-- Logs begin at Fri 2022-06-24 21:44:20 UTC, end at Fri 2022-06-24 23:31:51 UTC. -- Jun 24 22:24:42.149445 dv-cinder-847620-1-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jun 24 22:24:42.157585 dv-cinder-847620-1-iscsi devstack@keystone.service[80201]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 24 22:24:42.160662 dv-cinder-847620-1-iscsi devstack@keystone.service[80201]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jun 24 22:24:42 2022] *** Jun 24 22:24:42.160662 dv-cinder-847620-1-iscsi devstack@keystone.service[80201]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 24 22:24:42.160662 dv-cinder-847620-1-iscsi devstack@keystone.service[80201]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 24 22:24:42.160662 dv-cinder-847620-1-iscsi devstack@keystone.service[80201]: nodename: dv-cinder-847620-1-iscsi Jun 24 22:24:42.160662 dv-cinder-847620-1-iscsi devstack@keystone.service[80201]: machine: x86_64 Jun 24 22:24:42.160662 dv-cinder-847620-1-iscsi devstack@keystone.service[80201]: clock source: unix Jun 24 22:24:42.160662 dv-cinder-847620-1-iscsi devstack@keystone.service[80201]: pcre jit disabled Jun 24 22:24:42.160662 dv-cinder-847620-1-iscsi devstack@keystone.service[80201]: detected number of CPU cores: 4 Jun 24 22:24:42.160662 dv-cinder-847620-1-iscsi devstack@keystone.service[80201]: current working directory: / Jun 24 22:24:42.160662 dv-cinder-847620-1-iscsi devstack@keystone.service[80201]: detected binary path: /usr/bin/uwsgi-core Jun 24 22:24:42.160662 dv-cinder-847620-1-iscsi devstack@keystone.service[80201]: your processes number limit is 47680 Jun 24 22:24:42.160662 dv-cinder-847620-1-iscsi devstack@keystone.service[80201]: your memory page size is 4096 bytes Jun 24 22:24:42.161290 dv-cinder-847620-1-iscsi devstack@keystone.service[80201]: detected max file descriptor number: 2048 Jun 24 22:24:42.161290 dv-cinder-847620-1-iscsi devstack@keystone.service[80201]: lock engine: pthread robust mutexes Jun 24 22:24:42.161290 dv-cinder-847620-1-iscsi devstack@keystone.service[80201]: thunder lock: enabled Jun 24 22:24:42.161290 dv-cinder-847620-1-iscsi devstack@keystone.service[80201]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 24 22:24:42.161290 dv-cinder-847620-1-iscsi devstack@keystone.service[80201]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 24 22:24:42.204101 dv-cinder-847620-1-iscsi devstack@keystone.service[80201]: Python main interpreter initialized at 0x55ae5a7059c0 Jun 24 22:24:42.204101 dv-cinder-847620-1-iscsi devstack@keystone.service[80201]: python threads support enabled Jun 24 22:24:42.204101 dv-cinder-847620-1-iscsi devstack@keystone.service[80201]: your server socket listen backlog is limited to 100 connections Jun 24 22:24:42.204101 dv-cinder-847620-1-iscsi devstack@keystone.service[80201]: your mercy for graceful operations on workers is 90 seconds Jun 24 22:24:42.204480 dv-cinder-847620-1-iscsi devstack@keystone.service[80201]: mapped 403077 bytes (393 KB) for 2 cores Jun 24 22:24:42.204552 dv-cinder-847620-1-iscsi devstack@keystone.service[80201]: *** Operational MODE: preforking *** Jun 24 22:24:42.204806 dv-cinder-847620-1-iscsi devstack@keystone.service[80201]: *** uWSGI is running in multiple interpreter mode *** Jun 24 22:24:42.204806 dv-cinder-847620-1-iscsi devstack@keystone.service[80201]: spawned uWSGI master process (pid: 80201) Jun 24 22:24:42.205031 dv-cinder-847620-1-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jun 24 22:24:42.205783 dv-cinder-847620-1-iscsi devstack@keystone.service[80201]: spawned uWSGI worker 1 (pid: 80214, cores: 1) Jun 24 22:24:42.205886 dv-cinder-847620-1-iscsi devstack@keystone.service[80201]: spawned uWSGI worker 2 (pid: 80215, cores: 1) Jun 24 22:24:42.206026 dv-cinder-847620-1-iscsi devstack@keystone.service[80201]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 24 22:24:47.712006 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 22:24:47.712006 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: from cryptography.utils import int_from_bytes Jun 24 22:24:47.712820 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 22:24:47.712820 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: from cryptography.utils import int_from_bytes Jun 24 22:24:47.712820 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 22:24:47.712820 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: from cryptography.utils import int_from_bytes Jun 24 22:24:47.713382 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 22:24:47.713382 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: from cryptography.utils import int_from_bytes Jun 24 22:24:47.760924 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 24 22:24:47.761137 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 24 22:24:47.761296 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] command line args: [] {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 24 22:24:47.761446 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 24 22:24:47.761535 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 24 22:24:47.761618 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 24 22:24:47.761689 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ================================================================================ {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 24 22:24:47.761774 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] command line args: [] {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 24 22:24:47.761959 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] admin_token = **** {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 22:24:47.762083 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 24 22:24:47.762155 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ================================================================================ {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 24 22:24:47.762227 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] config_dir = [] {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 22:24:47.762356 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 22:24:47.762441 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] admin_token = **** {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 22:24:47.762507 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] config_source = [] {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 22:24:47.762617 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] config_dir = [] {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 22:24:47.762692 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] debug = True {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 22:24:47.762808 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 22:24:47.762884 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 22:24:47.763143 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] config_source = [] {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 22:24:47.763143 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] debug = True {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 22:24:47.763283 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 22:24:47.763361 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 22:24:47.763446 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 22:24:47.763585 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 22:24:47.763660 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 22:24:47.763765 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 22:24:47.763895 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 22:24:47.764008 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 22:24:47.764119 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] list_limit = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 22:24:47.764289 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 22:24:47.764412 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] log_config_append = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 22:24:47.764489 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 22:24:47.764548 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] list_limit = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 22:24:47.764609 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] log_dir = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 22:24:47.764665 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] log_config_append = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 22:24:47.764803 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] log_file = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 22:24:47.764901 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 22:24:47.765014 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] log_dir = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 22:24:47.765107 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 22:24:47.765204 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] log_file = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 22:24:47.765290 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 22:24:47.765405 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 22:24:47.765479 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 22:24:47.765594 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 22:24:47.765726 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 22:24:47.765851 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 22:24:47.765982 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 22:24:47.766101 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 22:24:47.766212 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 22:24:47.766212 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 22:24:47.766441 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 22:24:47.766556 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 22:24:47.766667 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 22:24:47.766781 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 22:24:47.766901 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 22:24:47.767010 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 22:24:47.767118 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 22:24:47.767218 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 22:24:47.767359 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 22:24:47.767480 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 22:24:47.767600 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 22:24:47.767709 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 22:24:47.767818 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 22:24:47.767925 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 22:24:47.768039 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 22:24:47.768154 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 22:24:47.768274 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 22:24:47.768391 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 22:24:47.768521 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 22:24:47.768639 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.36/identity {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 22:24:47.768718 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] publish_errors = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 22:24:47.768981 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 22:24:47.769146 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.36/identity {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 22:24:47.769146 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] publish_errors = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 22:24:47.769389 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 22:24:47.769389 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 22:24:47.769596 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 22:24:47.769596 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 22:24:47.769810 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 22:24:47.769926 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 22:24:47.770057 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 22:24:47.770180 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 22:24:47.770291 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] standard_threads = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 22:24:47.770400 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 22:24:47.770515 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 22:24:47.770673 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] standard_threads = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 22:24:47.770792 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 22:24:47.770911 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 22:24:47.771027 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 22:24:47.771027 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] use_journal = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 22:24:47.771232 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 22:24:47.771384 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] use_json = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 22:24:47.771495 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 22:24:47.771605 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] use_stderr = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 22:24:47.771720 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] use_journal = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 22:24:47.771831 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] use_syslog = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 22:24:47.771941 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] use_json = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 22:24:47.772061 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 22:24:47.772172 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] use_stderr = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 22:24:47.772172 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] use_syslog = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 22:24:47.772390 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.772500 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 22:24:47.772617 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.772727 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.772836 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.772946 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.773056 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.773171 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.773288 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.773398 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.773520 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.773631 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.773740 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.773848 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.773965 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.774076 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.774185 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.774294 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.774430 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.774575 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.774696 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.774812 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.774928 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.774928 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.775133 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.775242 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.775382 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.775539 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.775649 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.775649 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.775846 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.775846 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.776100 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.776100 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.776317 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.776317 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.776523 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.776523 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.776743 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.776853 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.776967 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.777077 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.777186 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.777342 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.777464 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.777574 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.777683 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.777791 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.777899 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.778008 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.778124 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.778236 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.778376 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.778494 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.778605 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.778713 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.778830 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.778948 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.779056 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.779164 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.779308 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.779469 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.779583 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.779583 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.779793 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.779903 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.780017 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.780017 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.780237 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.780237 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.780450 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.780565 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.780674 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.780794 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.780904 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.781019 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.781134 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.781243 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.781353 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.781535 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.781655 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.781764 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.781872 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.781981 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.782090 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.782210 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.782322 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.782431 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.782540 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.782649 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.782757 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.782874 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.782983 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.783093 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.783206 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.783358 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.783469 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.783591 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.783709 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.783825 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.783925 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.784019 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.784117 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.784222 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.784317 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.784409 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.784502 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.784593 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.784714 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.784823 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.784919 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.785036 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.785163 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.785274 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.785388 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.785508 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.785618 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.785736 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.785846 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.785961 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.786072 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.786191 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.786309 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.786429 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.786548 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.786671 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.786783 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.786898 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.787017 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.787128 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.787259 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.787382 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.787485 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.787595 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.787716 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.787834 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.787945 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.788055 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.788164 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.788272 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.788381 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.788499 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.788609 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.788719 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.788828 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.788937 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.789044 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.789162 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.789295 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.789406 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.789521 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.789637 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.789757 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.789868 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.789977 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.790086 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.790195 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.790305 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.790425 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.790542 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.790653 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.790763 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.790873 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.790987 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.791331 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.791450 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.791545 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.791649 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.791745 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.791840 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.791958 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.792069 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.792185 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.792185 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.792393 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.792501 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.792684 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.792797 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.792908 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.793024 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.793135 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.793244 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.793365 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.793493 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.793616 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.793727 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.793837 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.793947 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.794056 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.794171 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.794291 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.794401 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.794511 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.794620 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.794729 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.794838 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.794957 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.795068 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.795179 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.795302 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.795414 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.795540 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.795660 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.795771 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.795881 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.795991 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.796101 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.796101 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] auth.external = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.796322 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.796450 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.796587 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.796587 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] auth.external = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.796797 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.796923 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.797066 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.797066 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] auth.password = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.797293 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.797406 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] auth.token = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.797516 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.797627 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.797737 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] auth.password = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.797862 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.797975 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] auth.token = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.798086 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.798197 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.798314 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.798425 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.798544 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.798667 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.798779 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.798890 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.799006 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.799117 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.799237 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] credential.caching = True {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.799401 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.799513 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.799625 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.799735 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.799846 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] credential.caching = True {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.799960 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.800071 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.800183 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.800301 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.800413 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.800524 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.800641 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.800760 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.800872 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.800983 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.801095 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.801205 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.801324 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.801436 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.801546 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.801663 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.801775 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.801885 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.802003 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.802114 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.802224 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.802336 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.802446 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.802557 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.802675 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.802793 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.802904 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] federation.caching = True {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.803014 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.803124 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.803259 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.803387 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.803500 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] federation.caching = True {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.803610 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.803722 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.803833 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.803942 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.804061 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.804173 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.804283 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.804395 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.804505 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.804615 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.804734 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.804845 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.804956 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.805066 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.805179 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.805289 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.805407 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.805519 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.805640 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] identity.caching = True {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.805751 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.805861 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.805970 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.806151 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.806264 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] identity.caching = True {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.806375 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.806486 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.806597 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.806742 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.806867 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.806979 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.807074 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.807167 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.807377 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.807505 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.807505 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.807718 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.807828 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.807938 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.808047 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.808165 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.808277 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.808390 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.808501 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.808612 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.808722 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.808841 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.808953 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.809063 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.809173 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.809283 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.809393 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.809511 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.809624 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.809734 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.809845 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.809955 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.810064 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.810183 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.810294 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.810404 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.810515 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.810626 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.810737 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.810855 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.810974 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.811086 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.811197 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.811322 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.811433 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.811557 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.811669 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.811781 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.811892 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.812002 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.812112 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.812231 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.812343 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.812454 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.812564 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.812674 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.812790 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.812910 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.813091 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.813206 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.813316 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.813427 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.813536 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.813656 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.813767 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.813879 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.813988 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.814098 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.814208 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.814327 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.814437 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.814550 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.814659 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.814777 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.814890 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.815008 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.815120 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.815230 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.815371 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.815482 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.815591 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.815716 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.815828 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.815939 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.815939 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.816146 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.816146 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.816360 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.816471 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.816581 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.816691 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.816801 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.816801 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.817020 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.817132 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.817244 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.817362 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.user = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.817472 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.817583 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.817701 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.817812 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.817922 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.user = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.818033 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.818142 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.818252 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.818374 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.818487 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.818597 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.818707 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.818817 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.818935 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.819047 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.819158 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.819285 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.819398 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.819508 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.819629 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.819742 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.819852 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.819961 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.820071 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.820182 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.820300 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.820411 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.820521 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.820630 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.820740 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.820849 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.820970 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.821082 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.821194 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.821304 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.821415 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.821524 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.821641 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.821759 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.821870 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.821980 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.822090 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.822200 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.822402 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.822517 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.822629 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.822739 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.822850 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.822977 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.823162 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.823162 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.823427 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.823539 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.823649 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.823760 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.823884 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.823997 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.824108 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.824219 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.824330 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.824440 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.824558 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.824670 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.824780 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.824891 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.825000 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.825111 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.825229 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.825342 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.825452 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.825562 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.825562 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] resource.caching = True {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.825769 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.825888 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.825999 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.825999 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.826206 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.826316 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.826427 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.826578 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] resource.caching = True {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.826693 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.826803 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.826918 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.826918 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.827132 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.827267 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.827381 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.827493 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.827603 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.827714 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.827823 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.828013 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] role.caching = True {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.828128 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.828238 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] role.driver = sql {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.828349 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.828459 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.828570 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.828689 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.828800 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.828911 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.829021 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] role.caching = True {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.829131 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.829241 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] role.driver = sql {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.829359 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.829473 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.829584 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.829694 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.829804 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.829913 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.830033 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.830144 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.830254 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.830365 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.830475 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.830593 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.830706 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.830816 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.830926 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.831036 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.831147 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.831319 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.831434 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.831544 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.831544 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.831785 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.831896 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.832019 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.832131 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.832242 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.832353 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.832463 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.832463 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.832678 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.832792 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.832902 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.833013 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.833123 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.833234 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.833352 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.833464 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.833574 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.833684 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.833795 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.833906 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.834024 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.834136 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.834246 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.834357 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.834467 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.834577 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.834695 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.834808 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.834924 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.835035 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.835145 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.835276 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.835400 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.835514 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.835624 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.835735 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.835846 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.835964 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] token.caching = True {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.835964 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.836181 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.836181 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.836389 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.836499 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.836618 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.836729 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.836840 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.836956 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] token.caching = True {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.837066 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.837176 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.837294 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.837405 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.837515 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.837624 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.837734 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.837843 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.838053 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.838053 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.838371 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.838510 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.838607 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.838702 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.838822 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.838935 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.839046 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.839156 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.839297 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.839411 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.839534 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.839647 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.839757 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.839867 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.839976 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.840086 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] database.connection = **** {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.840208 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.840328 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.840447 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.840559 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.840668 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.840778 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.840888 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.840997 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.841116 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.841227 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.841336 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] database.connection = **** {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.841455 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.841573 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.841684 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.841793 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.841916 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.842027 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.842139 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.842248 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.842357 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.842467 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.842584 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.842696 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.842806 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.842916 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.843026 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.843136 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.843347 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.843462 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.843573 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.843683 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.843793 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.843793 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.844011 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.844124 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.844235 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.844345 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 24 22:24:47.844455 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.844455 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.844668 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.844818 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.845060 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.845299 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 22:24:47.845472 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 24 22:24:47.874520 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 22:24:47.874736 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 22:24:47.874849 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 22:24:47.874955 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 22:24:47.875082 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 22:24:47.875323 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 22:24:47.883767 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 22:24:47.884109 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 22:24:47.911411 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 22:24:47.911634 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 22:24:47.912353 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 22:24:47.912590 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 22:24:48.053693 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 22:24:48.053883 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 22:24:48.101939 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 22:24:48.102175 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 22:24:48.102553 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 22:24:48.102783 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 22:24:48.165279 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 22:24:48.165479 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 22:24:48.165732 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 22:24:48.165857 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 22:24:48.166022 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 22:24:48.166123 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 22:24:48.166266 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 22:24:48.166347 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 22:24:48.166410 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 22:24:48.166489 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 22:24:48.166944 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 22:24:48.166944 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 22:24:48.190751 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 22:24:48.190925 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 22:24:48.191058 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 22:24:48.191139 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 22:24:48.191201 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 22:24:48.191444 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 22:24:48.191574 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 22:24:48.191728 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 22:24:48.191811 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 22:24:48.191875 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 22:24:48.191996 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 22:24:48.192068 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 22:24:48.192142 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 22:24:48.192225 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 22:24:48.203110 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 22:24:48.203648 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 22:24:48.215838 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 22:24:48.216067 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 22:24:48.216212 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 22:24:48.216353 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 22:24:48.216435 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 22:24:48.216557 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 22:24:48.216637 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 22:24:48.216765 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 22:24:48.216846 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 22:24:48.216910 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 22:24:48.217026 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 22:24:48.217105 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80215) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 22:24:48.217222 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 22:24:48.217445 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80214) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 22:24:48.234085 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.234275 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 24 22:24:48.234404 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.234620 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 24 22:24:48.234767 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.234767 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 24 22:24:48.234909 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.235033 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.235115 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 24 22:24:48.235342 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.235487 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.235567 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.235631 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.235834 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.235959 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.236136 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.246574 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.246843 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.247012 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.247108 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.247307 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.247421 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.247572 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.247878 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.256097 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80215) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 22:24:48.256530 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80214) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 22:24:48.259406 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80215) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 22:24:48.259683 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.259993 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80214) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 22:24:48.260088 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.260153 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.260399 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.260530 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.260691 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.260815 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.261001 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.261141 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.261275 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.261355 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.261443 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.261527 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.261742 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.261878 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.262012 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.262091 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.262259 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.262383 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.262475 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.288908 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.289453 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.290519 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80215) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 22:24:48.290795 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.291050 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80214) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 22:24:48.291401 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.296086 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80215) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 22:24:48.296468 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.296689 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80214) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 22:24:48.296813 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.297073 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.297354 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.304088 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80215) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 22:24:48.304313 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.304721 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80214) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 22:24:48.305008 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.308993 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80215) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 22:24:48.309274 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.309555 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.309679 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80214) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 22:24:48.309843 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.309927 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.310084 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.310210 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.310349 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.310432 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.310606 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.310733 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.310864 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.310950 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.311242 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.311537 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.329629 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.329902 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.330391 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.330667 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.334483 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80215) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 22:24:48.335300 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80214) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 22:24:48.338127 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.338543 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.339138 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.339563 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.343644 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80215) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 22:24:48.344641 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80214) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 22:24:48.347234 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80215) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 22:24:48.348274 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80214) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 22:24:48.350990 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.351281 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.351584 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.351860 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.351984 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.352123 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.352226 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.352393 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.352486 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.352777 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.353050 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.353334 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.371667 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80215) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 22:24:48.371924 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.372212 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.372478 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.373154 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80214) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 22:24:48.373437 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.373715 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.373982 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.380358 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.382223 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.382350 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.382618 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.383980 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.384258 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.385913 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80215) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 22:24:48.386189 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.386464 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.386739 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.387023 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.387867 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80214) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 22:24:48.388146 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.388426 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.388705 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.388964 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.400294 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80215) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 22:24:48.400597 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.401044 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.401327 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.402585 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80214) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 22:24:48.402867 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.403004 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.403214 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.403366 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.403506 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.403589 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.405030 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.405318 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.405613 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.421486 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80215) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 22:24:48.423615 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80214) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 22:24:48.424811 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80215) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 22:24:48.426916 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80214) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 22:24:48.428133 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.429866 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.430262 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.431549 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80215) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 22:24:48.431883 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.432038 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.432148 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.433804 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80214) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 22:24:48.434281 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.434388 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.439577 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.441189 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80215) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 22:24:48.441911 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.443541 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80214) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 22:24:48.444444 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.444725 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.445111 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.445383 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.446775 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.447064 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.447614 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.448018 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.454637 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80215) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 22:24:48.454898 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.455196 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.457980 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80214) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 22:24:48.458270 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.458549 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.463076 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80215) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 22:24:48.463374 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.463649 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.463923 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.464188 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.464560 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.464838 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.465109 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.465376 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.465658 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.465929 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.466169 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.466441 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.466587 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80214) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 22:24:48.466702 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80215) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.466862 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.467129 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.467429 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.467700 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.468089 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.468366 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.468636 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.468919 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.469199 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.469475 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.469740 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.470021 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.470289 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80214) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 22:24:48.504607 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ae5a7059c0 pid: 80215 (default app) Jun 24 22:24:48.508413 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406b3a48-32c8-4419-953a-0e573c8e2f2a None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:24:48.508703 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406b3a48-32c8-4419-953a-0e573c8e2f2a None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:24:48.508981 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406b3a48-32c8-4419-953a-0e573c8e2f2a None None] PATH_INFO: `/v3` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:24:48.509264 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ae5a7059c0 pid: 80214 (default app) Jun 24 22:24:48.513303 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1/1] 10.222.0.36 () {50 vars in 791 bytes} [Fri Jun 24 22:24:48 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:24:56.194859 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992e416e-071d-421c-b825-e1156020b21a None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:24:56.195492 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992e416e-071d-421c-b825-e1156020b21a None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:24:56.195492 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992e416e-071d-421c-b825-e1156020b21a None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:24:56.200652 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1/2] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:24:56 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:24:56.207296 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab2573a-28c4-4aeb-a313-1c8ec8f58c3b None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:24:56.207670 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab2573a-28c4-4aeb-a313-1c8ec8f58c3b None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:24:56.207907 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab2573a-28c4-4aeb-a313-1c8ec8f58c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:24:56.278701 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: INFO dbcounter [None req-aab2573a-28c4-4aeb-a313-1c8ec8f58c3b None None] Registered counter for database keystone Jun 24 22:24:56.302882 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG oslo_db.sqlalchemy.engines [None req-aab2573a-28c4-4aeb-a313-1c8ec8f58c3b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80215) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 22:24:56.312499 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writer thread running {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 22:24:56.492312 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG passlib.handlers.bcrypt [None req-aab2573a-28c4-4aeb-a313-1c8ec8f58c3b None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80215) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 24 22:24:56.492811 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG passlib.handlers.bcrypt [None req-aab2573a-28c4-4aeb-a313-1c8ec8f58c3b None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80215) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 24 22:24:56.550178 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-aab2573a-28c4-4aeb-a313-1c8ec8f58c3b None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:24:56.551846 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-aab2573a-28c4-4aeb-a313-1c8ec8f58c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:24:56.688402 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 2/3] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:24:56 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 483 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 24 22:24:56.873771 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992e416e-071d-421c-b825-e1156020b21a None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:24:56.951192 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: INFO dbcounter [None req-992e416e-071d-421c-b825-e1156020b21a None None] Registered counter for database keystone Jun 24 22:24:56.972900 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG oslo_db.sqlalchemy.engines [None req-992e416e-071d-421c-b825-e1156020b21a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80214) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 22:24:56.985126 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writer thread running {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 22:24:57.110249 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992e416e-071d-421c-b825-e1156020b21a None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:24:57.115717 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d8ffbd-ec15-4a14-8ad9-51266193dc51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:24:57.116385 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d8ffbd-ec15-4a14-8ad9-51266193dc51 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:24:57.116671 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d8ffbd-ec15-4a14-8ad9-51266193dc51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:24:57.116946 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d8ffbd-ec15-4a14-8ad9-51266193dc51 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:24:57.125485 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d8ffbd-ec15-4a14-8ad9-51266193dc51 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:24:57.177560 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: WARNING keystone.common.rbac_enforcer.enforcer [None req-62d8ffbd-ec15-4a14-8ad9-51266193dc51 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 24 22:24:57.177905 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d8ffbd-ec15-4a14-8ad9-51266193dc51 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:24:57.188507 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 2/4] 10.222.0.36 () {58 vars in 1324 bytes} [Fri Jun 24 22:24:56 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 22:24:57.194849 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab2573a-28c4-4aeb-a313-1c8ec8f58c3b None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:24:57.210093 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab2573a-28c4-4aeb-a313-1c8ec8f58c3b None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:24:57.219051 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121018bc-8339-4856-b8f1-25c3a28aefc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:24:57.220782 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121018bc-8339-4856-b8f1-25c3a28aefc0 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:24:57.221164 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121018bc-8339-4856-b8f1-25c3a28aefc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:24:57.221514 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121018bc-8339-4856-b8f1-25c3a28aefc0 admin admin] PATH_INFO: `/v3/projects/ed521bc1cbbe4ae1823626f007bced73` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:24:57.228203 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121018bc-8339-4856-b8f1-25c3a28aefc0 admin admin] RBAC: Authorizing `identity:get_project(project_id=ed521bc1cbbe4ae1823626f007bced73)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:24:57.285265 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: WARNING keystone.common.rbac_enforcer.enforcer [None req-121018bc-8339-4856-b8f1-25c3a28aefc0 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 24 22:24:57.285604 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121018bc-8339-4856-b8f1-25c3a28aefc0 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:24:57.290172 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 3/5] 10.222.0.36 () {56 vars in 1207 bytes} [Fri Jun 24 22:24:57 2022] GET /identity/v3/projects/ed521bc1cbbe4ae1823626f007bced73 => generated 344 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:24:59.278734 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7267e7-8c6e-4f2a-85b8-fac2e778b5a7 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:24:59.279324 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7267e7-8c6e-4f2a-85b8-fac2e778b5a7 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:24:59.279324 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7267e7-8c6e-4f2a-85b8-fac2e778b5a7 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:24:59.283450 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 3/6] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:24:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 22:24:59.290120 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d4cef9-8d55-40cf-9578-b6ed197a63e3 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:24:59.290841 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d4cef9-8d55-40cf-9578-b6ed197a63e3 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:24:59.291024 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d4cef9-8d55-40cf-9578-b6ed197a63e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:24:59.313525 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-73d4cef9-8d55-40cf-9578-b6ed197a63e3 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:24:59.315035 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-73d4cef9-8d55-40cf-9578-b6ed197a63e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:24:59.323734 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 4/7] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:24:59 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 24 22:24:59.346387 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7267e7-8c6e-4f2a-85b8-fac2e778b5a7 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:24:59.359990 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7267e7-8c6e-4f2a-85b8-fac2e778b5a7 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:24:59.364781 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea76e50e-25f7-49d2-acd7-4380bf91a011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:24:59.365432 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea76e50e-25f7-49d2-acd7-4380bf91a011 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:24:59.365717 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea76e50e-25f7-49d2-acd7-4380bf91a011 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:24:59.365992 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea76e50e-25f7-49d2-acd7-4380bf91a011 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:24:59.374013 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea76e50e-25f7-49d2-acd7-4380bf91a011 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:24:59.375860 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea76e50e-25f7-49d2-acd7-4380bf91a011 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:24:59.385113 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 4/8] 10.222.0.36 () {58 vars in 1324 bytes} [Fri Jun 24 22:24:59 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 22:24:59.391485 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d4cef9-8d55-40cf-9578-b6ed197a63e3 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:24:59.404908 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d4cef9-8d55-40cf-9578-b6ed197a63e3 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:24:59.410730 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47b2c54-e086-48ad-b595-857ece28d6b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:24:59.411642 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47b2c54-e086-48ad-b595-857ece28d6b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:24:59.411926 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47b2c54-e086-48ad-b595-857ece28d6b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:24:59.412203 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47b2c54-e086-48ad-b595-857ece28d6b8 admin admin] PATH_INFO: `/v3/users/e1b71ca6ab0b436d901fe1079176cb45` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:24:59.413756 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47b2c54-e086-48ad-b595-857ece28d6b8 admin admin] RBAC: Authorizing `identity:get_user(user_id=e1b71ca6ab0b436d901fe1079176cb45)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:24:59.415661 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47b2c54-e086-48ad-b595-857ece28d6b8 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:24:59.417403 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 5/9] 10.222.0.36 () {56 vars in 1198 bytes} [Fri Jun 24 22:24:59 2022] GET /identity/v3/users/e1b71ca6ab0b436d901fe1079176cb45 => generated 247 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:01.502019 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c6c43a-a5aa-4d9b-a39e-4151d6e90524 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:01.502541 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c6c43a-a5aa-4d9b-a39e-4151d6e90524 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:01.502620 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c6c43a-a5aa-4d9b-a39e-4151d6e90524 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:01.503997 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 5/10] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:25:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:25:01.509745 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a565fabf-f50f-4088-a153-c69e8e7904e6 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:01.510674 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a565fabf-f50f-4088-a153-c69e8e7904e6 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:01.510674 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a565fabf-f50f-4088-a153-c69e8e7904e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:01.527818 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-a565fabf-f50f-4088-a153-c69e8e7904e6 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:25:01.528997 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-a565fabf-f50f-4088-a153-c69e8e7904e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:25:01.540781 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8926b92-483b-4cbb-9c87-fa363c0a58ca None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:01.541761 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8926b92-483b-4cbb-9c87-fa363c0a58ca None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:01.542087 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8926b92-483b-4cbb-9c87-fa363c0a58ca None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:01.543572 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 6/11] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:25:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:25:01.548625 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d44ebf-e2f8-4d40-81de-773ea397a30f None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:01.548973 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d44ebf-e2f8-4d40-81de-773ea397a30f None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:01.549276 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d44ebf-e2f8-4d40-81de-773ea397a30f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:01.588798 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG passlib.handlers.bcrypt [None req-24d44ebf-e2f8-4d40-81de-773ea397a30f None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80214) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 24 22:25:01.589211 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG passlib.handlers.bcrypt [None req-24d44ebf-e2f8-4d40-81de-773ea397a30f None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80214) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 24 22:25:01.616238 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 6/12] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:25:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 22:25:01.634574 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-24d44ebf-e2f8-4d40-81de-773ea397a30f None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:25:01.636221 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-24d44ebf-e2f8-4d40-81de-773ea397a30f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:25:01.640257 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a565fabf-f50f-4088-a153-c69e8e7904e6 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:01.664904 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:01.735687 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 7/13] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:25:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 22:25:01.744687 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a565fabf-f50f-4088-a153-c69e8e7904e6 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:01.758176 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d44ebf-e2f8-4d40-81de-773ea397a30f None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:01.780491 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b42fbc-71e3-4b69-88e1-922115a38774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:01.781314 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b42fbc-71e3-4b69-88e1-922115a38774 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:01.781600 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b42fbc-71e3-4b69-88e1-922115a38774 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:01.781880 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b42fbc-71e3-4b69-88e1-922115a38774 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:01.793213 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b42fbc-71e3-4b69-88e1-922115a38774 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 22:25:01.804369 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-28b42fbc-71e3-4b69-88e1-922115a38774 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 22:25:01.804369 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:25:01.804369 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:25:01.804369 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:25:01.804369 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:25:01.804369 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:25:01.804369 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:25:01.804369 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:25:01.804369 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:25:01.804369 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:25:01.804369 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:25:01.804369 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:25:01.804369 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 22:25:01.804369 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 22:25:01.804369 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 22:25:01.804369 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 22:25:01.805358 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 22:25:01.805358 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 22:25:01.805358 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 22:25:01.805358 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 22:25:01.805358 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:25:01.805358 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:25:01.805358 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:25:01.805358 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:25:01.805358 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:25:01.805358 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:25:01.805358 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:25:01.805358 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:25:01.805358 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:25:01.805358 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:25:01.805358 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:25:01.805358 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:25:01.806403 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:25:01.806403 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:25:01.806403 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:25:01.806403 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:25:01.806403 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 22:25:01.806403 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 22:25:01.806403 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 22:25:01.806403 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 22:25:01.806403 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 22:25:01.806403 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 22:25:01.806403 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 22:25:01.806403 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:25:01.806403 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 7/14] 10.222.0.36 () {56 vars in 1096 bytes} [Fri Jun 24 22:25:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:25:01.811781 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b42fbc-71e3-4b69-88e1-922115a38774 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:01.859519 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d44ebf-e2f8-4d40-81de-773ea397a30f None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:01.861880 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:01.894339 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:01.896155 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7581d7e-8e2e-4a06-8389-f691b3564d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:01.897071 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7581d7e-8e2e-4a06-8389-f691b3564d77 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:01.897379 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7581d7e-8e2e-4a06-8389-f691b3564d77 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:01.897659 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7581d7e-8e2e-4a06-8389-f691b3564d77 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:01.912964 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b42fbc-71e3-4b69-88e1-922115a38774 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:01.947014 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c299a89-926f-42d9-b453-a474f9cd179f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:01.947800 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c299a89-926f-42d9-b453-a474f9cd179f None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:01.948076 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c299a89-926f-42d9-b453-a474f9cd179f None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:01.948355 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c299a89-926f-42d9-b453-a474f9cd179f None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:01.949112 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c299a89-926f-42d9-b453-a474f9cd179f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:25:01.949422 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c299a89-926f-42d9-b453-a474f9cd179f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:01.950851 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c299a89-926f-42d9-b453-a474f9cd179f None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:01.962847 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 8/15] 10.222.0.36 () {56 vars in 1099 bytes} [Fri Jun 24 22:25:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:01.967285 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7581d7e-8e2e-4a06-8389-f691b3564d77 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:01.968439 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c299a89-926f-42d9-b453-a474f9cd179f None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:01.968854 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7581d7e-8e2e-4a06-8389-f691b3564d77 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:02.065161 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c299a89-926f-42d9-b453-a474f9cd179f None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:02.069130 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 8/16] 10.222.0.36 () {58 vars in 1282 bytes} [Fri Jun 24 22:25:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 22:25:02.075227 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7581d7e-8e2e-4a06-8389-f691b3564d77 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:02.078037 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:02.101767 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe5da1d-de21-4851-b39e-ad255ae5b238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:02.102657 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe5da1d-de21-4851-b39e-ad255ae5b238 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:02.102949 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe5da1d-de21-4851-b39e-ad255ae5b238 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:02.103234 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe5da1d-de21-4851-b39e-ad255ae5b238 None admin] PATH_INFO: `/v3/users/e1b71ca6ab0b436d901fe1079176cb45` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:02.104572 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe5da1d-de21-4851-b39e-ad255ae5b238 None admin] RBAC: Authorizing `identity:get_user(user_id=e1b71ca6ab0b436d901fe1079176cb45)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:02.106077 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe5da1d-de21-4851-b39e-ad255ae5b238 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:02.108311 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 9/17] 10.222.0.36 () {56 vars in 1177 bytes} [Fri Jun 24 22:25:01 2022] GET /identity/v3/users/e1b71ca6ab0b436d901fe1079176cb45 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 22:25:02.113474 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe5da1d-de21-4851-b39e-ad255ae5b238 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:02.128524 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:02.173940 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7581d7e-8e2e-4a06-8389-f691b3564d77 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:02.209402 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468e4a58-5d52-4f2f-8d68-58ed056c6f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:02.210207 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e4a58-5d52-4f2f-8d68-58ed056c6f06 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:02.210473 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e4a58-5d52-4f2f-8d68-58ed056c6f06 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:02.210747 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e4a58-5d52-4f2f-8d68-58ed056c6f06 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:02.217984 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe5da1d-de21-4851-b39e-ad255ae5b238 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:02.229227 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468e4a58-5d52-4f2f-8d68-58ed056c6f06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:02.230726 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468e4a58-5d52-4f2f-8d68-58ed056c6f06 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:02.253007 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-468e4a58-5d52-4f2f-8d68-58ed056c6f06 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:25:02.253007 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:25:02.253007 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:25:02.253007 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:25:02.253007 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:25:02.253007 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:25:02.253007 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:25:02.253007 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:25:02.253007 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:25:02.253007 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:25:02.253007 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:25:02.253007 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:25:02.253007 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 22:25:02.253007 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 22:25:02.253007 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 22:25:02.253809 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 22:25:02.253809 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:25:02.253809 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:25:02.253809 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:25:02.253809 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:25:02.253809 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:25:02.253809 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:25:02.253809 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:25:02.253809 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:25:02.253809 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:25:02.253809 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:25:02.253809 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:25:02.253809 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:25:02.253809 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:25:02.253809 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:25:02.253809 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:25:02.253809 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:25:02.254580 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 22:25:02.254580 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 22:25:02.254580 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:25:02.254580 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:25:02.254784 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb86cf7-dc71-4bed-a009-8d1b99288577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:02.254784 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb86cf7-dc71-4bed-a009-8d1b99288577 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:02.254920 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 9/18] 10.222.0.36 () {56 vars in 1108 bytes} [Fri Jun 24 22:25:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:25:02.254990 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb86cf7-dc71-4bed-a009-8d1b99288577 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:02.254990 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb86cf7-dc71-4bed-a009-8d1b99288577 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:02.256236 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb86cf7-dc71-4bed-a009-8d1b99288577 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:02.257705 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb86cf7-dc71-4bed-a009-8d1b99288577 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:02.259504 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 10/19] 10.222.0.36 () {56 vars in 1108 bytes} [Fri Jun 24 22:25:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:02.260590 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468e4a58-5d52-4f2f-8d68-58ed056c6f06 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:02.265071 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb86cf7-dc71-4bed-a009-8d1b99288577 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:02.315796 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:02.346562 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:02.362699 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468e4a58-5d52-4f2f-8d68-58ed056c6f06 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:02.365954 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb86cf7-dc71-4bed-a009-8d1b99288577 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:02.397165 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9c962d-a1e9-41a9-b387-a427877a6674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:02.397826 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9c962d-a1e9-41a9-b387-a427877a6674 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:02.398088 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9c962d-a1e9-41a9-b387-a427877a6674 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:02.398364 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9c962d-a1e9-41a9-b387-a427877a6674 None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:02.398666 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5461f3c-a263-4924-9ed4-9e7d5bb55b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:02.399100 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9c962d-a1e9-41a9-b387-a427877a6674 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:25:02.399423 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5461f3c-a263-4924-9ed4-9e7d5bb55b52 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:02.399513 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9c962d-a1e9-41a9-b387-a427877a6674 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:02.399713 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5461f3c-a263-4924-9ed4-9e7d5bb55b52 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:02.399990 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5461f3c-a263-4924-9ed4-9e7d5bb55b52 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:02.400953 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5461f3c-a263-4924-9ed4-9e7d5bb55b52 None admin] RBAC: Adding query filter params (role.id=1a1c43cc97a0407eb7a7c7a1333a9d4a, scope.domain.id=default, user.id=e1b71ca6ab0b436d901fe1079176cb45) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:25:02.401087 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9c962d-a1e9-41a9-b387-a427877a6674 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:02.401265 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5461f3c-a263-4924-9ed4-9e7d5bb55b52 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:02.402698 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5461f3c-a263-4924-9ed4-9e7d5bb55b52 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:02.409488 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 11/20] 10.222.0.36 () {56 vars in 1322 bytes} [Fri Jun 24 22:25:02 2022] GET /identity/v3/role_assignments?user.id=e1b71ca6ab0b436d901fe1079176cb45&scope.domain.id=default&role.id=1a1c43cc97a0407eb7a7c7a1333a9d4a => generated 233 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:02.419430 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 10/21] 10.222.0.36 () {56 vars in 1109 bytes} [Fri Jun 24 22:25:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 22:25:04.869122 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93627e7c-ce57-4ac0-abd1-3dd993ff3a3d None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:04.870424 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93627e7c-ce57-4ac0-abd1-3dd993ff3a3d None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:04.870995 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93627e7c-ce57-4ac0-abd1-3dd993ff3a3d None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:04.872993 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 12/22] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:25:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:25:04.878445 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b44470-4236-4f52-9db3-23caf6bc20f2 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:04.879417 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b44470-4236-4f52-9db3-23caf6bc20f2 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:04.879970 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b44470-4236-4f52-9db3-23caf6bc20f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:04.901669 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-a9b44470-4236-4f52-9db3-23caf6bc20f2 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:25:04.903233 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-a9b44470-4236-4f52-9db3-23caf6bc20f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:25:04.990552 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 11/23] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:25:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 22:25:05.028220 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93627e7c-ce57-4ac0-abd1-3dd993ff3a3d None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:05.159750 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa4ce35-e198-4916-99a8-edee76e6c27e None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:05.160386 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa4ce35-e198-4916-99a8-edee76e6c27e None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:05.160883 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa4ce35-e198-4916-99a8-edee76e6c27e None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:05.162783 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 12/24] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:25:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:25:05.167313 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93627e7c-ce57-4ac0-abd1-3dd993ff3a3d None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:05.168736 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0762bba-ff16-4167-b800-7882d2709100 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:05.169241 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0762bba-ff16-4167-b800-7882d2709100 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:05.169712 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0762bba-ff16-4167-b800-7882d2709100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:05.210966 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-b0762bba-ff16-4167-b800-7882d2709100 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:25:05.212210 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-b0762bba-ff16-4167-b800-7882d2709100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:25:05.238649 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b60d8cd-9d4f-43b5-a459-ac0955bcd688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:05.239491 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b60d8cd-9d4f-43b5-a459-ac0955bcd688 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:05.239777 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b60d8cd-9d4f-43b5-a459-ac0955bcd688 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:05.240053 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b60d8cd-9d4f-43b5-a459-ac0955bcd688 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:05.258236 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b60d8cd-9d4f-43b5-a459-ac0955bcd688 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 22:25:05.265988 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-4b60d8cd-9d4f-43b5-a459-ac0955bcd688 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 22:25:05.265988 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:25:05.265988 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:25:05.265988 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:25:05.265988 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:25:05.265988 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:25:05.265988 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:25:05.265988 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:25:05.265988 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:25:05.265988 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:25:05.265988 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:25:05.265988 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:25:05.265988 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 22:25:05.265988 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 22:25:05.265988 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 22:25:05.265988 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 22:25:05.266820 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 22:25:05.266820 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 22:25:05.266820 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 22:25:05.266820 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 22:25:05.266820 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:25:05.266820 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:25:05.266820 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:25:05.266820 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:25:05.266820 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:25:05.266820 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:25:05.266820 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:25:05.266820 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:25:05.266820 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:25:05.266820 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:25:05.266820 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:25:05.266820 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:25:05.267591 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:25:05.267591 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:25:05.267591 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:25:05.267591 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:25:05.267591 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 22:25:05.267591 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 22:25:05.267591 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 22:25:05.267591 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 22:25:05.267591 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 22:25:05.267591 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 22:25:05.267591 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 22:25:05.267591 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:25:05.267591 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 13/25] 10.222.0.36 () {56 vars in 1096 bytes} [Fri Jun 24 22:25:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:25:05.274213 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b60d8cd-9d4f-43b5-a459-ac0955bcd688 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:05.283305 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:05.313479 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:05.360502 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 13/26] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:25:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 22:25:05.396571 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0762bba-ff16-4167-b800-7882d2709100 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:05.410047 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b60d8cd-9d4f-43b5-a459-ac0955bcd688 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:05.459089 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eb45e9-abd0-4b6b-bcf8-41d7eb0d137d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:05.459808 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eb45e9-abd0-4b6b-bcf8-41d7eb0d137d None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:05.460087 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eb45e9-abd0-4b6b-bcf8-41d7eb0d137d None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:05.460360 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eb45e9-abd0-4b6b-bcf8-41d7eb0d137d None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:05.461118 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eb45e9-abd0-4b6b-bcf8-41d7eb0d137d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:25:05.461422 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eb45e9-abd0-4b6b-bcf8-41d7eb0d137d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:05.463202 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eb45e9-abd0-4b6b-bcf8-41d7eb0d137d None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:05.472391 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 14/27] 10.222.0.36 () {56 vars in 1099 bytes} [Fri Jun 24 22:25:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 22:25:05.473868 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201482b3-d104-4a3a-9dc6-656a2c68684a None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:05.474160 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201482b3-d104-4a3a-9dc6-656a2c68684a None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:05.474433 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201482b3-d104-4a3a-9dc6-656a2c68684a None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:05.475931 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 15/28] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:25:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:25:05.480305 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201482b3-d104-4a3a-9dc6-656a2c68684a None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:05.577117 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0762bba-ff16-4167-b800-7882d2709100 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:05.579477 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:05.615097 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c86e91-0841-4ba1-b28b-9503b1eaf22c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:05.615830 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c86e91-0841-4ba1-b28b-9503b1eaf22c None admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:05.616121 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c86e91-0841-4ba1-b28b-9503b1eaf22c None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:05.616400 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c86e91-0841-4ba1-b28b-9503b1eaf22c None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:05.617173 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c86e91-0841-4ba1-b28b-9503b1eaf22c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:05.618402 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201482b3-d104-4a3a-9dc6-656a2c68684a None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:05.618576 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c86e91-0841-4ba1-b28b-9503b1eaf22c None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:05.656597 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d394cb2-9fab-44d9-9701-b49b79ce4ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:05.657485 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d394cb2-9fab-44d9-9701-b49b79ce4ea2 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:05.657765 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d394cb2-9fab-44d9-9701-b49b79ce4ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:05.658032 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d394cb2-9fab-44d9-9701-b49b79ce4ea2 None admin] PATH_INFO: `/v3/users/e1b71ca6ab0b436d901fe1079176cb45` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:05.659230 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d394cb2-9fab-44d9-9701-b49b79ce4ea2 None admin] RBAC: Authorizing `identity:get_user(user_id=e1b71ca6ab0b436d901fe1079176cb45)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:05.660769 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d394cb2-9fab-44d9-9701-b49b79ce4ea2 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:05.662498 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 16/29] 10.222.0.36 () {56 vars in 1177 bytes} [Fri Jun 24 22:25:05 2022] GET /identity/v3/users/e1b71ca6ab0b436d901fe1079176cb45 => generated 247 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:05.663619 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d59a27-aec8-4645-b619-de67a009ff9d None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:05.663906 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d59a27-aec8-4645-b619-de67a009ff9d None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:05.664181 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d59a27-aec8-4645-b619-de67a009ff9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:05.680759 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-f3d59a27-aec8-4645-b619-de67a009ff9d None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:25:05.682007 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-f3d59a27-aec8-4645-b619-de67a009ff9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:25:05.748686 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 17/30] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:25:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 22:25:05.749880 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8c168e-2d96-4a30-b3fc-60349db16f7f None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:05.750172 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8c168e-2d96-4a30-b3fc-60349db16f7f None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:05.750458 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8c168e-2d96-4a30-b3fc-60349db16f7f None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:05.751914 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 18/31] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:25:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:25:05.752822 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e143b746-f5aa-4f31-93aa-dedbab27af98 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:05.753158 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e143b746-f5aa-4f31-93aa-dedbab27af98 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:05.753439 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e143b746-f5aa-4f31-93aa-dedbab27af98 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:05.754899 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 19/32] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:25:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:25:05.755696 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e143b746-f5aa-4f31-93aa-dedbab27af98 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:05.757374 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 14/33] 10.222.0.36 () {60 vars in 1131 bytes} [Fri Jun 24 22:25:05 2022] POST /identity/v3/roles => generated 219 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 22:25:05.758919 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0406a17e-dba2-4b90-9786-248a3444f5d3 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:05.759215 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0406a17e-dba2-4b90-9786-248a3444f5d3 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:05.759617 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0406a17e-dba2-4b90-9786-248a3444f5d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:05.778449 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-0406a17e-dba2-4b90-9786-248a3444f5d3 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:25:05.780064 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-0406a17e-dba2-4b90-9786-248a3444f5d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:25:05.812660 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:05.855616 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:05.861065 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 15/34] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:25:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 22:25:05.862602 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea985b1-4de6-4e1a-a449-9d37dc629f84 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:05.871319 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea985b1-4de6-4e1a-a449-9d37dc629f84 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:05.871712 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea985b1-4de6-4e1a-a449-9d37dc629f84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:05.899344 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-3ea985b1-4de6-4e1a-a449-9d37dc629f84 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:25:05.900749 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-3ea985b1-4de6-4e1a-a449-9d37dc629f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:25:05.902466 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e143b746-f5aa-4f31-93aa-dedbab27af98 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:05.941488 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bb5b9b-9264-44d8-bcaa-e9123c24890b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:05.942218 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bb5b9b-9264-44d8-bcaa-e9123c24890b None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:05.942503 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bb5b9b-9264-44d8-bcaa-e9123c24890b None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:05.942782 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bb5b9b-9264-44d8-bcaa-e9123c24890b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:05.944157 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bb5b9b-9264-44d8-bcaa-e9123c24890b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:05.945550 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bb5b9b-9264-44d8-bcaa-e9123c24890b None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:05.948153 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 20/35] 10.222.0.36 () {56 vars in 1108 bytes} [Fri Jun 24 22:25:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:05.949014 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bb5b9b-9264-44d8-bcaa-e9123c24890b None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:05.993463 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 16/36] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:25:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 22:25:05.993463 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea985b1-4de6-4e1a-a449-9d37dc629f84 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:06.073177 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bb5b9b-9264-44d8-bcaa-e9123c24890b None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:06.103951 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:06.107515 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:06.110002 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ff21eb-c9a5-4645-9bb7-5c0bb42883e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:06.110883 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff21eb-c9a5-4645-9bb7-5c0bb42883e0 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:06.111276 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff21eb-c9a5-4645-9bb7-5c0bb42883e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:06.111514 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff21eb-c9a5-4645-9bb7-5c0bb42883e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:06.115945 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea985b1-4de6-4e1a-a449-9d37dc629f84 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:06.122562 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ff21eb-c9a5-4645-9bb7-5c0bb42883e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:06.124098 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ff21eb-c9a5-4645-9bb7-5c0bb42883e0 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:06.147428 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-25ff21eb-c9a5-4645-9bb7-5c0bb42883e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:25:06.147428 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:25:06.147428 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:25:06.147428 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:25:06.147428 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:25:06.147428 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:25:06.147428 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:25:06.147428 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:25:06.147428 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:25:06.147428 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:25:06.147428 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:25:06.147428 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:25:06.147428 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 22:25:06.147428 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 22:25:06.147428 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 22:25:06.148296 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 22:25:06.148296 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:25:06.148296 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:25:06.148296 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:25:06.148296 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:25:06.148296 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:25:06.148296 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:25:06.148296 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:25:06.148296 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:25:06.148296 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:25:06.148296 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:25:06.148296 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:25:06.148296 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:25:06.148296 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:25:06.148296 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:25:06.148296 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:25:06.148296 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:25:06.149092 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 22:25:06.149092 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 22:25:06.149092 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:25:06.149092 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:25:06.151320 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 21/37] 10.222.0.36 () {56 vars in 1108 bytes} [Fri Jun 24 22:25:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:25:06.151320 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ff21eb-c9a5-4645-9bb7-5c0bb42883e0 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:06.158913 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9feb045-be96-4eb1-b63f-0995932d7a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:06.159624 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9feb045-be96-4eb1-b63f-0995932d7a48 None admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:06.160198 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9feb045-be96-4eb1-b63f-0995932d7a48 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:06.160317 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9feb045-be96-4eb1-b63f-0995932d7a48 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:06.161050 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9feb045-be96-4eb1-b63f-0995932d7a48 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:06.162620 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9feb045-be96-4eb1-b63f-0995932d7a48 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:06.180372 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 17/38] 10.222.0.36 () {60 vars in 1131 bytes} [Fri Jun 24 22:25:05 2022] POST /identity/v3/roles => generated 223 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:25:06.188698 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9feb045-be96-4eb1-b63f-0995932d7a48 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:06.281891 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ff21eb-c9a5-4645-9bb7-5c0bb42883e0 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:06.321517 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621cb6a9-241f-4023-86ab-39028b99e9c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:06.322483 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621cb6a9-241f-4023-86ab-39028b99e9c4 None admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:06.322766 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621cb6a9-241f-4023-86ab-39028b99e9c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:06.323047 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621cb6a9-241f-4023-86ab-39028b99e9c4 None admin] PATH_INFO: `/v3/domains/default/users/e1b71ca6ab0b436d901fe1079176cb45/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:06.324683 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9feb045-be96-4eb1-b63f-0995932d7a48 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:06.325279 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621cb6a9-241f-4023-86ab-39028b99e9c4 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=e1b71ca6ab0b436d901fe1079176cb45, role_id=1a1c43cc97a0407eb7a7c7a1333a9d4a)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:06.326985 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621cb6a9-241f-4023-86ab-39028b99e9c4 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:06.365453 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cb89c7-acc8-4ed1-96b6-dcddfa9f227a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:06.366528 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cb89c7-acc8-4ed1-96b6-dcddfa9f227a None admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:06.367036 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cb89c7-acc8-4ed1-96b6-dcddfa9f227a None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:06.370143 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cb89c7-acc8-4ed1-96b6-dcddfa9f227a None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:06.370143 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cb89c7-acc8-4ed1-96b6-dcddfa9f227a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:06.370502 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cb89c7-acc8-4ed1-96b6-dcddfa9f227a None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:06.388102 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 18/39] 10.222.0.36 () {60 vars in 1131 bytes} [Fri Jun 24 22:25:06 2022] POST /identity/v3/roles => generated 225 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:25:06.388935 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cb89c7-acc8-4ed1-96b6-dcddfa9f227a None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:06.410436 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:06.468898 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 22/40] 10.222.0.36 () {58 vars in 1361 bytes} [Fri Jun 24 22:25:06 2022] PUT /identity/v3/domains/default/users/e1b71ca6ab0b436d901fe1079176cb45/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:25:06.470671 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08191018-3fab-4afc-8706-997298bbbbd2 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:06.470967 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08191018-3fab-4afc-8706-997298bbbbd2 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:06.471280 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08191018-3fab-4afc-8706-997298bbbbd2 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:06.475845 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 23/41] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:25:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:25:06.482657 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5826e066-42e7-4e84-8b71-818474a5b1a2 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:06.482956 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5826e066-42e7-4e84-8b71-818474a5b1a2 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:06.483421 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5826e066-42e7-4e84-8b71-818474a5b1a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:06.503877 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-5826e066-42e7-4e84-8b71-818474a5b1a2 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:25:06.505480 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-5826e066-42e7-4e84-8b71-818474a5b1a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:25:06.527850 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cb89c7-acc8-4ed1-96b6-dcddfa9f227a None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:06.567768 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:06.572936 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa38e23-24a8-4cdb-a2b4-d9159fb2a45d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:06.574109 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa38e23-24a8-4cdb-a2b4-d9159fb2a45d None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:06.574631 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa38e23-24a8-4cdb-a2b4-d9159fb2a45d None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:06.575142 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa38e23-24a8-4cdb-a2b4-d9159fb2a45d None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:06.576149 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa38e23-24a8-4cdb-a2b4-d9159fb2a45d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:25:06.576692 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa38e23-24a8-4cdb-a2b4-d9159fb2a45d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:06.578421 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa38e23-24a8-4cdb-a2b4-d9159fb2a45d None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:06.594107 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 19/42] 10.222.0.36 () {56 vars in 1109 bytes} [Fri Jun 24 22:25:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:06.603582 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 24/43] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:25:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 22:25:06.605964 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa38e23-24a8-4cdb-a2b4-d9159fb2a45d None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:06.621142 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5826e066-42e7-4e84-8b71-818474a5b1a2 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:06.710886 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:06.736799 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa38e23-24a8-4cdb-a2b4-d9159fb2a45d None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:06.775026 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be457b4-c5f7-4b77-9a81-51c446050cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:06.776062 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be457b4-c5f7-4b77-9a81-51c446050cf1 None admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:06.776352 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be457b4-c5f7-4b77-9a81-51c446050cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:06.776635 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be457b4-c5f7-4b77-9a81-51c446050cf1 None admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:06.777647 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be457b4-c5f7-4b77-9a81-51c446050cf1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:06.779155 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be457b4-c5f7-4b77-9a81-51c446050cf1 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:06.812106 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 20/44] 10.222.0.36 () {60 vars in 1141 bytes} [Fri Jun 24 22:25:06 2022] POST /identity/v3/projects => generated 301 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:25:06.853462 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5826e066-42e7-4e84-8b71-818474a5b1a2 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:06.892312 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d06a93-97d0-45be-be69-96caff204e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:06.893165 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d06a93-97d0-45be-be69-96caff204e1d None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:06.893455 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d06a93-97d0-45be-be69-96caff204e1d None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:06.893740 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d06a93-97d0-45be-be69-96caff204e1d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:06.895063 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d06a93-97d0-45be-be69-96caff204e1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:06.896770 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d06a93-97d0-45be-be69-96caff204e1d None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:06.898687 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 25/45] 10.222.0.36 () {56 vars in 1108 bytes} [Fri Jun 24 22:25:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 22:25:06.904523 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be457b4-c5f7-4b77-9a81-51c446050cf1 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:07.015299 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be457b4-c5f7-4b77-9a81-51c446050cf1 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:07.043653 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:07.052486 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54103eb-b615-4012-8b02-7f65341930b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:07.053167 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54103eb-b615-4012-8b02-7f65341930b9 None admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:07.053452 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54103eb-b615-4012-8b02-7f65341930b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:07.053786 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54103eb-b615-4012-8b02-7f65341930b9 None admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:07.054516 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54103eb-b615-4012-8b02-7f65341930b9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:07.056224 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54103eb-b615-4012-8b02-7f65341930b9 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:07.081389 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 21/46] 10.222.0.36 () {60 vars in 1141 bytes} [Fri Jun 24 22:25:06 2022] POST /identity/v3/projects => generated 312 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:25:08.554030 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887193f7-7ad6-43ea-909e-e5335fa65233 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:08.554572 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887193f7-7ad6-43ea-909e-e5335fa65233 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:08.554572 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887193f7-7ad6-43ea-909e-e5335fa65233 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:08.556017 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 26/47] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:25:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:25:08.561807 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaaf7c3-ab72-4afb-8a0b-6877ab1519e0 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:08.562245 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaaf7c3-ab72-4afb-8a0b-6877ab1519e0 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:08.562447 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaaf7c3-ab72-4afb-8a0b-6877ab1519e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:08.579889 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-fbaaf7c3-ab72-4afb-8a0b-6877ab1519e0 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:25:08.581085 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-fbaaf7c3-ab72-4afb-8a0b-6877ab1519e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:25:08.660470 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 22/48] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:25:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 22:25:08.684347 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887193f7-7ad6-43ea-909e-e5335fa65233 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:08.732841 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:08.793669 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887193f7-7ad6-43ea-909e-e5335fa65233 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:08.826674 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21949062-6e97-46df-bbcf-1fc157a58506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:08.827508 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21949062-6e97-46df-bbcf-1fc157a58506 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:08.827803 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21949062-6e97-46df-bbcf-1fc157a58506 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:08.828068 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21949062-6e97-46df-bbcf-1fc157a58506 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:08.838039 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21949062-6e97-46df-bbcf-1fc157a58506 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 22:25:08.845646 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-21949062-6e97-46df-bbcf-1fc157a58506 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 22:25:08.845646 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:25:08.845646 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:25:08.845646 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:25:08.845646 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:25:08.845646 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:25:08.845646 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:25:08.845646 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:25:08.845646 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:25:08.845646 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:25:08.845646 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:25:08.845646 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:25:08.845646 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 22:25:08.845646 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 22:25:08.845646 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 22:25:08.845646 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 22:25:08.846492 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 22:25:08.846492 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 22:25:08.846492 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 22:25:08.846492 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 22:25:08.846492 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:25:08.846492 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:25:08.846492 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:25:08.846492 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:25:08.846492 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:25:08.846492 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:25:08.846492 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:25:08.846492 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:25:08.846492 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:25:08.846492 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:25:08.846492 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:25:08.846492 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:25:08.847238 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:25:08.847238 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:25:08.847238 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:25:08.847238 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:25:08.847238 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 22:25:08.847238 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 22:25:08.847238 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 22:25:08.847238 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 22:25:08.847238 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 22:25:08.847238 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 22:25:08.847238 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 22:25:08.847238 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:25:08.847238 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 27/49] 10.222.0.36 () {56 vars in 1096 bytes} [Fri Jun 24 22:25:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:25:08.854225 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaaf7c3-ab72-4afb-8a0b-6877ab1519e0 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:08.957667 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaaf7c3-ab72-4afb-8a0b-6877ab1519e0 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:08.968549 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:08.992659 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f41e69-8f52-46b1-8ab9-c1f61dc65de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:08.993333 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f41e69-8f52-46b1-8ab9-c1f61dc65de5 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:08.993615 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f41e69-8f52-46b1-8ab9-c1f61dc65de5 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:08.993930 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f41e69-8f52-46b1-8ab9-c1f61dc65de5 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:08.994712 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f41e69-8f52-46b1-8ab9-c1f61dc65de5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:25:08.995019 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f41e69-8f52-46b1-8ab9-c1f61dc65de5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:08.996451 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f41e69-8f52-46b1-8ab9-c1f61dc65de5 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:09.008297 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 23/50] 10.222.0.36 () {56 vars in 1099 bytes} [Fri Jun 24 22:25:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:09.014136 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21949062-6e97-46df-bbcf-1fc157a58506 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:09.090200 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1243b9-1c46-4924-a547-8cc165de82a6 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:09.090467 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1243b9-1c46-4924-a547-8cc165de82a6 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:09.090744 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1243b9-1c46-4924-a547-8cc165de82a6 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:09.092181 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 24/51] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:25:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:25:09.097020 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db5bc9e-0ee5-4ebb-a5a8-124445dd16a4 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:09.097314 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db5bc9e-0ee5-4ebb-a5a8-124445dd16a4 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:09.097590 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db5bc9e-0ee5-4ebb-a5a8-124445dd16a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:09.114737 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-8db5bc9e-0ee5-4ebb-a5a8-124445dd16a4 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:25:09.115974 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-8db5bc9e-0ee5-4ebb-a5a8-124445dd16a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:25:09.116168 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21949062-6e97-46df-bbcf-1fc157a58506 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:09.117726 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:09.151789 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b3aa6c-3e78-47a8-9b49-f0e661f73e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:09.152687 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b3aa6c-3e78-47a8-9b49-f0e661f73e20 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:09.152982 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b3aa6c-3e78-47a8-9b49-f0e661f73e20 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:09.153260 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b3aa6c-3e78-47a8-9b49-f0e661f73e20 None admin] PATH_INFO: `/v3/users/e1b71ca6ab0b436d901fe1079176cb45` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:09.154532 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b3aa6c-3e78-47a8-9b49-f0e661f73e20 None admin] RBAC: Authorizing `identity:get_user(user_id=e1b71ca6ab0b436d901fe1079176cb45)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:09.156192 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b3aa6c-3e78-47a8-9b49-f0e661f73e20 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:09.157838 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 28/52] 10.222.0.36 () {56 vars in 1177 bytes} [Fri Jun 24 22:25:09 2022] GET /identity/v3/users/e1b71ca6ab0b436d901fe1079176cb45 => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:09.164787 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b3aa6c-3e78-47a8-9b49-f0e661f73e20 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:09.188689 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 25/53] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:25:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 22:25:09.212170 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db5bc9e-0ee5-4ebb-a5a8-124445dd16a4 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:09.268357 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b3aa6c-3e78-47a8-9b49-f0e661f73e20 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:09.301521 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193473e3-16ab-46f4-b923-2f57a4bca500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:09.302324 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193473e3-16ab-46f4-b923-2f57a4bca500 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:09.302603 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193473e3-16ab-46f4-b923-2f57a4bca500 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:09.302881 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193473e3-16ab-46f4-b923-2f57a4bca500 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:09.304141 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193473e3-16ab-46f4-b923-2f57a4bca500 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:09.305901 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193473e3-16ab-46f4-b923-2f57a4bca500 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:09.307764 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 29/54] 10.222.0.36 () {56 vars in 1108 bytes} [Fri Jun 24 22:25:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 22:25:09.308864 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db5bc9e-0ee5-4ebb-a5a8-124445dd16a4 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:09.310476 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:09.313824 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193473e3-16ab-46f4-b923-2f57a4bca500 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:09.355477 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:09.422387 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193473e3-16ab-46f4-b923-2f57a4bca500 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:09.455816 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c204e7f9-110d-4690-bd81-64257d1a4497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:09.456667 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c204e7f9-110d-4690-bd81-64257d1a4497 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:09.456952 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c204e7f9-110d-4690-bd81-64257d1a4497 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:09.457231 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c204e7f9-110d-4690-bd81-64257d1a4497 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:09.458413 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c204e7f9-110d-4690-bd81-64257d1a4497 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:09.458761 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6fb6ed-c5d4-47ae-b065-53f9e3d71d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:09.459460 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6fb6ed-c5d4-47ae-b065-53f9e3d71d49 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:09.459750 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6fb6ed-c5d4-47ae-b065-53f9e3d71d49 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:09.459922 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c204e7f9-110d-4690-bd81-64257d1a4497 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:09.460029 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6fb6ed-c5d4-47ae-b065-53f9e3d71d49 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:09.460870 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6fb6ed-c5d4-47ae-b065-53f9e3d71d49 None admin] RBAC: Adding query filter params (role.id=1a1c43cc97a0407eb7a7c7a1333a9d4a, scope.domain.id=default, user.id=e1b71ca6ab0b436d901fe1079176cb45) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:25:09.461188 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6fb6ed-c5d4-47ae-b065-53f9e3d71d49 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:09.461554 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 26/55] 10.222.0.36 () {56 vars in 1108 bytes} [Fri Jun 24 22:25:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 22:25:09.462890 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6fb6ed-c5d4-47ae-b065-53f9e3d71d49 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:09.467243 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c204e7f9-110d-4690-bd81-64257d1a4497 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:09.469136 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 30/56] 10.222.0.36 () {56 vars in 1322 bytes} [Fri Jun 24 22:25:09 2022] GET /identity/v3/role_assignments?user.id=e1b71ca6ab0b436d901fe1079176cb45&scope.domain.id=default&role.id=1a1c43cc97a0407eb7a7c7a1333a9d4a => generated 530 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 22:25:09.583146 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c204e7f9-110d-4690-bd81-64257d1a4497 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:09.621295 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4700a0d-6337-40e2-8e59-0a94c68b1e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:09.621295 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4700a0d-6337-40e2-8e59-0a94c68b1e5b None admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:09.621295 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4700a0d-6337-40e2-8e59-0a94c68b1e5b None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:09.621654 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4700a0d-6337-40e2-8e59-0a94c68b1e5b None admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:09.622358 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4700a0d-6337-40e2-8e59-0a94c68b1e5b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:09.623866 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4700a0d-6337-40e2-8e59-0a94c68b1e5b None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:09.652488 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 27/57] 10.222.0.36 () {60 vars in 1140 bytes} [Fri Jun 24 22:25:09 2022] POST /identity/v3/projects => generated 298 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 22:25:11.654868 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78182717-5b24-4aed-8c03-64e184c37ae1 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:11.655762 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78182717-5b24-4aed-8c03-64e184c37ae1 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:11.655762 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78182717-5b24-4aed-8c03-64e184c37ae1 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:11.658001 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 31/58] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:25:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:25:11.666835 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd62bc34-cee8-442a-b28e-9b73ee541eee None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:11.667277 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd62bc34-cee8-442a-b28e-9b73ee541eee None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:11.667467 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd62bc34-cee8-442a-b28e-9b73ee541eee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:11.695336 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-bd62bc34-cee8-442a-b28e-9b73ee541eee None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:25:11.697255 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-bd62bc34-cee8-442a-b28e-9b73ee541eee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:25:11.715164 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:11.770997 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 28/59] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:25:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 22:25:11.795818 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78182717-5b24-4aed-8c03-64e184c37ae1 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:11.912638 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78182717-5b24-4aed-8c03-64e184c37ae1 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:11.914125 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:11.950894 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e0fd78-8097-4693-8c1e-00f17a2000c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:11.951642 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e0fd78-8097-4693-8c1e-00f17a2000c3 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:11.951926 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e0fd78-8097-4693-8c1e-00f17a2000c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:11.952196 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e0fd78-8097-4693-8c1e-00f17a2000c3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:11.953424 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e0fd78-8097-4693-8c1e-00f17a2000c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:11.954892 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e0fd78-8097-4693-8c1e-00f17a2000c3 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:11.956534 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 32/60] 10.222.0.36 () {56 vars in 1108 bytes} [Fri Jun 24 22:25:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:11.964766 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd62bc34-cee8-442a-b28e-9b73ee541eee None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:12.064980 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd62bc34-cee8-442a-b28e-9b73ee541eee None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:12.101474 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93306d30-dc83-4b98-b96b-e90b8ea6720e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:12.102140 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93306d30-dc83-4b98-b96b-e90b8ea6720e None admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:12.102423 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93306d30-dc83-4b98-b96b-e90b8ea6720e None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:12.102698 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93306d30-dc83-4b98-b96b-e90b8ea6720e None admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:12.103450 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93306d30-dc83-4b98-b96b-e90b8ea6720e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:12.104970 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93306d30-dc83-4b98-b96b-e90b8ea6720e None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:12.134210 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 29/61] 10.222.0.36 () {60 vars in 1132 bytes} [Fri Jun 24 22:25:11 2022] POST /identity/v3/users => generated 275 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 22:25:15.284636 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f366d48b-d048-4421-bcc9-fadb93a4c234 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:15.285709 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f366d48b-d048-4421-bcc9-fadb93a4c234 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:15.286199 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f366d48b-d048-4421-bcc9-fadb93a4c234 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:15.287818 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 33/62] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:25:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:25:15.293503 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1d3451-f61b-44a6-a605-9efaf9e710bc None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:15.294346 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1d3451-f61b-44a6-a605-9efaf9e710bc None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:15.294839 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1d3451-f61b-44a6-a605-9efaf9e710bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:15.319496 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-cd1d3451-f61b-44a6-a605-9efaf9e710bc None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:25:15.320709 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-cd1d3451-f61b-44a6-a605-9efaf9e710bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:25:15.323554 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:15.415091 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 30/63] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:25:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 22:25:15.454074 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f366d48b-d048-4421-bcc9-fadb93a4c234 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:15.602006 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f366d48b-d048-4421-bcc9-fadb93a4c234 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:15.623681 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ded385-dac7-4630-b81d-596540ef8f8b None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:15.624011 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ded385-dac7-4630-b81d-596540ef8f8b None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:15.624255 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ded385-dac7-4630-b81d-596540ef8f8b None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:15.625889 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 31/64] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:25:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:25:15.631206 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f98f6-2dce-46d8-b456-63aa6cec74b7 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:15.631524 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f98f6-2dce-46d8-b456-63aa6cec74b7 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:15.631812 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f98f6-2dce-46d8-b456-63aa6cec74b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:15.659034 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-f39f98f6-2dce-46d8-b456-63aa6cec74b7 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:25:15.660283 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-f39f98f6-2dce-46d8-b456-63aa6cec74b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:25:15.675147 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c8fe83-3bce-47f8-b6cf-dc01353c2bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:15.676015 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c8fe83-3bce-47f8-b6cf-dc01353c2bb3 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:15.676306 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c8fe83-3bce-47f8-b6cf-dc01353c2bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:15.676585 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c8fe83-3bce-47f8-b6cf-dc01353c2bb3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:15.691137 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c8fe83-3bce-47f8-b6cf-dc01353c2bb3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 22:25:15.699634 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-27c8fe83-3bce-47f8-b6cf-dc01353c2bb3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 22:25:15.699634 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:25:15.699634 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:25:15.699634 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:25:15.699634 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:25:15.699634 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:25:15.699634 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:25:15.699634 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:25:15.699634 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:25:15.699634 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:25:15.699634 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:25:15.699634 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:25:15.699634 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 22:25:15.699634 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 22:25:15.699634 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 22:25:15.699634 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 22:25:15.700468 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 22:25:15.700468 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 22:25:15.700468 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 22:25:15.700468 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 22:25:15.700468 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:25:15.700468 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:25:15.700468 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:25:15.700468 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:25:15.700468 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:25:15.700468 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:25:15.700468 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:25:15.700468 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:25:15.700468 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:25:15.700468 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:25:15.700468 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:25:15.700468 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:25:15.701214 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:25:15.701214 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:25:15.701214 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:25:15.701214 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:25:15.701214 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 22:25:15.701214 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 22:25:15.701214 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 22:25:15.701214 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 22:25:15.701214 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 22:25:15.701214 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 22:25:15.701214 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 22:25:15.701214 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:25:15.701214 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 34/65] 10.222.0.36 () {56 vars in 1099 bytes} [Fri Jun 24 22:25:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:25:15.710869 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667d9ea7-bb76-4832-80ec-f1891547064b None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:15.711233 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667d9ea7-bb76-4832-80ec-f1891547064b None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:15.711610 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667d9ea7-bb76-4832-80ec-f1891547064b None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:15.713262 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 35/66] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:25:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 22:25:15.714088 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667d9ea7-bb76-4832-80ec-f1891547064b None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:15.746660 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:15.772883 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 32/67] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:25:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 22:25:15.774651 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99475976-3f22-4521-9ccc-b95844c47031 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:15.774986 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99475976-3f22-4521-9ccc-b95844c47031 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:15.775297 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99475976-3f22-4521-9ccc-b95844c47031 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:15.777342 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 33/68] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:25:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:25:15.778260 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ab08c7-7ae7-47be-afff-ff237724ea88 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:15.778544 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ab08c7-7ae7-47be-afff-ff237724ea88 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:15.778824 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ab08c7-7ae7-47be-afff-ff237724ea88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:15.799654 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-75ab08c7-7ae7-47be-afff-ff237724ea88 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:25:15.800900 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-75ab08c7-7ae7-47be-afff-ff237724ea88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:25:15.830954 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667d9ea7-bb76-4832-80ec-f1891547064b None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:15.867203 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:15.867731 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cab778-0cc0-4869-8b0e-bb3b78ba317c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:15.868424 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cab778-0cc0-4869-8b0e-bb3b78ba317c None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:15.868740 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cab778-0cc0-4869-8b0e-bb3b78ba317c None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:15.869036 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cab778-0cc0-4869-8b0e-bb3b78ba317c None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:15.869942 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cab778-0cc0-4869-8b0e-bb3b78ba317c None admin] RBAC: Adding query filter params (name=member) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:25:15.870257 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cab778-0cc0-4869-8b0e-bb3b78ba317c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:15.871725 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cab778-0cc0-4869-8b0e-bb3b78ba317c None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:15.874410 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 34/69] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:25:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 22:25:15.875709 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb344b8-5c24-4adf-9929-96b7b96c05ce None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:15.875999 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb344b8-5c24-4adf-9929-96b7b96c05ce None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:15.876277 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb344b8-5c24-4adf-9929-96b7b96c05ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:15.884809 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 36/70] 10.222.0.36 () {56 vars in 1101 bytes} [Fri Jun 24 22:25:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:15.886123 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cab778-0cc0-4869-8b0e-bb3b78ba317c None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:15.895655 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-3fb344b8-5c24-4adf-9929-96b7b96c05ce None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:25:15.896832 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-3fb344b8-5c24-4adf-9929-96b7b96c05ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:25:15.961959 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 35/71] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:25:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 22:25:15.963406 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a45156-6b1e-4c47-b5e7-986fc9a66dc7 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:15.963758 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a45156-6b1e-4c47-b5e7-986fc9a66dc7 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:15.964289 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a45156-6b1e-4c47-b5e7-986fc9a66dc7 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:15.967558 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 36/72] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:25:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:25:15.967558 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a45156-6b1e-4c47-b5e7-986fc9a66dc7 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:15.982758 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:15.992581 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cab778-0cc0-4869-8b0e-bb3b78ba317c None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:16.028976 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2483e60-54e9-471d-baa0-61ec9d28ed88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:16.029814 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2483e60-54e9-471d-baa0-61ec9d28ed88 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:16.030102 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2483e60-54e9-471d-baa0-61ec9d28ed88 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:16.030383 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2483e60-54e9-471d-baa0-61ec9d28ed88 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:16.040432 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2483e60-54e9-471d-baa0-61ec9d28ed88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 22:25:16.048825 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-f2483e60-54e9-471d-baa0-61ec9d28ed88 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 22:25:16.048825 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:25:16.048825 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:25:16.048825 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:25:16.048825 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:25:16.048825 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:25:16.048825 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:25:16.048825 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:25:16.048825 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:25:16.048825 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:25:16.048825 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:25:16.048825 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:25:16.048825 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 22:25:16.048825 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 22:25:16.048825 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 22:25:16.048825 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 22:25:16.049645 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 22:25:16.049645 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 22:25:16.049645 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 22:25:16.049645 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 22:25:16.049645 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:25:16.049645 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:25:16.049645 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:25:16.049645 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:25:16.049645 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:25:16.049645 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:25:16.049645 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:25:16.049645 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:25:16.049645 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:25:16.049645 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:25:16.049645 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:25:16.049645 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:25:16.050457 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:25:16.050457 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:25:16.050457 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:25:16.050457 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:25:16.050457 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 22:25:16.050457 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 22:25:16.050457 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 22:25:16.050457 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 22:25:16.050457 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 22:25:16.050457 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 22:25:16.050457 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 22:25:16.050457 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:25:16.050457 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 37/73] 10.222.0.36 () {56 vars in 1096 bytes} [Fri Jun 24 22:25:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:25:16.051203 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2483e60-54e9-471d-baa0-61ec9d28ed88 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:16.073412 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a45156-6b1e-4c47-b5e7-986fc9a66dc7 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:16.099234 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:16.108309 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777e95c2-2568-44a8-af21-da12ad3b8aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:16.109197 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e95c2-2568-44a8-af21-da12ad3b8aa6 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:16.109480 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e95c2-2568-44a8-af21-da12ad3b8aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:16.109748 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e95c2-2568-44a8-af21-da12ad3b8aa6 None admin] PATH_INFO: `/v3/users/c78d1ddf23904cb0b88c39812174a04e` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:16.125170 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777e95c2-2568-44a8-af21-da12ad3b8aa6 None admin] RBAC: Authorizing `identity:get_user(user_id=c78d1ddf23904cb0b88c39812174a04e)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:16.126577 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777e95c2-2568-44a8-af21-da12ad3b8aa6 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:16.128306 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 37/74] 10.222.0.36 () {56 vars in 1177 bytes} [Fri Jun 24 22:25:15 2022] GET /identity/v3/users/c78d1ddf23904cb0b88c39812174a04e => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:16.129549 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9bfb94-cc29-4c49-9b86-16f75fe71df4 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:16.129843 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9bfb94-cc29-4c49-9b86-16f75fe71df4 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:16.130121 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9bfb94-cc29-4c49-9b86-16f75fe71df4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:16.146722 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-2e9bfb94-cc29-4c49-9b86-16f75fe71df4 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:25:16.147936 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-2e9bfb94-cc29-4c49-9b86-16f75fe71df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:25:16.159436 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2483e60-54e9-471d-baa0-61ec9d28ed88 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:16.195957 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b1db9d-b740-47e6-a482-dfdd9ca77d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:16.196935 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b1db9d-b740-47e6-a482-dfdd9ca77d8a None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:16.197284 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b1db9d-b740-47e6-a482-dfdd9ca77d8a None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:16.197574 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b1db9d-b740-47e6-a482-dfdd9ca77d8a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:16.209176 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b1db9d-b740-47e6-a482-dfdd9ca77d8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 22:25:16.217319 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-c1b1db9d-b740-47e6-a482-dfdd9ca77d8a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 22:25:16.217319 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:25:16.217319 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:25:16.217319 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:25:16.217319 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:25:16.217319 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:25:16.217319 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:25:16.217319 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:25:16.217319 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:25:16.217319 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:25:16.217319 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:25:16.217319 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:25:16.217319 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 22:25:16.217319 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 22:25:16.217319 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 22:25:16.217319 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 22:25:16.218126 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 22:25:16.218126 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 22:25:16.218126 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 22:25:16.218126 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 22:25:16.218126 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:25:16.218126 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:25:16.218126 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:25:16.218126 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:25:16.218126 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:25:16.218126 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:25:16.218126 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:25:16.218126 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:25:16.218126 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:25:16.218126 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:25:16.218126 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:25:16.218126 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:25:16.218846 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:25:16.218846 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:25:16.218846 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:25:16.218846 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:25:16.218846 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 22:25:16.218846 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 22:25:16.218846 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 22:25:16.218846 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 22:25:16.218846 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 22:25:16.218846 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 22:25:16.218846 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 22:25:16.218846 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:25:16.219934 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 38/75] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:25:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 22:25:16.220017 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 38/76] 10.222.0.36 () {56 vars in 1099 bytes} [Fri Jun 24 22:25:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:25:16.220109 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9bfb94-cc29-4c49-9b86-16f75fe71df4 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:16.220187 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b1db9d-b740-47e6-a482-dfdd9ca77d8a None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:16.238378 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:16.327146 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b1db9d-b740-47e6-a482-dfdd9ca77d8a None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:16.336887 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9bfb94-cc29-4c49-9b86-16f75fe71df4 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:16.353059 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:16.360443 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55320729-f4d3-4842-8e1e-1c6ae9bffcba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:16.361117 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55320729-f4d3-4842-8e1e-1c6ae9bffcba None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:16.361403 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55320729-f4d3-4842-8e1e-1c6ae9bffcba None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:16.361679 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55320729-f4d3-4842-8e1e-1c6ae9bffcba None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:16.362430 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55320729-f4d3-4842-8e1e-1c6ae9bffcba None admin] RBAC: Adding query filter params (name=admin) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:25:16.362738 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55320729-f4d3-4842-8e1e-1c6ae9bffcba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:16.364173 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55320729-f4d3-4842-8e1e-1c6ae9bffcba None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:16.371100 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889f231b-32bb-49be-8a6f-20bdb294c352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:16.371940 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889f231b-32bb-49be-8a6f-20bdb294c352 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:16.372231 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889f231b-32bb-49be-8a6f-20bdb294c352 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:16.372509 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889f231b-32bb-49be-8a6f-20bdb294c352 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:16.373212 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 39/77] 10.222.0.36 () {56 vars in 1099 bytes} [Fri Jun 24 22:25:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:16.373806 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55320729-f4d3-4842-8e1e-1c6ae9bffcba None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:16.389103 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889f231b-32bb-49be-8a6f-20bdb294c352 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 22:25:16.398224 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-889f231b-32bb-49be-8a6f-20bdb294c352 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 22:25:16.398224 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:25:16.398224 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:25:16.398224 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:25:16.398224 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:25:16.398224 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:25:16.398224 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:25:16.398224 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:25:16.398224 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:25:16.398224 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:25:16.398224 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:25:16.398224 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:25:16.398224 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 22:25:16.398224 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 22:25:16.398224 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 22:25:16.398224 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 22:25:16.399203 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 22:25:16.399203 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 22:25:16.399203 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 22:25:16.399203 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 22:25:16.399203 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:25:16.399203 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:25:16.399203 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:25:16.399203 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:25:16.399203 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:25:16.399203 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:25:16.399203 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:25:16.399203 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:25:16.399203 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:25:16.399203 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:25:16.399203 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:25:16.399203 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:25:16.400153 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:25:16.400153 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:25:16.400153 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:25:16.400153 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:25:16.400153 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 22:25:16.400153 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 22:25:16.400153 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 22:25:16.400153 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 22:25:16.400153 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 22:25:16.400153 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 22:25:16.400153 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 22:25:16.400153 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:25:16.403412 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 39/78] 10.222.0.36 () {56 vars in 1114 bytes} [Fri Jun 24 22:25:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:25:16.404670 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889f231b-32bb-49be-8a6f-20bdb294c352 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:16.454164 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:16.479655 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55320729-f4d3-4842-8e1e-1c6ae9bffcba None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:16.506592 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889f231b-32bb-49be-8a6f-20bdb294c352 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:16.512205 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf558864-d28c-4b44-9991-49a4568f1441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:16.512860 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf558864-d28c-4b44-9991-49a4568f1441 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:16.513142 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf558864-d28c-4b44-9991-49a4568f1441 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:16.513417 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf558864-d28c-4b44-9991-49a4568f1441 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:16.539858 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26ff079-5930-4eca-ab8f-cc17b2f52dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:16.540540 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ff079-5930-4eca-ab8f-cc17b2f52dc7 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:16.540827 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ff079-5930-4eca-ab8f-cc17b2f52dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:16.541105 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ff079-5930-4eca-ab8f-cc17b2f52dc7 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:16.541947 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26ff079-5930-4eca-ab8f-cc17b2f52dc7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:25:16.542256 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26ff079-5930-4eca-ab8f-cc17b2f52dc7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:16.543723 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26ff079-5930-4eca-ab8f-cc17b2f52dc7 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:16.551677 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 40/79] 10.222.0.36 () {56 vars in 1101 bytes} [Fri Jun 24 22:25:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:16.552481 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26ff079-5930-4eca-ab8f-cc17b2f52dc7 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:16.584797 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf558864-d28c-4b44-9991-49a4568f1441 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:16.586283 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf558864-d28c-4b44-9991-49a4568f1441 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:16.592147 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:16.655358 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26ff079-5930-4eca-ab8f-cc17b2f52dc7 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:16.659191 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:16.686907 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 40/80] 10.222.0.36 () {58 vars in 1282 bytes} [Fri Jun 24 22:25:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 22:25:16.687757 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf558864-d28c-4b44-9991-49a4568f1441 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:16.688871 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e022beb-ebba-46cd-b3a2-46410436f725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:16.689682 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e022beb-ebba-46cd-b3a2-46410436f725 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:16.689971 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e022beb-ebba-46cd-b3a2-46410436f725 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:16.690235 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e022beb-ebba-46cd-b3a2-46410436f725 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:16.691472 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e022beb-ebba-46cd-b3a2-46410436f725 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:16.692931 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e022beb-ebba-46cd-b3a2-46410436f725 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:16.694559 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 41/81] 10.222.0.36 () {56 vars in 1108 bytes} [Fri Jun 24 22:25:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:16.695357 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e022beb-ebba-46cd-b3a2-46410436f725 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:16.789549 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf558864-d28c-4b44-9991-49a4568f1441 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:16.796257 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e022beb-ebba-46cd-b3a2-46410436f725 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:16.802911 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:16.824696 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51f4355-b98e-4515-adb5-c327c8fc51be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:16.825591 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f4355-b98e-4515-adb5-c327c8fc51be None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:16.825876 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f4355-b98e-4515-adb5-c327c8fc51be None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:16.826157 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f4355-b98e-4515-adb5-c327c8fc51be None admin] PATH_INFO: `/v3/users/e1b71ca6ab0b436d901fe1079176cb45` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:16.827412 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51f4355-b98e-4515-adb5-c327c8fc51be None admin] RBAC: Authorizing `identity:get_user(user_id=e1b71ca6ab0b436d901fe1079176cb45)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:16.828897 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51f4355-b98e-4515-adb5-c327c8fc51be None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:16.830473 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76bb427-3327-476d-8cdd-4bef98544f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:16.830623 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 41/82] 10.222.0.36 () {56 vars in 1177 bytes} [Fri Jun 24 22:25:16 2022] GET /identity/v3/users/e1b71ca6ab0b436d901fe1079176cb45 => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:16.831197 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76bb427-3327-476d-8cdd-4bef98544f4d None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:16.831308 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51f4355-b98e-4515-adb5-c327c8fc51be None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:16.831517 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76bb427-3327-476d-8cdd-4bef98544f4d None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:16.831793 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76bb427-3327-476d-8cdd-4bef98544f4d None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:16.832596 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76bb427-3327-476d-8cdd-4bef98544f4d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:25:16.832905 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76bb427-3327-476d-8cdd-4bef98544f4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:16.834290 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76bb427-3327-476d-8cdd-4bef98544f4d None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:16.842914 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 42/83] 10.222.0.36 () {56 vars in 1111 bytes} [Fri Jun 24 22:25:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:16.843717 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76bb427-3327-476d-8cdd-4bef98544f4d None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:16.876408 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:16.932741 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51f4355-b98e-4515-adb5-c327c8fc51be None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:16.946585 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76bb427-3327-476d-8cdd-4bef98544f4d None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:16.967554 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0750ce07-d8ba-4405-9167-194976754e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:16.968439 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0750ce07-d8ba-4405-9167-194976754e3b None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:16.968728 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0750ce07-d8ba-4405-9167-194976754e3b None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:16.969002 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0750ce07-d8ba-4405-9167-194976754e3b None admin] PATH_INFO: `/v3/users/c78d1ddf23904cb0b88c39812174a04e` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:16.970226 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0750ce07-d8ba-4405-9167-194976754e3b None admin] RBAC: Authorizing `identity:get_user(user_id=c78d1ddf23904cb0b88c39812174a04e)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:16.971757 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0750ce07-d8ba-4405-9167-194976754e3b None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:16.973390 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 42/84] 10.222.0.36 () {56 vars in 1177 bytes} [Fri Jun 24 22:25:16 2022] GET /identity/v3/users/c78d1ddf23904cb0b88c39812174a04e => generated 275 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:16.974127 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0750ce07-d8ba-4405-9167-194976754e3b None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:16.984679 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb0c392-01a2-46db-a656-34f1b9034127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:16.985896 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb0c392-01a2-46db-a656-34f1b9034127 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:16.986479 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb0c392-01a2-46db-a656-34f1b9034127 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:16.986760 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb0c392-01a2-46db-a656-34f1b9034127 None admin] PATH_INFO: `/v3/projects/8130cc4553114edcaa7ac3278c906eed` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:16.987988 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb0c392-01a2-46db-a656-34f1b9034127 None admin] RBAC: Authorizing `identity:get_project(project_id=8130cc4553114edcaa7ac3278c906eed)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:16.989467 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb0c392-01a2-46db-a656-34f1b9034127 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:16.991167 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 43/85] 10.222.0.36 () {56 vars in 1186 bytes} [Fri Jun 24 22:25:16 2022] GET /identity/v3/projects/8130cc4553114edcaa7ac3278c906eed => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:16.991943 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb0c392-01a2-46db-a656-34f1b9034127 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:17.028594 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:17.076875 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0750ce07-d8ba-4405-9167-194976754e3b None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:17.087618 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:17.092584 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb0c392-01a2-46db-a656-34f1b9034127 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:17.112383 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084e079a-58f5-4894-b6b8-b49c905cc6c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:17.113061 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e079a-58f5-4894-b6b8-b49c905cc6c9 None admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:17.113348 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e079a-58f5-4894-b6b8-b49c905cc6c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:17.113625 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e079a-58f5-4894-b6b8-b49c905cc6c9 None admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:17.114352 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084e079a-58f5-4894-b6b8-b49c905cc6c9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:17.115871 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084e079a-58f5-4894-b6b8-b49c905cc6c9 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:17.124599 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66fae76-9608-4164-bf0c-2b6a8cc4dc06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:17.125247 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66fae76-9608-4164-bf0c-2b6a8cc4dc06 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:17.125575 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66fae76-9608-4164-bf0c-2b6a8cc4dc06 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:17.126188 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66fae76-9608-4164-bf0c-2b6a8cc4dc06 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:17.143163 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 43/86] 10.222.0.36 () {60 vars in 1132 bytes} [Fri Jun 24 22:25:16 2022] POST /identity/v3/users => generated 289 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:25:17.144012 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084e079a-58f5-4894-b6b8-b49c905cc6c9 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:17.204350 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66fae76-9608-4164-bf0c-2b6a8cc4dc06 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:17.206229 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66fae76-9608-4164-bf0c-2b6a8cc4dc06 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:17.243902 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:17.270026 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084e079a-58f5-4894-b6b8-b49c905cc6c9 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:17.314084 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0880e0-4ed2-4564-8a1c-4464e1a10893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:17.314971 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0880e0-4ed2-4564-8a1c-4464e1a10893 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:17.315970 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0880e0-4ed2-4564-8a1c-4464e1a10893 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:17.315970 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0880e0-4ed2-4564-8a1c-4464e1a10893 None admin] PATH_INFO: `/v3/users/c78d1ddf23904cb0b88c39812174a04e` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:17.317706 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0880e0-4ed2-4564-8a1c-4464e1a10893 None admin] RBAC: Authorizing `identity:get_user(user_id=c78d1ddf23904cb0b88c39812174a04e)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:17.319206 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0880e0-4ed2-4564-8a1c-4464e1a10893 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:17.320918 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 44/87] 10.222.0.36 () {56 vars in 1177 bytes} [Fri Jun 24 22:25:17 2022] GET /identity/v3/users/c78d1ddf23904cb0b88c39812174a04e => generated 275 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:17.321702 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0880e0-4ed2-4564-8a1c-4464e1a10893 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:17.323402 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 44/88] 10.222.0.36 () {58 vars in 1282 bytes} [Fri Jun 24 22:25:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 22:25:17.324227 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66fae76-9608-4164-bf0c-2b6a8cc4dc06 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:17.366298 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:17.468705 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0880e0-4ed2-4564-8a1c-4464e1a10893 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:17.468873 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66fae76-9608-4164-bf0c-2b6a8cc4dc06 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:17.511758 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0281e3-64b2-45f2-b775-e0de8e455879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:17.512458 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0281e3-64b2-45f2-b775-e0de8e455879 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:17.512749 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0281e3-64b2-45f2-b775-e0de8e455879 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:17.513039 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0281e3-64b2-45f2-b775-e0de8e455879 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:17.518353 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d33c59e-3a4a-4586-bb92-3d398d08a2dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:17.519294 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d33c59e-3a4a-4586-bb92-3d398d08a2dd None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:17.519769 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d33c59e-3a4a-4586-bb92-3d398d08a2dd None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:17.520231 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d33c59e-3a4a-4586-bb92-3d398d08a2dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:17.521289 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d33c59e-3a4a-4586-bb92-3d398d08a2dd None admin] RBAC: Adding query filter params (role.id=1928787bfcc745419829cd315900ac44, scope.project.id=8130cc4553114edcaa7ac3278c906eed, user.id=c78d1ddf23904cb0b88c39812174a04e) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:25:17.522293 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d33c59e-3a4a-4586-bb92-3d398d08a2dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:17.524015 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d33c59e-3a4a-4586-bb92-3d398d08a2dd None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:17.532209 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:17.538759 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 45/89] 10.222.0.36 () {56 vars in 1374 bytes} [Fri Jun 24 22:25:17 2022] GET /identity/v3/role_assignments?user.id=c78d1ddf23904cb0b88c39812174a04e&scope.project.id=8130cc4553114edcaa7ac3278c906eed&role.id=1928787bfcc745419829cd315900ac44 => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:17.540436 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d33c59e-3a4a-4586-bb92-3d398d08a2dd None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:17.593544 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0281e3-64b2-45f2-b775-e0de8e455879 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:17.595557 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0281e3-64b2-45f2-b775-e0de8e455879 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:17.632699 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:17.681451 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d33c59e-3a4a-4586-bb92-3d398d08a2dd None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:17.743097 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 45/90] 10.222.0.36 () {58 vars in 1282 bytes} [Fri Jun 24 22:25:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 22:25:17.743953 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0281e3-64b2-45f2-b775-e0de8e455879 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:17.745612 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b57e11f-5ff2-4ed7-90dd-9c1c67f7ee93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:17.746440 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b57e11f-5ff2-4ed7-90dd-9c1c67f7ee93 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:17.746732 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b57e11f-5ff2-4ed7-90dd-9c1c67f7ee93 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:17.747013 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b57e11f-5ff2-4ed7-90dd-9c1c67f7ee93 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:17.843123 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b57e11f-5ff2-4ed7-90dd-9c1c67f7ee93 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:17.844672 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b57e11f-5ff2-4ed7-90dd-9c1c67f7ee93 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:17.847608 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:17.913581 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0281e3-64b2-45f2-b775-e0de8e455879 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:17.949315 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496925d0-1548-427a-a516-2ccd457211fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:17.950248 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496925d0-1548-427a-a516-2ccd457211fe None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:17.950534 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496925d0-1548-427a-a516-2ccd457211fe None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:17.950811 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496925d0-1548-427a-a516-2ccd457211fe None admin] PATH_INFO: `/v3/projects/8130cc4553114edcaa7ac3278c906eed` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:17.952171 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496925d0-1548-427a-a516-2ccd457211fe None admin] RBAC: Authorizing `identity:get_project(project_id=8130cc4553114edcaa7ac3278c906eed)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:17.955587 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496925d0-1548-427a-a516-2ccd457211fe None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:17.955587 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 46/91] 10.222.0.36 () {56 vars in 1186 bytes} [Fri Jun 24 22:25:17 2022] GET /identity/v3/projects/8130cc4553114edcaa7ac3278c906eed => generated 298 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:17.956142 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496925d0-1548-427a-a516-2ccd457211fe None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:17.963489 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:18.050289 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 46/92] 10.222.0.36 () {58 vars in 1282 bytes} [Fri Jun 24 22:25:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 22:25:18.051083 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b57e11f-5ff2-4ed7-90dd-9c1c67f7ee93 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:18.065674 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496925d0-1548-427a-a516-2ccd457211fe None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:18.100710 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab689ef4-c120-4b72-940e-c7a30ed04770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:18.101639 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab689ef4-c120-4b72-940e-c7a30ed04770 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:18.101925 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab689ef4-c120-4b72-940e-c7a30ed04770 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:18.102204 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab689ef4-c120-4b72-940e-c7a30ed04770 None admin] PATH_INFO: `/v3/projects/c163ce0b458f4aa9b60e981ba10bd611` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:18.103481 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab689ef4-c120-4b72-940e-c7a30ed04770 None admin] RBAC: Authorizing `identity:get_project(project_id=c163ce0b458f4aa9b60e981ba10bd611)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:18.105282 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab689ef4-c120-4b72-940e-c7a30ed04770 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:18.107010 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 47/93] 10.222.0.36 () {56 vars in 1186 bytes} [Fri Jun 24 22:25:17 2022] GET /identity/v3/projects/c163ce0b458f4aa9b60e981ba10bd611 => generated 312 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:18.107844 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab689ef4-c120-4b72-940e-c7a30ed04770 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:18.187525 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:18.229080 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab689ef4-c120-4b72-940e-c7a30ed04770 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:18.259108 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:18.264012 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b57e11f-5ff2-4ed7-90dd-9c1c67f7ee93 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:18.288949 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a21a8ae-b833-4a52-bf99-53a3722d1b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:18.289835 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21a8ae-b833-4a52-bf99-53a3722d1b3e None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:18.290116 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21a8ae-b833-4a52-bf99-53a3722d1b3e None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:18.290389 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21a8ae-b833-4a52-bf99-53a3722d1b3e None admin] PATH_INFO: `/v3/projects/8130cc4553114edcaa7ac3278c906eed` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:18.291784 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a21a8ae-b833-4a52-bf99-53a3722d1b3e None admin] RBAC: Authorizing `identity:get_project(project_id=8130cc4553114edcaa7ac3278c906eed)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:18.293250 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a21a8ae-b833-4a52-bf99-53a3722d1b3e None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:18.294967 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 48/94] 10.222.0.36 () {56 vars in 1186 bytes} [Fri Jun 24 22:25:18 2022] GET /identity/v3/projects/8130cc4553114edcaa7ac3278c906eed => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:18.295751 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a21a8ae-b833-4a52-bf99-53a3722d1b3e None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:18.332014 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abac4b20-310b-45b4-a5ca-88fd3aff6d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:18.333012 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abac4b20-310b-45b4-a5ca-88fd3aff6d6e None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:18.333486 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abac4b20-310b-45b4-a5ca-88fd3aff6d6e None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:18.333956 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abac4b20-310b-45b4-a5ca-88fd3aff6d6e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:18.334998 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abac4b20-310b-45b4-a5ca-88fd3aff6d6e None admin] RBAC: Adding query filter params (role.id=1a1c43cc97a0407eb7a7c7a1333a9d4a, scope.project.id=8130cc4553114edcaa7ac3278c906eed, user.id=e1b71ca6ab0b436d901fe1079176cb45) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:25:18.339588 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abac4b20-310b-45b4-a5ca-88fd3aff6d6e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:18.341319 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abac4b20-310b-45b4-a5ca-88fd3aff6d6e None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:18.355747 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 47/95] 10.222.0.36 () {56 vars in 1374 bytes} [Fri Jun 24 22:25:18 2022] GET /identity/v3/role_assignments?user.id=e1b71ca6ab0b436d901fe1079176cb45&scope.project.id=8130cc4553114edcaa7ac3278c906eed&role.id=1a1c43cc97a0407eb7a7c7a1333a9d4a => generated 259 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:18.359952 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abac4b20-310b-45b4-a5ca-88fd3aff6d6e None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:18.473516 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a21a8ae-b833-4a52-bf99-53a3722d1b3e None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:18.551749 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b177f7-cf45-4326-94e7-9a3b7e68016a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:18.552427 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b177f7-cf45-4326-94e7-9a3b7e68016a None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:18.552719 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b177f7-cf45-4326-94e7-9a3b7e68016a None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:18.553001 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b177f7-cf45-4326-94e7-9a3b7e68016a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:18.553855 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b177f7-cf45-4326-94e7-9a3b7e68016a None admin] RBAC: Adding query filter params (role.id=1928787bfcc745419829cd315900ac44, scope.project.id=c163ce0b458f4aa9b60e981ba10bd611, user.id=c78d1ddf23904cb0b88c39812174a04e) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:25:18.554175 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b177f7-cf45-4326-94e7-9a3b7e68016a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:18.555683 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b177f7-cf45-4326-94e7-9a3b7e68016a None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:18.571554 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 49/96] 10.222.0.36 () {56 vars in 1374 bytes} [Fri Jun 24 22:25:18 2022] GET /identity/v3/role_assignments?user.id=c78d1ddf23904cb0b88c39812174a04e&scope.project.id=c163ce0b458f4aa9b60e981ba10bd611&role.id=1928787bfcc745419829cd315900ac44 => generated 259 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:18.574192 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abac4b20-310b-45b4-a5ca-88fd3aff6d6e None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:18.614819 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db5f77c-96f5-4578-b598-3705016d0ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:18.615533 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db5f77c-96f5-4578-b598-3705016d0ac0 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:18.615824 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db5f77c-96f5-4578-b598-3705016d0ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:18.616108 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db5f77c-96f5-4578-b598-3705016d0ac0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:18.616979 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db5f77c-96f5-4578-b598-3705016d0ac0 None admin] RBAC: Adding query filter params (role.id=bf32f251a7764c7188fd782b65275038, scope.project.id=8130cc4553114edcaa7ac3278c906eed, user.id=c78d1ddf23904cb0b88c39812174a04e) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:25:18.617301 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db5f77c-96f5-4578-b598-3705016d0ac0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:18.618813 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db5f77c-96f5-4578-b598-3705016d0ac0 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:18.626346 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 48/97] 10.222.0.36 () {56 vars in 1374 bytes} [Fri Jun 24 22:25:18 2022] GET /identity/v3/role_assignments?user.id=c78d1ddf23904cb0b88c39812174a04e&scope.project.id=8130cc4553114edcaa7ac3278c906eed&role.id=bf32f251a7764c7188fd782b65275038 => generated 259 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:19.899031 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09680517-0920-492f-8d3b-941ab8b70d43 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:19.899578 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09680517-0920-492f-8d3b-941ab8b70d43 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:19.899650 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09680517-0920-492f-8d3b-941ab8b70d43 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:19.901354 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 50/98] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:25:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:25:19.907018 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e019a1b-0f66-4709-aae8-8ec927b7af14 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:19.907914 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e019a1b-0f66-4709-aae8-8ec927b7af14 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:19.908425 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e019a1b-0f66-4709-aae8-8ec927b7af14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:19.931845 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-5e019a1b-0f66-4709-aae8-8ec927b7af14 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:25:19.934069 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-5e019a1b-0f66-4709-aae8-8ec927b7af14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:25:19.963839 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:19.999645 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dcd2e1-cc9d-4e37-90cf-d759de52abd2 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:19.999983 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dcd2e1-cc9d-4e37-90cf-d759de52abd2 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:20.000314 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dcd2e1-cc9d-4e37-90cf-d759de52abd2 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:20.001729 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 51/99] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:25:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:25:20.007651 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d325c49c-7011-4870-9f2c-fcc17abe6b54 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:20.007943 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d325c49c-7011-4870-9f2c-fcc17abe6b54 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:20.008223 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d325c49c-7011-4870-9f2c-fcc17abe6b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:20.027636 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:20.035228 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-d325c49c-7011-4870-9f2c-fcc17abe6b54 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:25:20.036496 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-d325c49c-7011-4870-9f2c-fcc17abe6b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:25:20.045395 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 49/100] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:25:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 22:25:20.089762 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e019a1b-0f66-4709-aae8-8ec927b7af14 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:20.185819 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 52/101] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:25:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 22:25:20.226371 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d325c49c-7011-4870-9f2c-fcc17abe6b54 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:20.302239 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e019a1b-0f66-4709-aae8-8ec927b7af14 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:20.383686 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d325c49c-7011-4870-9f2c-fcc17abe6b54 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:20.386015 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24da8fab-2c85-4096-95dd-32da8e9de04c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:20.386860 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24da8fab-2c85-4096-95dd-32da8e9de04c None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:20.387143 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24da8fab-2c85-4096-95dd-32da8e9de04c None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:20.387457 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24da8fab-2c85-4096-95dd-32da8e9de04c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:20.396224 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24da8fab-2c85-4096-95dd-32da8e9de04c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:20.397724 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24da8fab-2c85-4096-95dd-32da8e9de04c None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:20.399852 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 50/102] 10.222.0.36 () {56 vars in 1108 bytes} [Fri Jun 24 22:25:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 22:25:20.401187 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed27e3-350f-4dd5-94fc-d34bf4eaed76 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:20.401438 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed27e3-350f-4dd5-94fc-d34bf4eaed76 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:20.401718 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed27e3-350f-4dd5-94fc-d34bf4eaed76 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:20.408540 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 51/103] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:25:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:25:20.412904 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e157853-5021-4da5-be7b-a8a6d70e8c7d None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:20.413191 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e157853-5021-4da5-be7b-a8a6d70e8c7d None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:20.413467 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e157853-5021-4da5-be7b-a8a6d70e8c7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:20.419606 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:20.423496 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3746c4-de09-4eab-8cbb-fb630f746162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:20.424324 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3746c4-de09-4eab-8cbb-fb630f746162 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:20.424617 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3746c4-de09-4eab-8cbb-fb630f746162 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:20.424898 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3746c4-de09-4eab-8cbb-fb630f746162 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:20.437815 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-9e157853-5021-4da5-be7b-a8a6d70e8c7d None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:25:20.439372 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-9e157853-5021-4da5-be7b-a8a6d70e8c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:25:20.463912 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3746c4-de09-4eab-8cbb-fb630f746162 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 22:25:20.467627 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:20.479959 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-2e3746c4-de09-4eab-8cbb-fb630f746162 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 22:25:20.479959 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:25:20.479959 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:25:20.479959 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:25:20.479959 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:25:20.479959 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:25:20.479959 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:25:20.479959 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:25:20.479959 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:25:20.479959 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:25:20.479959 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:25:20.479959 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:25:20.479959 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 22:25:20.479959 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 22:25:20.479959 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 22:25:20.479959 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 22:25:20.480836 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 22:25:20.480836 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 22:25:20.480836 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 22:25:20.480836 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 22:25:20.480836 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:25:20.480836 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:25:20.480836 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:25:20.480836 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:25:20.480836 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:25:20.480836 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:25:20.480836 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:25:20.480836 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:25:20.480836 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:25:20.480836 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:25:20.480836 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:25:20.480836 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:25:20.481575 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:25:20.481575 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:25:20.481575 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:25:20.481575 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:25:20.481575 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 22:25:20.481575 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 22:25:20.481575 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 22:25:20.481575 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 22:25:20.481575 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 22:25:20.481575 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 22:25:20.481575 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 22:25:20.481575 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:25:20.487794 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 53/104] 10.222.0.36 () {56 vars in 1099 bytes} [Fri Jun 24 22:25:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 22:25:20.488769 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3746c4-de09-4eab-8cbb-fb630f746162 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:20.550412 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 52/105] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:25:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 22:25:20.551567 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e157853-5021-4da5-be7b-a8a6d70e8c7d None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:20.627648 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3746c4-de09-4eab-8cbb-fb630f746162 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:20.663486 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12818294-fa18-4588-a8b7-a587e47959bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:20.664544 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12818294-fa18-4588-a8b7-a587e47959bc None admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:20.665036 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12818294-fa18-4588-a8b7-a587e47959bc None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:20.665502 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12818294-fa18-4588-a8b7-a587e47959bc None admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:20.666494 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12818294-fa18-4588-a8b7-a587e47959bc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:20.668245 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12818294-fa18-4588-a8b7-a587e47959bc None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:20.704204 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 54/106] 10.222.0.36 () {60 vars in 1141 bytes} [Fri Jun 24 22:25:20 2022] POST /identity/v3/projects => generated 302 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:25:20.707346 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12818294-fa18-4588-a8b7-a587e47959bc None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:20.786891 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e157853-5021-4da5-be7b-a8a6d70e8c7d None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:20.808609 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:20.870383 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7754bd-67a2-4037-b213-687c9b459f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:20.871086 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7754bd-67a2-4037-b213-687c9b459f3c None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:20.871746 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7754bd-67a2-4037-b213-687c9b459f3c None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:20.871746 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7754bd-67a2-4037-b213-687c9b459f3c None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:20.872452 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7754bd-67a2-4037-b213-687c9b459f3c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:25:20.872765 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7754bd-67a2-4037-b213-687c9b459f3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:20.874181 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7754bd-67a2-4037-b213-687c9b459f3c None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:20.892591 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 53/107] 10.222.0.36 () {56 vars in 1101 bytes} [Fri Jun 24 22:25:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:20.893486 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12818294-fa18-4588-a8b7-a587e47959bc None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:20.898279 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7754bd-67a2-4037-b213-687c9b459f3c None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:20.931150 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:20.933382 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dd11b1-0e10-43a8-83f2-39ba1c9043da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:20.934770 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd11b1-0e10-43a8-83f2-39ba1c9043da None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:20.935228 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd11b1-0e10-43a8-83f2-39ba1c9043da None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:20.935694 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd11b1-0e10-43a8-83f2-39ba1c9043da None admin] PATH_INFO: `/v3/roles/member` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:20.949282 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dd11b1-0e10-43a8-83f2-39ba1c9043da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 22:25:20.959689 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-79dd11b1-0e10-43a8-83f2-39ba1c9043da None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 22:25:20.959689 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:25:20.959689 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:25:20.959689 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:25:20.959689 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:25:20.959689 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:25:20.959689 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:25:20.959689 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:25:20.959689 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:25:20.959689 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:25:20.959689 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:25:20.959689 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:25:20.959689 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 22:25:20.959689 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 22:25:20.959689 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 22:25:20.959689 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 22:25:20.960579 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 22:25:20.960579 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 22:25:20.960579 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 22:25:20.960579 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 22:25:20.960579 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:25:20.960579 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:25:20.960579 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:25:20.960579 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:25:20.960579 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:25:20.960579 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:25:20.960579 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:25:20.960579 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:25:20.960579 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:25:20.960579 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:25:20.960579 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:25:20.960579 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:25:20.961318 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:25:20.961318 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:25:20.961318 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:25:20.961318 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:25:20.961318 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 22:25:20.961318 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 22:25:20.961318 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 22:25:20.961318 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 22:25:20.961318 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 22:25:20.961318 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 22:25:20.961318 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 22:25:20.961318 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:25:20.963662 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 55/108] 10.222.0.36 () {56 vars in 1099 bytes} [Fri Jun 24 22:25:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:25:20.971992 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dd11b1-0e10-43a8-83f2-39ba1c9043da None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:21.067920 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7754bd-67a2-4037-b213-687c9b459f3c None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:21.086369 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dd11b1-0e10-43a8-83f2-39ba1c9043da None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:21.103623 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:21.139910 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c682ea-543f-45aa-9ae2-eb03b29fbca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:21.140821 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c682ea-543f-45aa-9ae2-eb03b29fbca0 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:21.141096 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c682ea-543f-45aa-9ae2-eb03b29fbca0 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:21.141375 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c682ea-543f-45aa-9ae2-eb03b29fbca0 None admin] PATH_INFO: `/v3/users/f4756b216ba34275bf794c01488ec866` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:21.145889 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef13e0e-2c42-42a4-821c-3153a4b50515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:21.146373 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef13e0e-2c42-42a4-821c-3153a4b50515 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:21.146701 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef13e0e-2c42-42a4-821c-3153a4b50515 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:21.146990 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef13e0e-2c42-42a4-821c-3153a4b50515 None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:21.147790 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef13e0e-2c42-42a4-821c-3153a4b50515 None admin] RBAC: Adding query filter params (name=member) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:25:21.148104 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef13e0e-2c42-42a4-821c-3153a4b50515 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:21.149536 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef13e0e-2c42-42a4-821c-3153a4b50515 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:21.169276 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 56/109] 10.222.0.36 () {56 vars in 1101 bytes} [Fri Jun 24 22:25:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:21.171332 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c682ea-543f-45aa-9ae2-eb03b29fbca0 None admin] RBAC: Authorizing `identity:get_user(user_id=f4756b216ba34275bf794c01488ec866)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:21.172848 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c682ea-543f-45aa-9ae2-eb03b29fbca0 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:21.175582 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef13e0e-2c42-42a4-821c-3153a4b50515 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:21.176461 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 54/110] 10.222.0.36 () {56 vars in 1177 bytes} [Fri Jun 24 22:25:20 2022] GET /identity/v3/users/f4756b216ba34275bf794c01488ec866 => generated 289 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 22:25:21.181074 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c682ea-543f-45aa-9ae2-eb03b29fbca0 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:21.276260 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:21.303310 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c682ea-543f-45aa-9ae2-eb03b29fbca0 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:21.360739 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8a8499-fd61-426a-8358-75d55448672c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:21.361402 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8a8499-fd61-426a-8358-75d55448672c None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:21.361693 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8a8499-fd61-426a-8358-75d55448672c None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:21.361973 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8a8499-fd61-426a-8358-75d55448672c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:21.425600 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef13e0e-2c42-42a4-821c-3153a4b50515 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:21.493972 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc221911-d1ad-45a3-a633-abb939fcda83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:21.495007 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc221911-d1ad-45a3-a633-abb939fcda83 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:21.495314 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc221911-d1ad-45a3-a633-abb939fcda83 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:21.495598 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc221911-d1ad-45a3-a633-abb939fcda83 None admin] PATH_INFO: `/v3/users/c78d1ddf23904cb0b88c39812174a04e` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:21.500432 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc221911-d1ad-45a3-a633-abb939fcda83 None admin] RBAC: Authorizing `identity:get_user(user_id=c78d1ddf23904cb0b88c39812174a04e)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:21.500432 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc221911-d1ad-45a3-a633-abb939fcda83 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:21.501660 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 57/111] 10.222.0.36 () {56 vars in 1177 bytes} [Fri Jun 24 22:25:21 2022] GET /identity/v3/users/c78d1ddf23904cb0b88c39812174a04e => generated 275 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 22:25:21.506298 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8a8499-fd61-426a-8358-75d55448672c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:21.508260 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8a8499-fd61-426a-8358-75d55448672c None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:21.508694 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7cda01-716c-4637-9496-3c563bb948e8 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:21.508994 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7cda01-716c-4637-9496-3c563bb948e8 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:21.509286 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7cda01-716c-4637-9496-3c563bb948e8 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:21.517993 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 58/112] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:25:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 22:25:21.517993 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7cda01-716c-4637-9496-3c563bb948e8 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:21.564831 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:21.617132 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:21.652404 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 55/113] 10.222.0.36 () {58 vars in 1282 bytes} [Fri Jun 24 22:25:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 22:25:21.653944 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb760da8-3701-453c-856f-1fc65a98686d None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:21.654356 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb760da8-3701-453c-856f-1fc65a98686d None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:21.654728 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb760da8-3701-453c-856f-1fc65a98686d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:21.670644 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7cda01-716c-4637-9496-3c563bb948e8 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:21.673179 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-fb760da8-3701-453c-856f-1fc65a98686d None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:25:21.674619 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-fb760da8-3701-453c-856f-1fc65a98686d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:25:21.719368 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbc3ffd-1e9b-40af-976f-1f92ef3ea146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:21.720318 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbc3ffd-1e9b-40af-976f-1f92ef3ea146 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:21.721156 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbc3ffd-1e9b-40af-976f-1f92ef3ea146 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:21.721444 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbc3ffd-1e9b-40af-976f-1f92ef3ea146 None admin] PATH_INFO: `/v3/projects/8130cc4553114edcaa7ac3278c906eed` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:21.722665 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbc3ffd-1e9b-40af-976f-1f92ef3ea146 None admin] RBAC: Authorizing `identity:get_project(project_id=8130cc4553114edcaa7ac3278c906eed)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:21.725690 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbc3ffd-1e9b-40af-976f-1f92ef3ea146 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:21.729462 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 59/114] 10.222.0.36 () {56 vars in 1186 bytes} [Fri Jun 24 22:25:21 2022] GET /identity/v3/projects/8130cc4553114edcaa7ac3278c906eed => generated 298 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:21.729462 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ffdedd-e168-48fb-99fa-1d3940921dd6 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:21.729462 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ffdedd-e168-48fb-99fa-1d3940921dd6 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:21.729462 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ffdedd-e168-48fb-99fa-1d3940921dd6 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:21.730783 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 60/115] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:25:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:25:21.731521 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ffdedd-e168-48fb-99fa-1d3940921dd6 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:21.753630 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 56/116] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:25:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 22:25:21.755309 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d68898f-ae44-42cd-be51-823420108dd3 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:21.755610 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d68898f-ae44-42cd-be51-823420108dd3 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:21.756225 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d68898f-ae44-42cd-be51-823420108dd3 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:21.762003 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 57/117] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:25:21 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:25:21.762884 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d68898f-ae44-42cd-be51-823420108dd3 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:21.846631 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ffdedd-e168-48fb-99fa-1d3940921dd6 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:21.848218 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:21.879080 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d68898f-ae44-42cd-be51-823420108dd3 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:21.882719 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149e4294-cbe2-444c-96d3-7308c9d57464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:21.883681 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149e4294-cbe2-444c-96d3-7308c9d57464 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:21.883964 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149e4294-cbe2-444c-96d3-7308c9d57464 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:21.884241 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149e4294-cbe2-444c-96d3-7308c9d57464 None admin] PATH_INFO: `/v3/projects/8130cc4553114edcaa7ac3278c906eed` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:21.885687 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149e4294-cbe2-444c-96d3-7308c9d57464 None admin] RBAC: Authorizing `identity:get_project(project_id=8130cc4553114edcaa7ac3278c906eed)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:21.887171 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149e4294-cbe2-444c-96d3-7308c9d57464 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:21.888912 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 61/118] 10.222.0.36 () {56 vars in 1186 bytes} [Fri Jun 24 22:25:21 2022] GET /identity/v3/projects/8130cc4553114edcaa7ac3278c906eed => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:21.890071 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f536d5a4-34e1-43eb-838e-02590d0962d3 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:21.890340 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f536d5a4-34e1-43eb-838e-02590d0962d3 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:21.890614 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f536d5a4-34e1-43eb-838e-02590d0962d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:21.894054 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:21.907201 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-f536d5a4-34e1-43eb-838e-02590d0962d3 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:25:21.908447 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-f536d5a4-34e1-43eb-838e-02590d0962d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:25:21.922574 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd35538-67a4-411d-8898-03d2f3c191bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:21.923631 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd35538-67a4-411d-8898-03d2f3c191bf None admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:21.923913 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd35538-67a4-411d-8898-03d2f3c191bf None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:21.924187 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd35538-67a4-411d-8898-03d2f3c191bf None admin] PATH_INFO: `/v3/projects/8130cc4553114edcaa7ac3278c906eed/users/c78d1ddf23904cb0b88c39812174a04e/roles/1928787bfcc745419829cd315900ac44` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:21.926254 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd35538-67a4-411d-8898-03d2f3c191bf None admin] RBAC: Authorizing `identity:create_grant(project_id=8130cc4553114edcaa7ac3278c906eed, user_id=c78d1ddf23904cb0b88c39812174a04e, role_id=1928787bfcc745419829cd315900ac44)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:21.927833 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd35538-67a4-411d-8898-03d2f3c191bf None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:21.943955 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 58/119] 10.222.0.36 () {58 vars in 1439 bytes} [Fri Jun 24 22:25:21 2022] PUT /identity/v3/projects/8130cc4553114edcaa7ac3278c906eed/users/c78d1ddf23904cb0b88c39812174a04e/roles/1928787bfcc745419829cd315900ac44 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:25:21.945315 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee07bf6-4e4c-495d-8b10-e0f4209d09cd None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:21.945618 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee07bf6-4e4c-495d-8b10-e0f4209d09cd None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:21.945902 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee07bf6-4e4c-495d-8b10-e0f4209d09cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:21.964155 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-aee07bf6-4e4c-495d-8b10-e0f4209d09cd None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:25:21.965638 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-aee07bf6-4e4c-495d-8b10-e0f4209d09cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:25:21.989464 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 62/120] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:25:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 22:25:21.991128 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f536d5a4-34e1-43eb-838e-02590d0962d3 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:22.066284 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 59/121] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:25:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 22:25:22.067454 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee07bf6-4e4c-495d-8b10-e0f4209d09cd None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:22.107906 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:22.111741 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f536d5a4-34e1-43eb-838e-02590d0962d3 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:22.154737 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ed540b-defa-4219-8cbc-428fb5e47182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:22.155662 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed540b-defa-4219-8cbc-428fb5e47182 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:22.155955 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed540b-defa-4219-8cbc-428fb5e47182 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:22.156232 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed540b-defa-4219-8cbc-428fb5e47182 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:22.168524 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ed540b-defa-4219-8cbc-428fb5e47182 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 22:25:22.170876 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:22.177094 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee07bf6-4e4c-495d-8b10-e0f4209d09cd None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:22.177699 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-e1ed540b-defa-4219-8cbc-428fb5e47182 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 22:25:22.177699 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:25:22.177699 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:25:22.177699 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:25:22.177699 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:25:22.177699 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:25:22.177699 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:25:22.177699 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:25:22.177699 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:25:22.177699 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:25:22.177699 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:25:22.177699 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:25:22.177699 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 22:25:22.177699 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 22:25:22.177699 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 22:25:22.177699 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 22:25:22.178556 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 22:25:22.178556 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 22:25:22.178556 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 22:25:22.178556 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 22:25:22.178556 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:25:22.178556 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:25:22.178556 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:25:22.178556 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:25:22.178556 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:25:22.178556 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:25:22.178556 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:25:22.178556 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:25:22.178556 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:25:22.178556 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:25:22.178556 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:25:22.178556 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:25:22.180055 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:25:22.180055 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:25:22.180055 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:25:22.180055 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:25:22.180055 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 22:25:22.180055 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 22:25:22.180055 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 22:25:22.180055 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 22:25:22.180055 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 22:25:22.180055 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 22:25:22.180055 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 22:25:22.180055 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:25:22.180055 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 63/122] 10.222.0.36 () {56 vars in 1114 bytes} [Fri Jun 24 22:25:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:25:22.180055 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ed540b-defa-4219-8cbc-428fb5e47182 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:22.221106 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01737d14-5f0f-4c84-9c61-8dbfd9851bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:22.221785 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01737d14-5f0f-4c84-9c61-8dbfd9851bb0 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:22.222066 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01737d14-5f0f-4c84-9c61-8dbfd9851bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:22.222387 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01737d14-5f0f-4c84-9c61-8dbfd9851bb0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:22.223357 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01737d14-5f0f-4c84-9c61-8dbfd9851bb0 None admin] RBAC: Adding query filter params (role.id=c32d1d4e9658499ca095bd31a1fe816d, scope.project.id=8130cc4553114edcaa7ac3278c906eed, user.id=f4756b216ba34275bf794c01488ec866) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:25:22.223717 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01737d14-5f0f-4c84-9c61-8dbfd9851bb0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:22.225302 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01737d14-5f0f-4c84-9c61-8dbfd9851bb0 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:22.231394 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 60/123] 10.222.0.36 () {56 vars in 1374 bytes} [Fri Jun 24 22:25:22 2022] GET /identity/v3/role_assignments?user.id=f4756b216ba34275bf794c01488ec866&scope.project.id=8130cc4553114edcaa7ac3278c906eed&role.id=c32d1d4e9658499ca095bd31a1fe816d => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:22.232079 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01737d14-5f0f-4c84-9c61-8dbfd9851bb0 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:22.348790 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01737d14-5f0f-4c84-9c61-8dbfd9851bb0 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:22.411545 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf0c497-861a-4f69-b2fb-e46c07cb338c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:22.412294 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf0c497-861a-4f69-b2fb-e46c07cb338c None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:22.412582 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf0c497-861a-4f69-b2fb-e46c07cb338c None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:22.412862 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf0c497-861a-4f69-b2fb-e46c07cb338c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:22.425053 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ed540b-defa-4219-8cbc-428fb5e47182 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:22.443012 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf0c497-861a-4f69-b2fb-e46c07cb338c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 22:25:22.456099 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-bcf0c497-861a-4f69-b2fb-e46c07cb338c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 22:25:22.456099 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:25:22.456099 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:25:22.456099 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:25:22.456099 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:25:22.456099 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:25:22.456099 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:25:22.456099 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:25:22.456099 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:25:22.456099 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:25:22.456099 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:25:22.456099 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:25:22.456099 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 22:25:22.456099 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 22:25:22.456099 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 22:25:22.456099 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 22:25:22.457054 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 22:25:22.457054 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 22:25:22.457054 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 22:25:22.457054 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 22:25:22.457054 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:25:22.457054 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:25:22.457054 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:25:22.457054 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:25:22.457054 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:25:22.457054 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:25:22.457054 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:25:22.457054 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:25:22.457054 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:25:22.457054 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:25:22.457054 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:25:22.457054 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:25:22.457788 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:25:22.457788 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:25:22.457788 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:25:22.457788 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:25:22.457788 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 22:25:22.457788 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 22:25:22.457788 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 22:25:22.457788 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 22:25:22.457788 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 22:25:22.457788 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 22:25:22.457788 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 22:25:22.457788 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:25:22.462390 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 61/124] 10.222.0.36 () {56 vars in 1099 bytes} [Fri Jun 24 22:25:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:25:22.462986 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf0c497-861a-4f69-b2fb-e46c07cb338c None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:22.486374 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ae31d4-b6f3-4c87-9ce0-124abcb3e248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:22.487194 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ae31d4-b6f3-4c87-9ce0-124abcb3e248 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:22.487510 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ae31d4-b6f3-4c87-9ce0-124abcb3e248 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:22.487904 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ae31d4-b6f3-4c87-9ce0-124abcb3e248 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:22.499573 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ae31d4-b6f3-4c87-9ce0-124abcb3e248 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 22:25:22.507927 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-d5ae31d4-b6f3-4c87-9ce0-124abcb3e248 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 22:25:22.507927 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:25:22.507927 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:25:22.507927 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:25:22.507927 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:25:22.507927 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:25:22.507927 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:25:22.507927 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:25:22.507927 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:25:22.507927 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:25:22.507927 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:25:22.507927 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:25:22.507927 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 22:25:22.507927 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 22:25:22.507927 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 22:25:22.507927 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 22:25:22.508759 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 22:25:22.508759 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 22:25:22.508759 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 22:25:22.508759 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 22:25:22.508759 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:25:22.508759 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:25:22.508759 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:25:22.508759 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:25:22.508759 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:25:22.508759 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:25:22.508759 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:25:22.508759 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:25:22.508759 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:25:22.508759 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:25:22.508759 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:25:22.508759 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:25:22.510200 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:25:22.510200 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:25:22.510200 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:25:22.510200 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:25:22.510200 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 22:25:22.510200 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 22:25:22.510200 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 22:25:22.510200 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 22:25:22.510200 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 22:25:22.510200 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 22:25:22.510200 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 22:25:22.510200 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:25:22.510200 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 64/125] 10.222.0.36 () {56 vars in 1096 bytes} [Fri Jun 24 22:25:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:25:22.511796 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ae31d4-b6f3-4c87-9ce0-124abcb3e248 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:22.534450 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:22.541197 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:22.639236 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ae31d4-b6f3-4c87-9ce0-124abcb3e248 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:22.691326 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf0c497-861a-4f69-b2fb-e46c07cb338c None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:22.702566 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209b989c-31c1-4fcf-86f1-cc43da3b2dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:22.703281 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b989c-31c1-4fcf-86f1-cc43da3b2dad None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:22.703562 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b989c-31c1-4fcf-86f1-cc43da3b2dad None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:22.703841 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b989c-31c1-4fcf-86f1-cc43da3b2dad None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:22.704609 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209b989c-31c1-4fcf-86f1-cc43da3b2dad None admin] RBAC: Adding query filter params (name=member) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:25:22.704919 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209b989c-31c1-4fcf-86f1-cc43da3b2dad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:22.708300 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209b989c-31c1-4fcf-86f1-cc43da3b2dad None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:22.725422 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 65/126] 10.222.0.36 () {56 vars in 1101 bytes} [Fri Jun 24 22:25:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:22.726094 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209b989c-31c1-4fcf-86f1-cc43da3b2dad None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:22.739216 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc222ca-ab39-446a-a1b7-9fef8a17330e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:22.740025 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc222ca-ab39-446a-a1b7-9fef8a17330e None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:22.741167 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc222ca-ab39-446a-a1b7-9fef8a17330e None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:22.741456 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc222ca-ab39-446a-a1b7-9fef8a17330e None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:22.742230 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc222ca-ab39-446a-a1b7-9fef8a17330e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:25:22.742543 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc222ca-ab39-446a-a1b7-9fef8a17330e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:22.743989 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc222ca-ab39-446a-a1b7-9fef8a17330e None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:22.753346 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 62/127] 10.222.0.36 () {56 vars in 1111 bytes} [Fri Jun 24 22:25:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:22.754248 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc222ca-ab39-446a-a1b7-9fef8a17330e None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:22.898680 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:22.901749 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:22.936064 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209b989c-31c1-4fcf-86f1-cc43da3b2dad None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:22.938035 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc222ca-ab39-446a-a1b7-9fef8a17330e None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:22.997286 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5059b9f5-1f0c-404d-8d1b-d1e95992320c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:22.997934 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5059b9f5-1f0c-404d-8d1b-d1e95992320c None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:22.998171 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5059b9f5-1f0c-404d-8d1b-d1e95992320c None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:22.998450 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5059b9f5-1f0c-404d-8d1b-d1e95992320c None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:22.999217 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5059b9f5-1f0c-404d-8d1b-d1e95992320c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:25:22.999554 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5059b9f5-1f0c-404d-8d1b-d1e95992320c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:23.000968 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5059b9f5-1f0c-404d-8d1b-d1e95992320c None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:23.003054 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85de4412-9059-4069-b23a-7a29e8a88fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:23.003975 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85de4412-9059-4069-b23a-7a29e8a88fa2 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:23.004257 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85de4412-9059-4069-b23a-7a29e8a88fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:23.004535 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85de4412-9059-4069-b23a-7a29e8a88fa2 None admin] PATH_INFO: `/v3/users/c78d1ddf23904cb0b88c39812174a04e` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:23.005749 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85de4412-9059-4069-b23a-7a29e8a88fa2 None admin] RBAC: Authorizing `identity:get_user(user_id=c78d1ddf23904cb0b88c39812174a04e)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:23.007562 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85de4412-9059-4069-b23a-7a29e8a88fa2 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:23.009443 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 63/128] 10.222.0.36 () {56 vars in 1177 bytes} [Fri Jun 24 22:25:22 2022] GET /identity/v3/users/c78d1ddf23904cb0b88c39812174a04e => generated 275 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:23.010034 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85de4412-9059-4069-b23a-7a29e8a88fa2 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:23.022621 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 66/129] 10.222.0.36 () {56 vars in 1099 bytes} [Fri Jun 24 22:25:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:23.035336 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5059b9f5-1f0c-404d-8d1b-d1e95992320c None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:23.198649 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5059b9f5-1f0c-404d-8d1b-d1e95992320c None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:23.229585 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85de4412-9059-4069-b23a-7a29e8a88fa2 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:23.233479 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f27bde-6e2b-4dc4-8fe2-b2d1391a4d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:23.234366 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f27bde-6e2b-4dc4-8fe2-b2d1391a4d45 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:23.234650 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f27bde-6e2b-4dc4-8fe2-b2d1391a4d45 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:23.234925 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f27bde-6e2b-4dc4-8fe2-b2d1391a4d45 None admin] PATH_INFO: `/v3/projects/c163ce0b458f4aa9b60e981ba10bd611` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:23.236164 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f27bde-6e2b-4dc4-8fe2-b2d1391a4d45 None admin] RBAC: Authorizing `identity:get_project(project_id=c163ce0b458f4aa9b60e981ba10bd611)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:23.237658 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f27bde-6e2b-4dc4-8fe2-b2d1391a4d45 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:23.239394 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 67/130] 10.222.0.36 () {56 vars in 1186 bytes} [Fri Jun 24 22:25:23 2022] GET /identity/v3/projects/c163ce0b458f4aa9b60e981ba10bd611 => generated 312 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:23.240161 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f27bde-6e2b-4dc4-8fe2-b2d1391a4d45 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:23.255564 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:23.336044 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf106456-88e3-4fb7-aae4-589b7401ecfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:23.336985 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf106456-88e3-4fb7-aae4-589b7401ecfd None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:23.337271 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf106456-88e3-4fb7-aae4-589b7401ecfd None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:23.337555 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf106456-88e3-4fb7-aae4-589b7401ecfd None admin] PATH_INFO: `/v3/users/c78d1ddf23904cb0b88c39812174a04e` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:23.344050 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf106456-88e3-4fb7-aae4-589b7401ecfd None admin] RBAC: Authorizing `identity:get_user(user_id=c78d1ddf23904cb0b88c39812174a04e)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:23.345576 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf106456-88e3-4fb7-aae4-589b7401ecfd None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:23.346992 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f27bde-6e2b-4dc4-8fe2-b2d1391a4d45 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:23.347366 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 64/131] 10.222.0.36 () {56 vars in 1177 bytes} [Fri Jun 24 22:25:23 2022] GET /identity/v3/users/c78d1ddf23904cb0b88c39812174a04e => generated 275 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:23.348139 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf106456-88e3-4fb7-aae4-589b7401ecfd None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:23.385328 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0618c166-6ab4-4ed4-aa18-7bbc1cc5ba65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:23.386466 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0618c166-6ab4-4ed4-aa18-7bbc1cc5ba65 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:23.386915 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0618c166-6ab4-4ed4-aa18-7bbc1cc5ba65 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:23.387243 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0618c166-6ab4-4ed4-aa18-7bbc1cc5ba65 None admin] PATH_INFO: `/v3/users/e1b71ca6ab0b436d901fe1079176cb45` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:23.388506 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0618c166-6ab4-4ed4-aa18-7bbc1cc5ba65 None admin] RBAC: Authorizing `identity:get_user(user_id=e1b71ca6ab0b436d901fe1079176cb45)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:23.390494 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0618c166-6ab4-4ed4-aa18-7bbc1cc5ba65 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:23.392456 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 68/132] 10.222.0.36 () {56 vars in 1177 bytes} [Fri Jun 24 22:25:23 2022] GET /identity/v3/users/e1b71ca6ab0b436d901fe1079176cb45 => generated 247 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:23.393405 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0618c166-6ab4-4ed4-aa18-7bbc1cc5ba65 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:23.401154 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:23.499662 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:23.513207 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0618c166-6ab4-4ed4-aa18-7bbc1cc5ba65 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:23.554881 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deee87df-8be7-4e87-b815-bd9a6398ac21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:23.556183 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deee87df-8be7-4e87-b815-bd9a6398ac21 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:23.556568 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deee87df-8be7-4e87-b815-bd9a6398ac21 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:23.557017 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deee87df-8be7-4e87-b815-bd9a6398ac21 None admin] PATH_INFO: `/v3/projects/8130cc4553114edcaa7ac3278c906eed` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:23.558453 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deee87df-8be7-4e87-b815-bd9a6398ac21 None admin] RBAC: Authorizing `identity:get_project(project_id=8130cc4553114edcaa7ac3278c906eed)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:23.560744 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deee87df-8be7-4e87-b815-bd9a6398ac21 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:23.563558 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 69/133] 10.222.0.36 () {56 vars in 1186 bytes} [Fri Jun 24 22:25:23 2022] GET /identity/v3/projects/8130cc4553114edcaa7ac3278c906eed => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:23.564391 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deee87df-8be7-4e87-b815-bd9a6398ac21 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:23.576016 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf106456-88e3-4fb7-aae4-589b7401ecfd None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:23.610889 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a776d396-be9b-4480-a28d-db67a4f1b295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:23.611874 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a776d396-be9b-4480-a28d-db67a4f1b295 None admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:23.612174 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a776d396-be9b-4480-a28d-db67a4f1b295 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:23.612514 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a776d396-be9b-4480-a28d-db67a4f1b295 None admin] PATH_INFO: `/v3/projects/c163ce0b458f4aa9b60e981ba10bd611/users/c78d1ddf23904cb0b88c39812174a04e/roles/1928787bfcc745419829cd315900ac44` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:23.614548 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a776d396-be9b-4480-a28d-db67a4f1b295 None admin] RBAC: Authorizing `identity:create_grant(project_id=c163ce0b458f4aa9b60e981ba10bd611, user_id=c78d1ddf23904cb0b88c39812174a04e, role_id=1928787bfcc745419829cd315900ac44)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:23.616231 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a776d396-be9b-4480-a28d-db67a4f1b295 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:23.634876 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 65/134] 10.222.0.36 () {58 vars in 1439 bytes} [Fri Jun 24 22:25:23 2022] PUT /identity/v3/projects/c163ce0b458f4aa9b60e981ba10bd611/users/c78d1ddf23904cb0b88c39812174a04e/roles/1928787bfcc745419829cd315900ac44 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:25:23.637054 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bef1cc-dfce-49ca-afd3-c28c0e82cacb None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:23.637685 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bef1cc-dfce-49ca-afd3-c28c0e82cacb None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:23.637979 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bef1cc-dfce-49ca-afd3-c28c0e82cacb None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:23.639929 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 66/135] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:25:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:25:23.640702 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bef1cc-dfce-49ca-afd3-c28c0e82cacb None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:23.724738 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deee87df-8be7-4e87-b815-bd9a6398ac21 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:23.763443 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72bf5a2-ca12-4dab-abaf-70d9b5a1b36b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:23.764306 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72bf5a2-ca12-4dab-abaf-70d9b5a1b36b None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:23.764596 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72bf5a2-ca12-4dab-abaf-70d9b5a1b36b None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:23.764876 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72bf5a2-ca12-4dab-abaf-70d9b5a1b36b None admin] PATH_INFO: `/v3/projects/8130cc4553114edcaa7ac3278c906eed` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:23.766098 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72bf5a2-ca12-4dab-abaf-70d9b5a1b36b None admin] RBAC: Authorizing `identity:get_project(project_id=8130cc4553114edcaa7ac3278c906eed)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:23.767607 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72bf5a2-ca12-4dab-abaf-70d9b5a1b36b None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:23.769667 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 70/136] 10.222.0.36 () {56 vars in 1186 bytes} [Fri Jun 24 22:25:23 2022] GET /identity/v3/projects/8130cc4553114edcaa7ac3278c906eed => generated 298 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:23.770729 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eeda99-7a2b-4658-b5fa-dd3254acebde None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:23.771050 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eeda99-7a2b-4658-b5fa-dd3254acebde None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:23.774462 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eeda99-7a2b-4658-b5fa-dd3254acebde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:23.790346 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-a3eeda99-7a2b-4658-b5fa-dd3254acebde None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:25:23.792482 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-a3eeda99-7a2b-4658-b5fa-dd3254acebde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:25:23.805135 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:23.831183 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:23.872606 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 71/137] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:25:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 22:25:23.873864 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eeda99-7a2b-4658-b5fa-dd3254acebde None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:23.879128 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bef1cc-dfce-49ca-afd3-c28c0e82cacb None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:23.923122 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63826f65-6b23-434c-8f50-dcfb10af0600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:23.924031 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63826f65-6b23-434c-8f50-dcfb10af0600 None admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:23.924687 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63826f65-6b23-434c-8f50-dcfb10af0600 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:23.925067 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63826f65-6b23-434c-8f50-dcfb10af0600 None admin] PATH_INFO: `/v3/projects/8130cc4553114edcaa7ac3278c906eed/users/c78d1ddf23904cb0b88c39812174a04e/roles/bf32f251a7764c7188fd782b65275038` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:23.928289 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63826f65-6b23-434c-8f50-dcfb10af0600 None admin] RBAC: Authorizing `identity:create_grant(project_id=8130cc4553114edcaa7ac3278c906eed, user_id=c78d1ddf23904cb0b88c39812174a04e, role_id=bf32f251a7764c7188fd782b65275038)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:23.930391 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63826f65-6b23-434c-8f50-dcfb10af0600 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:23.952184 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 67/138] 10.222.0.36 () {58 vars in 1439 bytes} [Fri Jun 24 22:25:23 2022] PUT /identity/v3/projects/8130cc4553114edcaa7ac3278c906eed/users/c78d1ddf23904cb0b88c39812174a04e/roles/bf32f251a7764c7188fd782b65275038 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:25:23.953409 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63826f65-6b23-434c-8f50-dcfb10af0600 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:23.999561 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eeda99-7a2b-4658-b5fa-dd3254acebde None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:24.040605 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71165254-fc01-45c3-9429-4a2af013ef27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:24.041632 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71165254-fc01-45c3-9429-4a2af013ef27 None admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:24.042230 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71165254-fc01-45c3-9429-4a2af013ef27 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:24.042230 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71165254-fc01-45c3-9429-4a2af013ef27 None admin] PATH_INFO: `/v3/projects/8130cc4553114edcaa7ac3278c906eed/users/e1b71ca6ab0b436d901fe1079176cb45/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:24.049538 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71165254-fc01-45c3-9429-4a2af013ef27 None admin] RBAC: Authorizing `identity:create_grant(project_id=8130cc4553114edcaa7ac3278c906eed, user_id=e1b71ca6ab0b436d901fe1079176cb45, role_id=1a1c43cc97a0407eb7a7c7a1333a9d4a)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:24.052285 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71165254-fc01-45c3-9429-4a2af013ef27 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:24.078086 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 72/139] 10.222.0.36 () {58 vars in 1439 bytes} [Fri Jun 24 22:25:23 2022] PUT /identity/v3/projects/8130cc4553114edcaa7ac3278c906eed/users/e1b71ca6ab0b436d901fe1079176cb45/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:25:24.127489 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63826f65-6b23-434c-8f50-dcfb10af0600 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:24.179282 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c30dc1-c116-4dff-a98d-0e63c9f7c334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:24.180165 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c30dc1-c116-4dff-a98d-0e63c9f7c334 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:24.180452 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c30dc1-c116-4dff-a98d-0e63c9f7c334 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:24.180732 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c30dc1-c116-4dff-a98d-0e63c9f7c334 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:24.184165 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c30dc1-c116-4dff-a98d-0e63c9f7c334 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:24.185715 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c30dc1-c116-4dff-a98d-0e63c9f7c334 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:24.187592 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 68/140] 10.222.0.36 () {56 vars in 1108 bytes} [Fri Jun 24 22:25:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:24.193763 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71165254-fc01-45c3-9429-4a2af013ef27 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:24.208687 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:24.307469 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e29921-d4df-4e6a-8f84-5e4737d4f21a None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:24.307689 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e29921-d4df-4e6a-8f84-5e4737d4f21a None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:24.307942 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e29921-d4df-4e6a-8f84-5e4737d4f21a None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:24.309395 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 69/141] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:25:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:25:24.314933 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0760d0cb-0729-4ec4-a9af-f561e4ce74f4 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:24.315231 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0760d0cb-0729-4ec4-a9af-f561e4ce74f4 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:24.315552 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0760d0cb-0729-4ec4-a9af-f561e4ce74f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:24.335663 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71165254-fc01-45c3-9429-4a2af013ef27 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:24.341888 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:24.357269 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-0760d0cb-0729-4ec4-a9af-f561e4ce74f4 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:25:24.358498 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-0760d0cb-0729-4ec4-a9af-f561e4ce74f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:25:24.378966 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396f05a9-88d8-463b-850a-96c47e981018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:24.379716 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396f05a9-88d8-463b-850a-96c47e981018 None admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:24.379998 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396f05a9-88d8-463b-850a-96c47e981018 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:24.380272 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396f05a9-88d8-463b-850a-96c47e981018 None admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:24.381384 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396f05a9-88d8-463b-850a-96c47e981018 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:24.382891 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396f05a9-88d8-463b-850a-96c47e981018 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:24.425944 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 73/142] 10.222.0.36 () {60 vars in 1132 bytes} [Fri Jun 24 22:25:24 2022] POST /identity/v3/users => generated 283 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:25:24.498167 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 70/143] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:25:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 22:25:24.538571 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396f05a9-88d8-463b-850a-96c47e981018 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:24.614298 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:24.674597 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396f05a9-88d8-463b-850a-96c47e981018 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:24.716738 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e9e3d8-2585-4fd2-b9b7-ba1437e25b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:24.717948 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e9e3d8-2585-4fd2-b9b7-ba1437e25b4d None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:24.718440 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e9e3d8-2585-4fd2-b9b7-ba1437e25b4d None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:24.718927 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e9e3d8-2585-4fd2-b9b7-ba1437e25b4d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:24.732059 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e9e3d8-2585-4fd2-b9b7-ba1437e25b4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 22:25:24.740341 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-10e9e3d8-2585-4fd2-b9b7-ba1437e25b4d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 22:25:24.740341 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:25:24.740341 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:25:24.740341 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:25:24.740341 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:25:24.740341 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:25:24.740341 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:25:24.740341 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:25:24.740341 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:25:24.740341 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:25:24.740341 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:25:24.740341 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:25:24.740341 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 22:25:24.740341 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 22:25:24.740341 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 22:25:24.740341 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 22:25:24.741182 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 22:25:24.741182 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 22:25:24.741182 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 22:25:24.741182 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 22:25:24.741182 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:25:24.741182 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:25:24.741182 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:25:24.741182 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:25:24.741182 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:25:24.741182 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:25:24.741182 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:25:24.741182 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:25:24.741182 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:25:24.741182 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:25:24.741182 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:25:24.741182 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:25:24.741935 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:25:24.741935 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:25:24.741935 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:25:24.741935 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:25:24.741935 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 22:25:24.741935 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 22:25:24.741935 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 22:25:24.741935 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 22:25:24.741935 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 22:25:24.741935 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 22:25:24.741935 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 22:25:24.741935 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:25:24.744395 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 74/144] 10.222.0.36 () {56 vars in 1099 bytes} [Fri Jun 24 22:25:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:25:24.750615 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0760d0cb-0729-4ec4-a9af-f561e4ce74f4 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:24.860231 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0760d0cb-0729-4ec4-a9af-f561e4ce74f4 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:24.862892 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eea67c-8c57-4058-8613-ea63530e09dd None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:24.863497 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eea67c-8c57-4058-8613-ea63530e09dd None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:24.863975 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eea67c-8c57-4058-8613-ea63530e09dd None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:24.865910 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 75/145] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:25:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:25:24.872416 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cfd66a-8ee9-49d8-bde1-03770eda995d None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:24.872979 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cfd66a-8ee9-49d8-bde1-03770eda995d None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:24.873516 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cfd66a-8ee9-49d8-bde1-03770eda995d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:24.901548 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d871a82a-1875-400e-a226-146e8946fddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:24.902056 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d871a82a-1875-400e-a226-146e8946fddc None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:24.902342 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d871a82a-1875-400e-a226-146e8946fddc None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:24.902626 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d871a82a-1875-400e-a226-146e8946fddc None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:24.903432 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d871a82a-1875-400e-a226-146e8946fddc None admin] RBAC: Adding query filter params (name=member) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:25:24.903748 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d871a82a-1875-400e-a226-146e8946fddc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:24.905188 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d871a82a-1875-400e-a226-146e8946fddc None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:24.910664 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-49cfd66a-8ee9-49d8-bde1-03770eda995d None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:25:24.911914 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-49cfd66a-8ee9-49d8-bde1-03770eda995d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:25:24.915082 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:24.931538 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 71/146] 10.222.0.36 () {56 vars in 1101 bytes} [Fri Jun 24 22:25:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:24.933036 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d871a82a-1875-400e-a226-146e8946fddc None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:25.046262 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 76/147] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:25:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 22:25:25.077747 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cfd66a-8ee9-49d8-bde1-03770eda995d None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:25.090683 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d871a82a-1875-400e-a226-146e8946fddc None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:25.129116 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19ab211-9d8e-42b1-8892-0ff537d26720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:25.129934 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19ab211-9d8e-42b1-8892-0ff537d26720 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:25.130226 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19ab211-9d8e-42b1-8892-0ff537d26720 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:25.130510 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19ab211-9d8e-42b1-8892-0ff537d26720 None admin] PATH_INFO: `/v3/users/c78d1ddf23904cb0b88c39812174a04e` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:25.132165 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19ab211-9d8e-42b1-8892-0ff537d26720 None admin] RBAC: Authorizing `identity:get_user(user_id=c78d1ddf23904cb0b88c39812174a04e)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:25.133647 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19ab211-9d8e-42b1-8892-0ff537d26720 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:25.135843 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 72/148] 10.222.0.36 () {56 vars in 1177 bytes} [Fri Jun 24 22:25:24 2022] GET /identity/v3/users/c78d1ddf23904cb0b88c39812174a04e => generated 275 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 22:25:25.141313 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19ab211-9d8e-42b1-8892-0ff537d26720 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:25.227657 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:25.242536 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:25.253023 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19ab211-9d8e-42b1-8892-0ff537d26720 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:25.292093 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba7adc4-756f-43b5-a213-52d39ccb52c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:25.292549 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba7adc4-756f-43b5-a213-52d39ccb52c9 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:25.292841 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba7adc4-756f-43b5-a213-52d39ccb52c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:25.293125 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba7adc4-756f-43b5-a213-52d39ccb52c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:25.371277 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba7adc4-756f-43b5-a213-52d39ccb52c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:25.373173 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba7adc4-756f-43b5-a213-52d39ccb52c9 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:25.405278 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cfd66a-8ee9-49d8-bde1-03770eda995d None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:25.449226 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:25.467999 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72520de8-3983-4586-b01e-940e3d966db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:25.468834 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72520de8-3983-4586-b01e-940e3d966db6 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:25.469118 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72520de8-3983-4586-b01e-940e3d966db6 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:25.469394 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72520de8-3983-4586-b01e-940e3d966db6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:25.480991 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 73/149] 10.222.0.36 () {58 vars in 1282 bytes} [Fri Jun 24 22:25:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 24 22:25:25.486849 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba7adc4-756f-43b5-a213-52d39ccb52c9 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:25.492869 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72520de8-3983-4586-b01e-940e3d966db6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 22:25:25.508966 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-72520de8-3983-4586-b01e-940e3d966db6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 22:25:25.508966 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:25:25.508966 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:25:25.508966 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:25:25.508966 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:25:25.508966 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:25:25.508966 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:25:25.508966 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:25:25.508966 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:25:25.508966 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:25:25.508966 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:25:25.508966 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:25:25.508966 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 22:25:25.508966 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 22:25:25.508966 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 22:25:25.508966 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 22:25:25.509891 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 22:25:25.509891 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 22:25:25.509891 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 22:25:25.509891 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 22:25:25.509891 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:25:25.509891 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:25:25.509891 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:25:25.509891 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:25:25.509891 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:25:25.509891 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:25:25.509891 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:25:25.509891 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:25:25.509891 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:25:25.509891 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:25:25.509891 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:25:25.509891 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:25:25.510709 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:25:25.510709 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:25:25.510709 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:25:25.510709 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:25:25.510709 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 22:25:25.510709 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 22:25:25.510709 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 22:25:25.510709 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 22:25:25.510709 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 22:25:25.510709 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 22:25:25.510709 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 22:25:25.510709 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:25:25.510709 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 77/150] 10.222.0.36 () {56 vars in 1099 bytes} [Fri Jun 24 22:25:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 433 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 22:25:25.520256 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72520de8-3983-4586-b01e-940e3d966db6 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:25.598142 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba7adc4-756f-43b5-a213-52d39ccb52c9 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:25.633659 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebc35a6-ad02-4cbe-8b89-1833488602de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:25.634549 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc35a6-ad02-4cbe-8b89-1833488602de None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:25.634970 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc35a6-ad02-4cbe-8b89-1833488602de None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:25.635325 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc35a6-ad02-4cbe-8b89-1833488602de None admin] PATH_INFO: `/v3/projects/8130cc4553114edcaa7ac3278c906eed` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:25.637209 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebc35a6-ad02-4cbe-8b89-1833488602de None admin] RBAC: Authorizing `identity:get_project(project_id=8130cc4553114edcaa7ac3278c906eed)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:25.638794 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebc35a6-ad02-4cbe-8b89-1833488602de None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:25.641689 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 74/151] 10.222.0.36 () {56 vars in 1186 bytes} [Fri Jun 24 22:25:25 2022] GET /identity/v3/projects/8130cc4553114edcaa7ac3278c906eed => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 22:25:25.647284 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebc35a6-ad02-4cbe-8b89-1833488602de None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:25.692511 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:25.702345 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72520de8-3983-4586-b01e-940e3d966db6 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:25.734600 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:25.761874 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebc35a6-ad02-4cbe-8b89-1833488602de None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:25.785308 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544e13ae-4ef1-4b84-80f9-b7fbffa0fed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:25.786012 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544e13ae-4ef1-4b84-80f9-b7fbffa0fed6 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:25.786291 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544e13ae-4ef1-4b84-80f9-b7fbffa0fed6 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:25.786566 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544e13ae-4ef1-4b84-80f9-b7fbffa0fed6 None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:25.787360 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544e13ae-4ef1-4b84-80f9-b7fbffa0fed6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:25:25.787679 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544e13ae-4ef1-4b84-80f9-b7fbffa0fed6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:25.789101 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544e13ae-4ef1-4b84-80f9-b7fbffa0fed6 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:25.803147 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 78/152] 10.222.0.36 () {56 vars in 1101 bytes} [Fri Jun 24 22:25:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:25.805258 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20749ebf-a369-4f3d-befc-582bc9d58a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:25.805978 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20749ebf-a369-4f3d-befc-582bc9d58a32 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:25.806262 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20749ebf-a369-4f3d-befc-582bc9d58a32 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:25.806584 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20749ebf-a369-4f3d-befc-582bc9d58a32 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:25.807831 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20749ebf-a369-4f3d-befc-582bc9d58a32 None admin] RBAC: Adding query filter params (role.id=1928787bfcc745419829cd315900ac44, scope.project.id=8130cc4553114edcaa7ac3278c906eed, user.id=c78d1ddf23904cb0b88c39812174a04e) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:25:25.808160 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20749ebf-a369-4f3d-befc-582bc9d58a32 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:25.809677 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20749ebf-a369-4f3d-befc-582bc9d58a32 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:25.812107 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544e13ae-4ef1-4b84-80f9-b7fbffa0fed6 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:25.827857 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 75/153] 10.222.0.36 () {56 vars in 1374 bytes} [Fri Jun 24 22:25:25 2022] GET /identity/v3/role_assignments?user.id=c78d1ddf23904cb0b88c39812174a04e&scope.project.id=8130cc4553114edcaa7ac3278c906eed&role.id=1928787bfcc745419829cd315900ac44 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 22:25:25.936582 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544e13ae-4ef1-4b84-80f9-b7fbffa0fed6 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:25.973230 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e041f34-2ab4-489b-b7f9-8aad5f7cb8d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:25.974074 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e041f34-2ab4-489b-b7f9-8aad5f7cb8d1 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:25.974363 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e041f34-2ab4-489b-b7f9-8aad5f7cb8d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:25.974642 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e041f34-2ab4-489b-b7f9-8aad5f7cb8d1 None admin] PATH_INFO: `/v3/users/f4756b216ba34275bf794c01488ec866` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:25.976012 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e041f34-2ab4-489b-b7f9-8aad5f7cb8d1 None admin] RBAC: Authorizing `identity:get_user(user_id=f4756b216ba34275bf794c01488ec866)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:25.977503 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e041f34-2ab4-489b-b7f9-8aad5f7cb8d1 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:25.979273 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 79/154] 10.222.0.36 () {56 vars in 1177 bytes} [Fri Jun 24 22:25:25 2022] GET /identity/v3/users/f4756b216ba34275bf794c01488ec866 => generated 289 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:25.985566 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20749ebf-a369-4f3d-befc-582bc9d58a32 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:26.096811 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20749ebf-a369-4f3d-befc-582bc9d58a32 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:26.098530 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:26.135500 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bd9f9a-ed39-4692-859e-55ee2ffd9744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:26.136494 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bd9f9a-ed39-4692-859e-55ee2ffd9744 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:26.136781 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bd9f9a-ed39-4692-859e-55ee2ffd9744 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:26.137059 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bd9f9a-ed39-4692-859e-55ee2ffd9744 None admin] PATH_INFO: `/v3/projects/8130cc4553114edcaa7ac3278c906eed` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:26.138337 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bd9f9a-ed39-4692-859e-55ee2ffd9744 None admin] RBAC: Authorizing `identity:get_project(project_id=8130cc4553114edcaa7ac3278c906eed)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:26.139946 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bd9f9a-ed39-4692-859e-55ee2ffd9744 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:26.141851 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 76/155] 10.222.0.36 () {56 vars in 1186 bytes} [Fri Jun 24 22:25:25 2022] GET /identity/v3/projects/8130cc4553114edcaa7ac3278c906eed => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:26.147656 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e041f34-2ab4-489b-b7f9-8aad5f7cb8d1 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:26.194884 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:26.257211 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e041f34-2ab4-489b-b7f9-8aad5f7cb8d1 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:26.294093 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e702e475-dfd0-47d1-9ed9-0606e227a262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:26.295019 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702e475-dfd0-47d1-9ed9-0606e227a262 None admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:26.295328 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702e475-dfd0-47d1-9ed9-0606e227a262 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:26.295612 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702e475-dfd0-47d1-9ed9-0606e227a262 None admin] PATH_INFO: `/v3/projects/8130cc4553114edcaa7ac3278c906eed/users/f4756b216ba34275bf794c01488ec866/roles/c32d1d4e9658499ca095bd31a1fe816d` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:26.297627 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e702e475-dfd0-47d1-9ed9-0606e227a262 None admin] RBAC: Authorizing `identity:create_grant(project_id=8130cc4553114edcaa7ac3278c906eed, user_id=f4756b216ba34275bf794c01488ec866, role_id=c32d1d4e9658499ca095bd31a1fe816d)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:26.299232 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e702e475-dfd0-47d1-9ed9-0606e227a262 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:26.317249 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 80/156] 10.222.0.36 () {58 vars in 1439 bytes} [Fri Jun 24 22:25:26 2022] PUT /identity/v3/projects/8130cc4553114edcaa7ac3278c906eed/users/f4756b216ba34275bf794c01488ec866/roles/c32d1d4e9658499ca095bd31a1fe816d => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:25:26.801311 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c04d90-424e-437b-b2d7-77bcc30537ab None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:26.801683 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c04d90-424e-437b-b2d7-77bcc30537ab None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:26.801873 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c04d90-424e-437b-b2d7-77bcc30537ab None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:26.803300 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 77/157] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:25:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:25:26.809480 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec11870-9be3-4747-9ca7-63f1f07bfca5 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:26.809771 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec11870-9be3-4747-9ca7-63f1f07bfca5 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:26.810052 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec11870-9be3-4747-9ca7-63f1f07bfca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:26.831559 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-9ec11870-9be3-4747-9ca7-63f1f07bfca5 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:25:26.832831 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-9ec11870-9be3-4747-9ca7-63f1f07bfca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:25:26.911142 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 81/158] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:25:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 22:25:26.944721 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c04d90-424e-437b-b2d7-77bcc30537ab None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:27.064040 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c04d90-424e-437b-b2d7-77bcc30537ab None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:27.106737 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede2dc04-2a1b-40de-a509-4099a7338261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:27.107645 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede2dc04-2a1b-40de-a509-4099a7338261 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:27.107932 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede2dc04-2a1b-40de-a509-4099a7338261 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:27.108207 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede2dc04-2a1b-40de-a509-4099a7338261 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:27.121986 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede2dc04-2a1b-40de-a509-4099a7338261 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 22:25:27.130278 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-ede2dc04-2a1b-40de-a509-4099a7338261 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 22:25:27.130278 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:25:27.130278 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:25:27.130278 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:25:27.130278 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:25:27.130278 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:25:27.130278 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:25:27.130278 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:25:27.130278 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:25:27.130278 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:25:27.130278 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:25:27.130278 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:25:27.130278 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 22:25:27.130278 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 22:25:27.130278 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 22:25:27.130278 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 22:25:27.131578 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 22:25:27.131578 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 22:25:27.131578 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 22:25:27.131578 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 22:25:27.131578 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:25:27.131578 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:25:27.131578 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:25:27.131578 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:25:27.131578 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:25:27.131578 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:25:27.131578 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:25:27.131578 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:25:27.131578 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:25:27.131578 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:25:27.131578 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:25:27.131578 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:25:27.132796 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:25:27.132796 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:25:27.132796 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:25:27.132796 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:25:27.132796 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 22:25:27.132796 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 22:25:27.132796 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 22:25:27.132796 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 22:25:27.132796 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 22:25:27.132796 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 22:25:27.132796 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 22:25:27.132796 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:25:27.132796 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 78/159] 10.222.0.36 () {56 vars in 1114 bytes} [Fri Jun 24 22:25:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:25:27.139583 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec11870-9be3-4747-9ca7-63f1f07bfca5 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:27.188126 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:27.267741 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec11870-9be3-4747-9ca7-63f1f07bfca5 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:27.310810 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf11539-4933-4750-9a61-7da943367611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:27.311534 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf11539-4933-4750-9a61-7da943367611 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:27.311883 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf11539-4933-4750-9a61-7da943367611 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:27.312165 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf11539-4933-4750-9a61-7da943367611 None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:27.312982 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf11539-4933-4750-9a61-7da943367611 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:25:27.313301 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf11539-4933-4750-9a61-7da943367611 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:27.314772 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf11539-4933-4750-9a61-7da943367611 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:27.323452 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 82/160] 10.222.0.36 () {56 vars in 1111 bytes} [Fri Jun 24 22:25:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:27.329399 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede2dc04-2a1b-40de-a509-4099a7338261 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:27.363238 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:27.454182 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede2dc04-2a1b-40de-a509-4099a7338261 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:27.494800 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c2b164-e77c-40c6-a936-4c6251d6f0b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:27.495752 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c2b164-e77c-40c6-a936-4c6251d6f0b5 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:27.496038 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c2b164-e77c-40c6-a936-4c6251d6f0b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:27.496317 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c2b164-e77c-40c6-a936-4c6251d6f0b5 None admin] PATH_INFO: `/v3/users/c78d1ddf23904cb0b88c39812174a04e` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:27.497703 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c2b164-e77c-40c6-a936-4c6251d6f0b5 None admin] RBAC: Authorizing `identity:get_user(user_id=c78d1ddf23904cb0b88c39812174a04e)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:27.499275 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c2b164-e77c-40c6-a936-4c6251d6f0b5 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:27.500958 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 79/161] 10.222.0.36 () {56 vars in 1177 bytes} [Fri Jun 24 22:25:27 2022] GET /identity/v3/users/c78d1ddf23904cb0b88c39812174a04e => generated 275 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:27.507138 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf11539-4933-4750-9a61-7da943367611 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:27.623579 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf11539-4933-4750-9a61-7da943367611 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:27.625343 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:27.666892 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35691c66-d5fb-4eaf-97c0-b72d644cf3d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:27.667669 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35691c66-d5fb-4eaf-97c0-b72d644cf3d3 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:27.667958 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35691c66-d5fb-4eaf-97c0-b72d644cf3d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:27.668245 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35691c66-d5fb-4eaf-97c0-b72d644cf3d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:27.713141 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4eabee-86e1-42d6-b7de-215090d9d0c7 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:27.713475 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4eabee-86e1-42d6-b7de-215090d9d0c7 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:27.713815 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4eabee-86e1-42d6-b7de-215090d9d0c7 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:27.715242 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 80/162] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:25:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:25:27.720614 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576eb502-c8a5-4e5b-8c82-86112c89f8ac None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:27.720904 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576eb502-c8a5-4e5b-8c82-86112c89f8ac None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:27.721189 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576eb502-c8a5-4e5b-8c82-86112c89f8ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:27.754268 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-576eb502-c8a5-4e5b-8c82-86112c89f8ac None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:25:27.755515 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-576eb502-c8a5-4e5b-8c82-86112c89f8ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:25:27.803969 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35691c66-d5fb-4eaf-97c0-b72d644cf3d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:27.805511 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35691c66-d5fb-4eaf-97c0-b72d644cf3d3 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:27.936900 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:27.946490 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 83/163] 10.222.0.36 () {58 vars in 1282 bytes} [Fri Jun 24 22:25:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 22:25:27.953671 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35691c66-d5fb-4eaf-97c0-b72d644cf3d3 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:27.985181 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 81/164] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:25:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 22:25:28.024348 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576eb502-c8a5-4e5b-8c82-86112c89f8ac None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:28.068651 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:28.098269 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35691c66-d5fb-4eaf-97c0-b72d644cf3d3 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:28.190876 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83014ec-0227-46b8-9e62-8b922cb814cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:28.192590 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83014ec-0227-46b8-9e62-8b922cb814cc None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:28.193077 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83014ec-0227-46b8-9e62-8b922cb814cc None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:28.193542 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83014ec-0227-46b8-9e62-8b922cb814cc None admin] PATH_INFO: `/v3/projects/8130cc4553114edcaa7ac3278c906eed` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:28.195640 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83014ec-0227-46b8-9e62-8b922cb814cc None admin] RBAC: Authorizing `identity:get_project(project_id=8130cc4553114edcaa7ac3278c906eed)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:28.197726 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83014ec-0227-46b8-9e62-8b922cb814cc None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:28.206259 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 84/165] 10.222.0.36 () {56 vars in 1186 bytes} [Fri Jun 24 22:25:27 2022] GET /identity/v3/projects/8130cc4553114edcaa7ac3278c906eed => generated 298 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 22:25:28.215846 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83014ec-0227-46b8-9e62-8b922cb814cc None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:28.253959 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576eb502-c8a5-4e5b-8c82-86112c89f8ac None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:28.344126 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99877f3e-37d8-4d56-9327-2328fdb2999e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:28.344951 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99877f3e-37d8-4d56-9327-2328fdb2999e None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:28.345242 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99877f3e-37d8-4d56-9327-2328fdb2999e None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:28.345520 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99877f3e-37d8-4d56-9327-2328fdb2999e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:28.353501 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:28.367281 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99877f3e-37d8-4d56-9327-2328fdb2999e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 22:25:28.375425 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-99877f3e-37d8-4d56-9327-2328fdb2999e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 22:25:28.375425 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:25:28.375425 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:25:28.375425 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:25:28.375425 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:25:28.375425 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:25:28.375425 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:25:28.375425 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:25:28.375425 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:25:28.375425 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:25:28.375425 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:25:28.375425 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:25:28.375425 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 22:25:28.375425 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 22:25:28.375425 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 22:25:28.375425 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 22:25:28.376297 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 22:25:28.376297 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 22:25:28.376297 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 22:25:28.376297 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 22:25:28.376297 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:25:28.376297 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:25:28.376297 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:25:28.376297 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:25:28.376297 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:25:28.376297 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:25:28.376297 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:25:28.376297 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:25:28.376297 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:25:28.376297 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:25:28.376297 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:25:28.376297 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:25:28.377705 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:25:28.377705 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:25:28.377705 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:25:28.377705 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:25:28.377705 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 22:25:28.377705 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 22:25:28.377705 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 22:25:28.377705 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 22:25:28.377705 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 22:25:28.377705 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 22:25:28.377705 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 22:25:28.377705 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:25:28.377705 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 82/166] 10.222.0.36 () {56 vars in 1099 bytes} [Fri Jun 24 22:25:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:25:28.378516 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a05c1c6-78d2-4764-a174-17707401b057 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:28.378516 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a05c1c6-78d2-4764-a174-17707401b057 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:28.378516 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a05c1c6-78d2-4764-a174-17707401b057 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:28.380775 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 83/167] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:25:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:25:28.385741 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a05c1c6-78d2-4764-a174-17707401b057 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:28.459225 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83014ec-0227-46b8-9e62-8b922cb814cc None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:28.513309 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:28.530903 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a05c1c6-78d2-4764-a174-17707401b057 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:28.532092 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452d3fa5-ffe1-49b8-9240-c084f8c8ce25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:28.532980 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d3fa5-ffe1-49b8-9240-c084f8c8ce25 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:28.533358 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d3fa5-ffe1-49b8-9240-c084f8c8ce25 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:28.533731 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d3fa5-ffe1-49b8-9240-c084f8c8ce25 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:28.534823 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452d3fa5-ffe1-49b8-9240-c084f8c8ce25 None admin] RBAC: Adding query filter params (role.id=bf32f251a7764c7188fd782b65275038, scope.project.id=8130cc4553114edcaa7ac3278c906eed, user.id=c78d1ddf23904cb0b88c39812174a04e) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:25:28.535172 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452d3fa5-ffe1-49b8-9240-c084f8c8ce25 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:28.536784 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452d3fa5-ffe1-49b8-9240-c084f8c8ce25 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:28.547924 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 85/168] 10.222.0.36 () {56 vars in 1374 bytes} [Fri Jun 24 22:25:28 2022] GET /identity/v3/role_assignments?user.id=c78d1ddf23904cb0b88c39812174a04e&scope.project.id=8130cc4553114edcaa7ac3278c906eed&role.id=bf32f251a7764c7188fd782b65275038 => generated 608 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 22:25:28.549483 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78758e9e-5010-43e0-ae03-aa3656acb484 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:28.550013 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78758e9e-5010-43e0-ae03-aa3656acb484 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:28.550517 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78758e9e-5010-43e0-ae03-aa3656acb484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:28.568762 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d110464e-c614-4792-b1bc-e4fdebaaba09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:28.569443 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d110464e-c614-4792-b1bc-e4fdebaaba09 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:28.569955 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d110464e-c614-4792-b1bc-e4fdebaaba09 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:28.570438 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d110464e-c614-4792-b1bc-e4fdebaaba09 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:28.571421 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d110464e-c614-4792-b1bc-e4fdebaaba09 None admin] RBAC: Adding query filter params (name=member) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:25:28.571934 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d110464e-c614-4792-b1bc-e4fdebaaba09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:28.573683 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d110464e-c614-4792-b1bc-e4fdebaaba09 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:28.583229 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 84/169] 10.222.0.36 () {56 vars in 1101 bytes} [Fri Jun 24 22:25:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:28.585325 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-78758e9e-5010-43e0-ae03-aa3656acb484 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:25:28.586528 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-78758e9e-5010-43e0-ae03-aa3656acb484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:25:28.588843 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d110464e-c614-4792-b1bc-e4fdebaaba09 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:28.702397 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 86/170] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:25:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 22:25:28.743484 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d110464e-c614-4792-b1bc-e4fdebaaba09 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:28.785601 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78758e9e-5010-43e0-ae03-aa3656acb484 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:28.812984 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc2ce5f-2c9a-40dc-9ee7-2f294fb58a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:28.813878 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc2ce5f-2c9a-40dc-9ee7-2f294fb58a88 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:28.814165 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc2ce5f-2c9a-40dc-9ee7-2f294fb58a88 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:28.814443 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc2ce5f-2c9a-40dc-9ee7-2f294fb58a88 None admin] PATH_INFO: `/v3/users/c78d1ddf23904cb0b88c39812174a04e` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:28.820019 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc2ce5f-2c9a-40dc-9ee7-2f294fb58a88 None admin] RBAC: Authorizing `identity:get_user(user_id=c78d1ddf23904cb0b88c39812174a04e)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:28.821508 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc2ce5f-2c9a-40dc-9ee7-2f294fb58a88 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:28.824069 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 85/171] 10.222.0.36 () {56 vars in 1177 bytes} [Fri Jun 24 22:25:28 2022] GET /identity/v3/users/c78d1ddf23904cb0b88c39812174a04e => generated 275 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:28.830116 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc2ce5f-2c9a-40dc-9ee7-2f294fb58a88 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:28.868766 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:28.882873 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:28.963955 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78758e9e-5010-43e0-ae03-aa3656acb484 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:29.015776 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ecdea7-37b5-4372-8966-869a69e5d52b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:29.016663 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ecdea7-37b5-4372-8966-869a69e5d52b None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:29.016948 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ecdea7-37b5-4372-8966-869a69e5d52b None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:29.017223 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ecdea7-37b5-4372-8966-869a69e5d52b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:29.031128 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ecdea7-37b5-4372-8966-869a69e5d52b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 22:25:29.039919 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-56ecdea7-37b5-4372-8966-869a69e5d52b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 22:25:29.039919 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:25:29.039919 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:25:29.039919 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:25:29.039919 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:25:29.039919 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:25:29.039919 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:25:29.039919 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:25:29.039919 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:25:29.039919 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:25:29.039919 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:25:29.039919 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:25:29.039919 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 22:25:29.039919 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 22:25:29.039919 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 22:25:29.039919 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 22:25:29.040953 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 22:25:29.040953 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 22:25:29.040953 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 22:25:29.040953 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 22:25:29.040953 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:25:29.040953 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:25:29.040953 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:25:29.040953 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:25:29.040953 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:25:29.040953 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:25:29.040953 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:25:29.040953 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:25:29.040953 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:25:29.040953 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:25:29.040953 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:25:29.040953 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:25:29.041814 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:25:29.041814 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:25:29.041814 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:25:29.041814 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:25:29.041814 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 22:25:29.041814 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 22:25:29.041814 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 22:25:29.041814 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 22:25:29.041814 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 22:25:29.041814 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 22:25:29.041814 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 22:25:29.041814 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:25:29.042457 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 87/172] 10.222.0.36 () {56 vars in 1096 bytes} [Fri Jun 24 22:25:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:25:29.044051 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a15132-f204-4e8e-a92c-daf71a269370 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:29.044051 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a15132-f204-4e8e-a92c-daf71a269370 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:29.044224 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a15132-f204-4e8e-a92c-daf71a269370 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:29.045568 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 88/173] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:25:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:25:29.046515 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1032e63-510b-4f7a-a4c8-26ababd01fcf None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:29.046801 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1032e63-510b-4f7a-a4c8-26ababd01fcf None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:29.047078 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1032e63-510b-4f7a-a4c8-26ababd01fcf None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:29.053341 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 89/174] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:25:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:25:29.054630 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537f266d-1e12-42d6-9402-b14e387d6bfe None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:29.054918 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537f266d-1e12-42d6-9402-b14e387d6bfe None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:29.055195 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537f266d-1e12-42d6-9402-b14e387d6bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:29.074432 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-537f266d-1e12-42d6-9402-b14e387d6bfe None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:25:29.075675 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-537f266d-1e12-42d6-9402-b14e387d6bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:25:29.083850 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc2ce5f-2c9a-40dc-9ee7-2f294fb58a88 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:29.121806 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118e8bf1-15dd-48ee-8b17-3f03ab7d464b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:29.122849 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118e8bf1-15dd-48ee-8b17-3f03ab7d464b None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:29.123370 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118e8bf1-15dd-48ee-8b17-3f03ab7d464b None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:29.123886 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118e8bf1-15dd-48ee-8b17-3f03ab7d464b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:29.146603 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 90/175] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:25:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 22:25:29.147771 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537f266d-1e12-42d6-9402-b14e387d6bfe None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:29.195632 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:29.202263 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118e8bf1-15dd-48ee-8b17-3f03ab7d464b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:29.203951 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118e8bf1-15dd-48ee-8b17-3f03ab7d464b None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:29.219675 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:29.249641 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537f266d-1e12-42d6-9402-b14e387d6bfe None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:29.284944 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d0600b-ea47-4e8a-aca7-dd1388251889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:29.285856 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d0600b-ea47-4e8a-aca7-dd1388251889 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:29.286288 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d0600b-ea47-4e8a-aca7-dd1388251889 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:29.286769 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d0600b-ea47-4e8a-aca7-dd1388251889 None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:29.287787 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d0600b-ea47-4e8a-aca7-dd1388251889 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:25:29.288293 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d0600b-ea47-4e8a-aca7-dd1388251889 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:29.289908 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d0600b-ea47-4e8a-aca7-dd1388251889 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:29.299136 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 91/176] 10.222.0.36 () {56 vars in 1099 bytes} [Fri Jun 24 22:25:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:29.300669 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693a27b4-68fa-4757-8af5-09ea88100935 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:29.301159 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693a27b4-68fa-4757-8af5-09ea88100935 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:29.301664 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693a27b4-68fa-4757-8af5-09ea88100935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:29.312135 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 86/177] 10.222.0.36 () {58 vars in 1282 bytes} [Fri Jun 24 22:25:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 22:25:29.313068 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118e8bf1-15dd-48ee-8b17-3f03ab7d464b None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:29.319632 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-693a27b4-68fa-4757-8af5-09ea88100935 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:25:29.321097 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-693a27b4-68fa-4757-8af5-09ea88100935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:25:29.389840 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 92/178] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:25:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 22:25:29.395282 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693a27b4-68fa-4757-8af5-09ea88100935 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:29.438381 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118e8bf1-15dd-48ee-8b17-3f03ab7d464b None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:29.447103 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:29.457559 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:29.481198 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61734238-6c5f-49b0-be8b-68e5353713a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:29.482240 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61734238-6c5f-49b0-be8b-68e5353713a0 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:29.482686 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61734238-6c5f-49b0-be8b-68e5353713a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:29.483100 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61734238-6c5f-49b0-be8b-68e5353713a0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:29.484564 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61734238-6c5f-49b0-be8b-68e5353713a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:29.486315 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61734238-6c5f-49b0-be8b-68e5353713a0 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:29.488237 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 87/179] 10.222.0.36 () {56 vars in 1108 bytes} [Fri Jun 24 22:25:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:29.490328 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61734238-6c5f-49b0-be8b-68e5353713a0 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:29.510873 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693a27b4-68fa-4757-8af5-09ea88100935 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:29.546198 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093f9b78-8cbe-4daf-9c41-d11eeb4c9a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:29.547174 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093f9b78-8cbe-4daf-9c41-d11eeb4c9a2a None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:29.547594 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093f9b78-8cbe-4daf-9c41-d11eeb4c9a2a None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:29.547960 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093f9b78-8cbe-4daf-9c41-d11eeb4c9a2a None admin] PATH_INFO: `/v3/users/e1b71ca6ab0b436d901fe1079176cb45` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:29.549380 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093f9b78-8cbe-4daf-9c41-d11eeb4c9a2a None admin] RBAC: Authorizing `identity:get_user(user_id=e1b71ca6ab0b436d901fe1079176cb45)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:29.551063 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093f9b78-8cbe-4daf-9c41-d11eeb4c9a2a None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:29.552979 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 93/180] 10.222.0.36 () {56 vars in 1177 bytes} [Fri Jun 24 22:25:29 2022] GET /identity/v3/users/e1b71ca6ab0b436d901fe1079176cb45 => generated 247 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:29.553927 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093f9b78-8cbe-4daf-9c41-d11eeb4c9a2a None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:29.608641 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61734238-6c5f-49b0-be8b-68e5353713a0 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:29.646128 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562674f3-ca32-41f6-a84c-1f5fddd85d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:29.647406 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562674f3-ca32-41f6-a84c-1f5fddd85d67 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:29.647825 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562674f3-ca32-41f6-a84c-1f5fddd85d67 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:29.648232 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562674f3-ca32-41f6-a84c-1f5fddd85d67 None admin] PATH_INFO: `/v3/projects/c163ce0b458f4aa9b60e981ba10bd611` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:29.649713 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562674f3-ca32-41f6-a84c-1f5fddd85d67 None admin] RBAC: Authorizing `identity:get_project(project_id=c163ce0b458f4aa9b60e981ba10bd611)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:29.651731 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562674f3-ca32-41f6-a84c-1f5fddd85d67 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:29.653933 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 88/181] 10.222.0.36 () {56 vars in 1186 bytes} [Fri Jun 24 22:25:29 2022] GET /identity/v3/projects/c163ce0b458f4aa9b60e981ba10bd611 => generated 312 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:29.654951 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562674f3-ca32-41f6-a84c-1f5fddd85d67 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:29.656227 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093f9b78-8cbe-4daf-9c41-d11eeb4c9a2a None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:29.664112 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:29.697164 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e5a2d2-dc42-4893-b515-e38119635494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:29.698679 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e5a2d2-dc42-4893-b515-e38119635494 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:29.698970 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e5a2d2-dc42-4893-b515-e38119635494 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:29.699267 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e5a2d2-dc42-4893-b515-e38119635494 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:29.709237 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:29.711079 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e5a2d2-dc42-4893-b515-e38119635494 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 22:25:29.719677 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-e3e5a2d2-dc42-4893-b515-e38119635494 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 22:25:29.719677 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:25:29.719677 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:25:29.719677 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:25:29.719677 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:25:29.719677 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:25:29.719677 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:25:29.719677 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:25:29.719677 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:25:29.719677 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:25:29.719677 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:25:29.719677 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:25:29.719677 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 22:25:29.719677 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 22:25:29.719677 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 22:25:29.719677 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 22:25:29.720555 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 22:25:29.720555 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 22:25:29.720555 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 22:25:29.720555 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 22:25:29.720555 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:25:29.720555 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:25:29.720555 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:25:29.720555 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:25:29.720555 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:25:29.720555 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:25:29.720555 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:25:29.720555 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:25:29.720555 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:25:29.720555 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:25:29.720555 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:25:29.720555 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:25:29.721323 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:25:29.721323 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:25:29.721323 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:25:29.721323 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:25:29.721323 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 22:25:29.721323 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 22:25:29.721323 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 22:25:29.721323 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 22:25:29.721323 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 22:25:29.721323 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 22:25:29.721323 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 22:25:29.721323 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:25:29.721323 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 94/182] 10.222.0.36 () {56 vars in 1096 bytes} [Fri Jun 24 22:25:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:25:29.721947 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e5a2d2-dc42-4893-b515-e38119635494 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:29.769217 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562674f3-ca32-41f6-a84c-1f5fddd85d67 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:29.806482 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6461d09b-f941-41fb-8da8-5e1c2abd3305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:29.808146 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6461d09b-f941-41fb-8da8-5e1c2abd3305 None admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:29.808449 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6461d09b-f941-41fb-8da8-5e1c2abd3305 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:29.808734 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6461d09b-f941-41fb-8da8-5e1c2abd3305 None admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:29.809788 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6461d09b-f941-41fb-8da8-5e1c2abd3305 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:29.811277 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6461d09b-f941-41fb-8da8-5e1c2abd3305 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:29.832430 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 89/183] 10.222.0.36 () {60 vars in 1132 bytes} [Fri Jun 24 22:25:29 2022] POST /identity/v3/users => generated 297 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:25:29.834167 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e5a2d2-dc42-4893-b515-e38119635494 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:29.834529 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9c0c02-7188-412d-967a-7f5ef81623b4 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:29.834961 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9c0c02-7188-412d-967a-7f5ef81623b4 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:29.835405 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9c0c02-7188-412d-967a-7f5ef81623b4 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:29.836993 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 90/184] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:25:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:25:29.837938 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9c0c02-7188-412d-967a-7f5ef81623b4 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:29.878636 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd729acf-f6ed-4878-864b-9483b888dc1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:29.879397 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd729acf-f6ed-4878-864b-9483b888dc1a None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:29.879677 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd729acf-f6ed-4878-864b-9483b888dc1a None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:29.879999 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd729acf-f6ed-4878-864b-9483b888dc1a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:29.918531 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:29.959268 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd729acf-f6ed-4878-864b-9483b888dc1a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:29.959622 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9c0c02-7188-412d-967a-7f5ef81623b4 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:29.960807 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd729acf-f6ed-4878-864b-9483b888dc1a None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:29.968479 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:30.003603 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52857e98-4ad0-4b2f-bcaf-52f46322289a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:30.004283 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52857e98-4ad0-4b2f-bcaf-52f46322289a None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:30.004571 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52857e98-4ad0-4b2f-bcaf-52f46322289a None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:30.004843 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52857e98-4ad0-4b2f-bcaf-52f46322289a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:30.005705 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52857e98-4ad0-4b2f-bcaf-52f46322289a None admin] RBAC: Adding query filter params (role.id=1928787bfcc745419829cd315900ac44, scope.project.id=c163ce0b458f4aa9b60e981ba10bd611, user.id=c78d1ddf23904cb0b88c39812174a04e) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:25:30.006353 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52857e98-4ad0-4b2f-bcaf-52f46322289a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:30.008538 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52857e98-4ad0-4b2f-bcaf-52f46322289a None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:30.015150 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 91/185] 10.222.0.36 () {56 vars in 1374 bytes} [Fri Jun 24 22:25:29 2022] GET /identity/v3/role_assignments?user.id=c78d1ddf23904cb0b88c39812174a04e&scope.project.id=c163ce0b458f4aa9b60e981ba10bd611&role.id=1928787bfcc745419829cd315900ac44 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:30.015998 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52857e98-4ad0-4b2f-bcaf-52f46322289a None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:30.100472 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 95/186] 10.222.0.36 () {58 vars in 1282 bytes} [Fri Jun 24 22:25:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 22:25:30.102853 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d8333f-9409-44b2-8591-f8144f806644 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:30.103145 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d8333f-9409-44b2-8591-f8144f806644 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:30.103451 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d8333f-9409-44b2-8591-f8144f806644 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:30.105626 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 96/187] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:25:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:25:30.106803 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bc7445-9765-424f-b8b4-9e2c6cfff7b8 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:30.107092 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bc7445-9765-424f-b8b4-9e2c6cfff7b8 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:30.107448 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bc7445-9765-424f-b8b4-9e2c6cfff7b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:30.137299 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-b3bc7445-9765-424f-b8b4-9e2c6cfff7b8 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:25:30.138544 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-b3bc7445-9765-424f-b8b4-9e2c6cfff7b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:25:30.164912 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52857e98-4ad0-4b2f-bcaf-52f46322289a None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:30.216519 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b970c4c3-7e61-4256-b008-b5204495db5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:30.217222 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b970c4c3-7e61-4256-b008-b5204495db5d None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:30.217502 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b970c4c3-7e61-4256-b008-b5204495db5d None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:30.217777 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b970c4c3-7e61-4256-b008-b5204495db5d None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:30.218933 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b970c4c3-7e61-4256-b008-b5204495db5d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:25:30.219235 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b970c4c3-7e61-4256-b008-b5204495db5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:30.221006 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b970c4c3-7e61-4256-b008-b5204495db5d None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:30.228841 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:30.231786 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 97/188] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:25:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 22:25:30.232535 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 92/189] 10.222.0.36 () {56 vars in 1099 bytes} [Fri Jun 24 22:25:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:30.233409 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bc7445-9765-424f-b8b4-9e2c6cfff7b8 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:30.233969 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc0f2f0-f482-4d8b-bd1d-065c046f1b42 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:30.234154 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc0f2f0-f482-4d8b-bd1d-065c046f1b42 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:30.234360 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc0f2f0-f482-4d8b-bd1d-065c046f1b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:30.258395 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-ebc0f2f0-f482-4d8b-bd1d-065c046f1b42 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:25:30.259617 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-ebc0f2f0-f482-4d8b-bd1d-065c046f1b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:25:30.294884 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:30.343493 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 93/190] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:25:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 22:25:30.344684 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc0f2f0-f482-4d8b-bd1d-065c046f1b42 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:30.382177 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bc7445-9765-424f-b8b4-9e2c6cfff7b8 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:30.445515 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2b25b6-4f3b-41ec-946f-95b5627af8de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:30.446402 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b25b6-4f3b-41ec-946f-95b5627af8de None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:30.446684 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b25b6-4f3b-41ec-946f-95b5627af8de None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:30.446950 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b25b6-4f3b-41ec-946f-95b5627af8de None admin] PATH_INFO: `/v3/projects/8130cc4553114edcaa7ac3278c906eed` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:30.448524 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2b25b6-4f3b-41ec-946f-95b5627af8de None admin] RBAC: Authorizing `identity:get_project(project_id=8130cc4553114edcaa7ac3278c906eed)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:30.450012 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2b25b6-4f3b-41ec-946f-95b5627af8de None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:30.451889 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 98/191] 10.222.0.36 () {56 vars in 1186 bytes} [Fri Jun 24 22:25:30 2022] GET /identity/v3/projects/8130cc4553114edcaa7ac3278c906eed => generated 298 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:30.452644 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2b25b6-4f3b-41ec-946f-95b5627af8de None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:30.486231 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc0f2f0-f482-4d8b-bd1d-065c046f1b42 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:30.521191 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:30.549041 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455034c6-ee58-4679-9e93-57e467b3f8a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:30.551218 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455034c6-ee58-4679-9e93-57e467b3f8a6 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:30.551992 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455034c6-ee58-4679-9e93-57e467b3f8a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:30.552814 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455034c6-ee58-4679-9e93-57e467b3f8a6 None admin] PATH_INFO: `/v3/users/2c5a7e7d1a0e4836808b16c2690ea655` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:30.562155 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2b25b6-4f3b-41ec-946f-95b5627af8de None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:30.578965 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455034c6-ee58-4679-9e93-57e467b3f8a6 None admin] RBAC: Authorizing `identity:get_user(user_id=2c5a7e7d1a0e4836808b16c2690ea655)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:30.581958 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455034c6-ee58-4679-9e93-57e467b3f8a6 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:30.591406 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 94/192] 10.222.0.36 () {56 vars in 1177 bytes} [Fri Jun 24 22:25:30 2022] GET /identity/v3/users/2c5a7e7d1a0e4836808b16c2690ea655 => generated 283 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:30.593125 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455034c6-ee58-4679-9e93-57e467b3f8a6 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:30.597024 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15874a56-b189-4786-843c-e8cfe73ddc7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:30.598941 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15874a56-b189-4786-843c-e8cfe73ddc7c None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:30.598941 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15874a56-b189-4786-843c-e8cfe73ddc7c None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:30.598941 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15874a56-b189-4786-843c-e8cfe73ddc7c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:30.610053 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15874a56-b189-4786-843c-e8cfe73ddc7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 22:25:30.618198 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-15874a56-b189-4786-843c-e8cfe73ddc7c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 22:25:30.618198 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:25:30.618198 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:25:30.618198 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:25:30.618198 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:25:30.618198 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:25:30.618198 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:25:30.618198 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:25:30.618198 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:25:30.618198 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:25:30.618198 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:25:30.618198 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:25:30.618198 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 22:25:30.618198 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 22:25:30.618198 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 22:25:30.618198 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 22:25:30.619274 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 22:25:30.619274 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 22:25:30.619274 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 22:25:30.619274 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 22:25:30.619274 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:25:30.619274 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:25:30.619274 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:25:30.619274 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:25:30.619274 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:25:30.619274 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:25:30.619274 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:25:30.619274 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:25:30.619274 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:25:30.619274 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:25:30.619274 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:25:30.619274 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:25:30.620402 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:25:30.620402 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:25:30.620402 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:25:30.620402 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:25:30.620402 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 22:25:30.620402 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 22:25:30.620402 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 22:25:30.620402 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 22:25:30.620402 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 22:25:30.620402 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 22:25:30.620402 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 22:25:30.620402 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:25:30.622810 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 99/193] 10.222.0.36 () {56 vars in 1114 bytes} [Fri Jun 24 22:25:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:25:30.622810 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15874a56-b189-4786-843c-e8cfe73ddc7c None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:30.623304 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:30.715335 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455034c6-ee58-4679-9e93-57e467b3f8a6 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:30.736869 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15874a56-b189-4786-843c-e8cfe73ddc7c None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:30.753848 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02ba7c7-bbf6-495e-a0ee-0d701a5b22dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:30.754893 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02ba7c7-bbf6-495e-a0ee-0d701a5b22dc None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:30.755231 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02ba7c7-bbf6-495e-a0ee-0d701a5b22dc None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:30.755628 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02ba7c7-bbf6-495e-a0ee-0d701a5b22dc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:30.768627 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02ba7c7-bbf6-495e-a0ee-0d701a5b22dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 22:25:30.772499 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:30.779101 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-b02ba7c7-bbf6-495e-a0ee-0d701a5b22dc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 22:25:30.779101 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:25:30.779101 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:25:30.779101 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:25:30.779101 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:25:30.779101 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:25:30.779101 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:25:30.779101 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:25:30.779101 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:25:30.779101 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:25:30.779101 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:25:30.779101 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:25:30.779101 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 22:25:30.779101 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 22:25:30.779101 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 22:25:30.779101 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 22:25:30.780943 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 22:25:30.780943 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 22:25:30.780943 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 22:25:30.780943 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 22:25:30.780943 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:25:30.780943 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:25:30.780943 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:25:30.780943 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:25:30.780943 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:25:30.780943 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:25:30.780943 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:25:30.780943 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:25:30.780943 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:25:30.780943 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:25:30.780943 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:25:30.780943 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:25:30.782575 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:25:30.782575 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:25:30.782575 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:25:30.782575 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:25:30.782575 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 22:25:30.782575 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 22:25:30.782575 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 22:25:30.782575 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 22:25:30.782575 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 22:25:30.782575 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 22:25:30.782575 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 22:25:30.782575 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:25:30.782575 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 95/194] 10.222.0.36 () {56 vars in 1099 bytes} [Fri Jun 24 22:25:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:25:30.783376 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02ba7c7-bbf6-495e-a0ee-0d701a5b22dc None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:30.802632 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c022c5-1439-4b6f-aad9-ab57d7ca9695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:30.803742 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c022c5-1439-4b6f-aad9-ab57d7ca9695 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:30.804502 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c022c5-1439-4b6f-aad9-ab57d7ca9695 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:30.805072 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c022c5-1439-4b6f-aad9-ab57d7ca9695 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:30.806309 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c022c5-1439-4b6f-aad9-ab57d7ca9695 None admin] RBAC: Adding query filter params (role.id=1a1c43cc97a0407eb7a7c7a1333a9d4a, scope.project.id=8130cc4553114edcaa7ac3278c906eed, user.id=e1b71ca6ab0b436d901fe1079176cb45) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:25:30.807026 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c022c5-1439-4b6f-aad9-ab57d7ca9695 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:30.809272 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c022c5-1439-4b6f-aad9-ab57d7ca9695 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:30.817320 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 100/195] 10.222.0.36 () {56 vars in 1374 bytes} [Fri Jun 24 22:25:30 2022] GET /identity/v3/role_assignments?user.id=e1b71ca6ab0b436d901fe1079176cb45&scope.project.id=8130cc4553114edcaa7ac3278c906eed&role.id=1a1c43cc97a0407eb7a7c7a1333a9d4a => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:30.819491 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c022c5-1439-4b6f-aad9-ab57d7ca9695 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:30.946747 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:30.995698 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02ba7c7-bbf6-495e-a0ee-0d701a5b22dc None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:31.002598 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c022c5-1439-4b6f-aad9-ab57d7ca9695 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:31.051606 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da19df6-cc59-4988-9f9f-845fbca4863e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:31.052445 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da19df6-cc59-4988-9f9f-845fbca4863e None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:31.052750 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da19df6-cc59-4988-9f9f-845fbca4863e None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:31.053006 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da19df6-cc59-4988-9f9f-845fbca4863e None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:31.053759 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da19df6-cc59-4988-9f9f-845fbca4863e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:25:31.054066 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da19df6-cc59-4988-9f9f-845fbca4863e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:31.054585 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff60792-f8af-4cf1-8528-4094feab10e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:31.055486 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da19df6-cc59-4988-9f9f-845fbca4863e None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:31.055634 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff60792-f8af-4cf1-8528-4094feab10e3 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:31.056034 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff60792-f8af-4cf1-8528-4094feab10e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:31.056456 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff60792-f8af-4cf1-8528-4094feab10e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:31.066138 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 101/196] 10.222.0.36 () {56 vars in 1111 bytes} [Fri Jun 24 22:25:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:31.066957 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da19df6-cc59-4988-9f9f-845fbca4863e None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:31.133484 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:31.169474 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff60792-f8af-4cf1-8528-4094feab10e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:31.171629 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff60792-f8af-4cf1-8528-4094feab10e3 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:31.194598 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da19df6-cc59-4988-9f9f-845fbca4863e None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:31.235984 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba389ae-4dae-498e-ad1d-5b192cbca41a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:31.236682 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba389ae-4dae-498e-ad1d-5b192cbca41a None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:31.236934 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba389ae-4dae-498e-ad1d-5b192cbca41a None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:31.237208 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba389ae-4dae-498e-ad1d-5b192cbca41a None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:31.237966 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba389ae-4dae-498e-ad1d-5b192cbca41a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:25:31.238269 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba389ae-4dae-498e-ad1d-5b192cbca41a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:31.239727 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba389ae-4dae-498e-ad1d-5b192cbca41a None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:31.248876 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 102/197] 10.222.0.36 () {56 vars in 1101 bytes} [Fri Jun 24 22:25:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:31.251986 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba389ae-4dae-498e-ad1d-5b192cbca41a None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:31.287506 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:31.311925 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 96/198] 10.222.0.36 () {58 vars in 1282 bytes} [Fri Jun 24 22:25:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 22:25:31.312790 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff60792-f8af-4cf1-8528-4094feab10e3 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:31.394284 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba389ae-4dae-498e-ad1d-5b192cbca41a None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:31.408910 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:31.435653 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cead3b-18f1-41eb-b47c-1590155d4105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:31.439353 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cead3b-18f1-41eb-b47c-1590155d4105 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:31.439638 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cead3b-18f1-41eb-b47c-1590155d4105 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:31.439914 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cead3b-18f1-41eb-b47c-1590155d4105 None admin] PATH_INFO: `/v3/users/2c5a7e7d1a0e4836808b16c2690ea655` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:31.441237 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cead3b-18f1-41eb-b47c-1590155d4105 None admin] RBAC: Authorizing `identity:get_user(user_id=2c5a7e7d1a0e4836808b16c2690ea655)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:31.442739 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cead3b-18f1-41eb-b47c-1590155d4105 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:31.444662 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 103/199] 10.222.0.36 () {56 vars in 1177 bytes} [Fri Jun 24 22:25:31 2022] GET /identity/v3/users/2c5a7e7d1a0e4836808b16c2690ea655 => generated 283 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:31.445241 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cead3b-18f1-41eb-b47c-1590155d4105 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:31.454559 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff60792-f8af-4cf1-8528-4094feab10e3 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:31.491280 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c758970-6e86-40ab-83fc-be3d15faa555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:31.492320 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c758970-6e86-40ab-83fc-be3d15faa555 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:31.492650 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c758970-6e86-40ab-83fc-be3d15faa555 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:31.492928 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c758970-6e86-40ab-83fc-be3d15faa555 None admin] PATH_INFO: `/v3/users/f4756b216ba34275bf794c01488ec866` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:31.494319 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c758970-6e86-40ab-83fc-be3d15faa555 None admin] RBAC: Authorizing `identity:get_user(user_id=f4756b216ba34275bf794c01488ec866)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:31.496070 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c758970-6e86-40ab-83fc-be3d15faa555 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:31.498127 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 97/200] 10.222.0.36 () {56 vars in 1177 bytes} [Fri Jun 24 22:25:31 2022] GET /identity/v3/users/f4756b216ba34275bf794c01488ec866 => generated 289 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:31.503214 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c758970-6e86-40ab-83fc-be3d15faa555 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:31.545333 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cead3b-18f1-41eb-b47c-1590155d4105 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:31.576716 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:31.580481 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a1b010-cbe2-480c-a90b-821325ed89f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:31.581369 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a1b010-cbe2-480c-a90b-821325ed89f8 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:31.582664 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a1b010-cbe2-480c-a90b-821325ed89f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:31.582946 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a1b010-cbe2-480c-a90b-821325ed89f8 None admin] PATH_INFO: `/v3/projects/deb0943e980a41b2987f1c69584ddf73` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:31.584933 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a1b010-cbe2-480c-a90b-821325ed89f8 None admin] RBAC: Authorizing `identity:get_project(project_id=deb0943e980a41b2987f1c69584ddf73)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:31.587110 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a1b010-cbe2-480c-a90b-821325ed89f8 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:31.590229 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 104/201] 10.222.0.36 () {56 vars in 1186 bytes} [Fri Jun 24 22:25:31 2022] GET /identity/v3/projects/deb0943e980a41b2987f1c69584ddf73 => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:31.591010 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a1b010-cbe2-480c-a90b-821325ed89f8 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:31.615242 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c758970-6e86-40ab-83fc-be3d15faa555 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:31.653664 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:31.658270 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f580ae04-b01b-4460-a856-b295949a26c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:31.659009 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f580ae04-b01b-4460-a856-b295949a26c6 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:31.659406 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f580ae04-b01b-4460-a856-b295949a26c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:31.659746 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f580ae04-b01b-4460-a856-b295949a26c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:31.711156 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a1b010-cbe2-480c-a90b-821325ed89f8 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:31.737062 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f580ae04-b01b-4460-a856-b295949a26c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:31.738798 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f580ae04-b01b-4460-a856-b295949a26c6 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:31.745130 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21de6bcc-da0b-4288-8810-54ba1b17e96d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:31.745798 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21de6bcc-da0b-4288-8810-54ba1b17e96d None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:31.746126 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21de6bcc-da0b-4288-8810-54ba1b17e96d None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:31.746401 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21de6bcc-da0b-4288-8810-54ba1b17e96d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:31.792415 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:31.816135 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21de6bcc-da0b-4288-8810-54ba1b17e96d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:31.817889 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21de6bcc-da0b-4288-8810-54ba1b17e96d None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:31.852122 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 98/202] 10.222.0.36 () {58 vars in 1282 bytes} [Fri Jun 24 22:25:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 22:25:31.854267 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f580ae04-b01b-4460-a856-b295949a26c6 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:31.868387 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:31.921826 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 105/203] 10.222.0.36 () {58 vars in 1282 bytes} [Fri Jun 24 22:25:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 22:25:31.926441 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21de6bcc-da0b-4288-8810-54ba1b17e96d None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:31.972635 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f580ae04-b01b-4460-a856-b295949a26c6 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:32.010028 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260b52c1-4e8b-4c7b-9a44-d0675c7f1aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:32.011098 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b52c1-4e8b-4c7b-9a44-d0675c7f1aa5 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:32.011592 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b52c1-4e8b-4c7b-9a44-d0675c7f1aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:32.012075 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b52c1-4e8b-4c7b-9a44-d0675c7f1aa5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:32.013201 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260b52c1-4e8b-4c7b-9a44-d0675c7f1aa5 None admin] RBAC: Adding query filter params (role.id=1a1c43cc97a0407eb7a7c7a1333a9d4a, scope.project.id=deb0943e980a41b2987f1c69584ddf73, user.id=2c5a7e7d1a0e4836808b16c2690ea655) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:25:32.013762 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260b52c1-4e8b-4c7b-9a44-d0675c7f1aa5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:32.015438 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260b52c1-4e8b-4c7b-9a44-d0675c7f1aa5 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:32.022310 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21de6bcc-da0b-4288-8810-54ba1b17e96d None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:32.022638 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 99/204] 10.222.0.36 () {56 vars in 1374 bytes} [Fri Jun 24 22:25:31 2022] GET /identity/v3/role_assignments?user.id=2c5a7e7d1a0e4836808b16c2690ea655&scope.project.id=deb0943e980a41b2987f1c69584ddf73&role.id=1a1c43cc97a0407eb7a7c7a1333a9d4a => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:32.023681 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260b52c1-4e8b-4c7b-9a44-d0675c7f1aa5 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:32.039941 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:32.087199 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495b0410-6592-458f-a723-f8ab5f094db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:32.088055 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495b0410-6592-458f-a723-f8ab5f094db1 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:32.088339 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495b0410-6592-458f-a723-f8ab5f094db1 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:32.088621 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495b0410-6592-458f-a723-f8ab5f094db1 None admin] PATH_INFO: `/v3/projects/deb0943e980a41b2987f1c69584ddf73` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:32.096024 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495b0410-6592-458f-a723-f8ab5f094db1 None admin] RBAC: Authorizing `identity:get_project(project_id=deb0943e980a41b2987f1c69584ddf73)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:32.097607 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495b0410-6592-458f-a723-f8ab5f094db1 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:32.099649 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 106/205] 10.222.0.36 () {56 vars in 1186 bytes} [Fri Jun 24 22:25:31 2022] GET /identity/v3/projects/deb0943e980a41b2987f1c69584ddf73 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:32.105491 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495b0410-6592-458f-a723-f8ab5f094db1 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:32.133792 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:32.144940 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260b52c1-4e8b-4c7b-9a44-d0675c7f1aa5 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:32.188709 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db66276-e0e5-4d37-9cf9-94eff8240143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:32.189998 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db66276-e0e5-4d37-9cf9-94eff8240143 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:32.190471 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db66276-e0e5-4d37-9cf9-94eff8240143 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:32.190945 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db66276-e0e5-4d37-9cf9-94eff8240143 None admin] PATH_INFO: `/v3/projects/8130cc4553114edcaa7ac3278c906eed` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:32.194888 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db66276-e0e5-4d37-9cf9-94eff8240143 None admin] RBAC: Authorizing `identity:get_project(project_id=8130cc4553114edcaa7ac3278c906eed)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:32.198241 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db66276-e0e5-4d37-9cf9-94eff8240143 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:32.201660 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 100/206] 10.222.0.36 () {56 vars in 1186 bytes} [Fri Jun 24 22:25:32 2022] GET /identity/v3/projects/8130cc4553114edcaa7ac3278c906eed => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:32.212558 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db66276-e0e5-4d37-9cf9-94eff8240143 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:32.293597 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495b0410-6592-458f-a723-f8ab5f094db1 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:32.349051 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f829ad02-4863-4025-a047-abd552a45c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:32.350101 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f829ad02-4863-4025-a047-abd552a45c13 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:32.350661 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f829ad02-4863-4025-a047-abd552a45c13 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:32.351517 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f829ad02-4863-4025-a047-abd552a45c13 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:32.353233 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f829ad02-4863-4025-a047-abd552a45c13 None admin] RBAC: Adding query filter params (role.id=bf32f251a7764c7188fd782b65275038, scope.project.id=deb0943e980a41b2987f1c69584ddf73, user.id=2c5a7e7d1a0e4836808b16c2690ea655) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:25:32.353833 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f829ad02-4863-4025-a047-abd552a45c13 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:32.356110 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f829ad02-4863-4025-a047-abd552a45c13 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:32.362814 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 107/207] 10.222.0.36 () {56 vars in 1374 bytes} [Fri Jun 24 22:25:32 2022] GET /identity/v3/role_assignments?user.id=2c5a7e7d1a0e4836808b16c2690ea655&scope.project.id=deb0943e980a41b2987f1c69584ddf73&role.id=bf32f251a7764c7188fd782b65275038 => generated 259 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:32.364580 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45819d06-2783-4b40-89ba-985e68b655e1 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:32.365057 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45819d06-2783-4b40-89ba-985e68b655e1 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:32.365571 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45819d06-2783-4b40-89ba-985e68b655e1 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:32.367099 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 108/208] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:25:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:25:32.382095 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:32.382555 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a82c29c-1ea7-4fc8-8e17-d2d883d5d80d None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:32.383815 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a82c29c-1ea7-4fc8-8e17-d2d883d5d80d None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:32.384311 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a82c29c-1ea7-4fc8-8e17-d2d883d5d80d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:32.414904 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db66276-e0e5-4d37-9cf9-94eff8240143 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:32.428770 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-1a82c29c-1ea7-4fc8-8e17-d2d883d5d80d None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:25:32.430434 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-1a82c29c-1ea7-4fc8-8e17-d2d883d5d80d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:25:32.460785 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef8987c-9a48-4df5-b6fa-b9f0636d99b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:32.461971 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef8987c-9a48-4df5-b6fa-b9f0636d99b3 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:32.462541 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef8987c-9a48-4df5-b6fa-b9f0636d99b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:32.463284 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef8987c-9a48-4df5-b6fa-b9f0636d99b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:32.465183 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef8987c-9a48-4df5-b6fa-b9f0636d99b3 None admin] RBAC: Adding query filter params (role.id=c32d1d4e9658499ca095bd31a1fe816d, scope.project.id=8130cc4553114edcaa7ac3278c906eed, user.id=f4756b216ba34275bf794c01488ec866) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:25:32.465824 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef8987c-9a48-4df5-b6fa-b9f0636d99b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:32.468899 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef8987c-9a48-4df5-b6fa-b9f0636d99b3 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:32.481458 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 101/209] 10.222.0.36 () {56 vars in 1374 bytes} [Fri Jun 24 22:25:32 2022] GET /identity/v3/role_assignments?user.id=f4756b216ba34275bf794c01488ec866&scope.project.id=8130cc4553114edcaa7ac3278c906eed&role.id=c32d1d4e9658499ca095bd31a1fe816d => generated 608 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 22:25:32.483187 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf31d2e-6a03-41c5-b519-298262665dce None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:32.483553 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf31d2e-6a03-41c5-b519-298262665dce None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:32.483837 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf31d2e-6a03-41c5-b519-298262665dce None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:32.485412 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 102/210] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:25:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:25:32.505602 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1122fa-4fc9-4e64-8496-e05eafb2e7c1 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:32.506933 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1122fa-4fc9-4e64-8496-e05eafb2e7c1 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:32.507386 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1122fa-4fc9-4e64-8496-e05eafb2e7c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:32.534662 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-4b1122fa-4fc9-4e64-8496-e05eafb2e7c1 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:25:32.537352 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-4b1122fa-4fc9-4e64-8496-e05eafb2e7c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:25:32.632336 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 103/211] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:25:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 22:25:32.637552 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 109/212] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:25:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 22:25:32.657130 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1122fa-4fc9-4e64-8496-e05eafb2e7c1 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:32.696579 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a82c29c-1ea7-4fc8-8e17-d2d883d5d80d None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:32.718156 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:32.761367 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:32.800684 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1122fa-4fc9-4e64-8496-e05eafb2e7c1 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:32.838970 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a82c29c-1ea7-4fc8-8e17-d2d883d5d80d None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:32.842212 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e8d32f-186b-4d40-ad58-1d505769823c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:32.843112 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e8d32f-186b-4d40-ad58-1d505769823c None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:32.843494 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e8d32f-186b-4d40-ad58-1d505769823c None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:32.843841 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e8d32f-186b-4d40-ad58-1d505769823c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:32.859485 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e8d32f-186b-4d40-ad58-1d505769823c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 22:25:32.868697 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-b9e8d32f-186b-4d40-ad58-1d505769823c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 22:25:32.868697 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:25:32.868697 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:25:32.868697 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:25:32.868697 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:25:32.868697 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:25:32.868697 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:25:32.868697 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:25:32.868697 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:25:32.868697 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:25:32.868697 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:25:32.868697 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:25:32.868697 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 22:25:32.868697 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 22:25:32.868697 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 22:25:32.868697 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 22:25:32.869869 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 22:25:32.869869 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 22:25:32.869869 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 22:25:32.869869 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 22:25:32.869869 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:25:32.869869 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:25:32.869869 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:25:32.869869 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:25:32.869869 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:25:32.869869 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:25:32.869869 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:25:32.869869 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:25:32.869869 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:25:32.869869 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:25:32.869869 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:25:32.869869 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:25:32.870979 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:25:32.870979 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:25:32.870979 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:25:32.870979 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:25:32.870979 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 22:25:32.870979 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 22:25:32.870979 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 22:25:32.870979 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 22:25:32.870979 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 22:25:32.870979 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 22:25:32.870979 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 22:25:32.870979 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:25:32.873389 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 104/213] 10.222.0.36 () {56 vars in 1099 bytes} [Fri Jun 24 22:25:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:25:32.879194 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e8d32f-186b-4d40-ad58-1d505769823c None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:32.885348 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cbb812-0f47-4a5a-9dd9-7827c34306b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:32.886489 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cbb812-0f47-4a5a-9dd9-7827c34306b7 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:32.886980 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cbb812-0f47-4a5a-9dd9-7827c34306b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:32.887478 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cbb812-0f47-4a5a-9dd9-7827c34306b7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:32.888952 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cbb812-0f47-4a5a-9dd9-7827c34306b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:32.890660 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cbb812-0f47-4a5a-9dd9-7827c34306b7 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:32.892983 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 110/214] 10.222.0.36 () {56 vars in 1108 bytes} [Fri Jun 24 22:25:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:32.898593 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cbb812-0f47-4a5a-9dd9-7827c34306b7 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:33.005568 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e8d32f-186b-4d40-ad58-1d505769823c None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:33.049639 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c705baf6-1f4b-4d41-961f-cac751508a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:33.049639 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c705baf6-1f4b-4d41-961f-cac751508a73 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:33.049639 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c705baf6-1f4b-4d41-961f-cac751508a73 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:33.049639 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c705baf6-1f4b-4d41-961f-cac751508a73 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:33.050044 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c705baf6-1f4b-4d41-961f-cac751508a73 None admin] RBAC: Adding query filter params (name=member) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:25:33.050044 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c705baf6-1f4b-4d41-961f-cac751508a73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:33.052219 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c705baf6-1f4b-4d41-961f-cac751508a73 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:33.055854 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:33.058432 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:33.068579 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 105/215] 10.222.0.36 () {56 vars in 1101 bytes} [Fri Jun 24 22:25:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:33.077381 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c705baf6-1f4b-4d41-961f-cac751508a73 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:33.093014 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cbb812-0f47-4a5a-9dd9-7827c34306b7 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:33.143726 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd50331-9112-497e-9c61-b6961ad2b80c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:33.145005 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd50331-9112-497e-9c61-b6961ad2b80c None admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:33.145839 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd50331-9112-497e-9c61-b6961ad2b80c None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:33.146403 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd50331-9112-497e-9c61-b6961ad2b80c None admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:33.147563 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd50331-9112-497e-9c61-b6961ad2b80c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:33.150660 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd50331-9112-497e-9c61-b6961ad2b80c None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:33.182607 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 111/216] 10.222.0.36 () {60 vars in 1132 bytes} [Fri Jun 24 22:25:32 2022] POST /identity/v3/users => generated 297 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:25:33.214987 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c705baf6-1f4b-4d41-961f-cac751508a73 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:33.257148 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5df921-f1a9-4ba3-9da4-1910b8719277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:33.258486 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5df921-f1a9-4ba3-9da4-1910b8719277 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:33.258957 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5df921-f1a9-4ba3-9da4-1910b8719277 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:33.259444 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5df921-f1a9-4ba3-9da4-1910b8719277 None admin] PATH_INFO: `/v3/users/418751f793f8460fbe788b798407b9be` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:33.277364 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5df921-f1a9-4ba3-9da4-1910b8719277 None admin] RBAC: Authorizing `identity:get_user(user_id=418751f793f8460fbe788b798407b9be)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:33.279308 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5df921-f1a9-4ba3-9da4-1910b8719277 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:33.281872 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 106/217] 10.222.0.36 () {56 vars in 1177 bytes} [Fri Jun 24 22:25:33 2022] GET /identity/v3/users/418751f793f8460fbe788b798407b9be => generated 297 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 22:25:33.288453 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd50331-9112-497e-9c61-b6961ad2b80c None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:33.404474 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd50331-9112-497e-9c61-b6961ad2b80c None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:33.442687 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362bf06d-b59e-443f-bac8-04ceba5fcbc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:33.443390 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362bf06d-b59e-443f-bac8-04ceba5fcbc9 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:33.443678 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362bf06d-b59e-443f-bac8-04ceba5fcbc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:33.443957 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362bf06d-b59e-443f-bac8-04ceba5fcbc9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:33.449278 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:33.526711 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362bf06d-b59e-443f-bac8-04ceba5fcbc9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:33.528238 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362bf06d-b59e-443f-bac8-04ceba5fcbc9 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:33.639873 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 112/218] 10.222.0.36 () {58 vars in 1282 bytes} [Fri Jun 24 22:25:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 22:25:33.646084 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5df921-f1a9-4ba3-9da4-1910b8719277 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:33.712993 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:33.782626 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5df921-f1a9-4ba3-9da4-1910b8719277 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:33.824839 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb145fc-88c9-41ed-90b3-49890fc20242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:33.825743 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb145fc-88c9-41ed-90b3-49890fc20242 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:33.826027 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb145fc-88c9-41ed-90b3-49890fc20242 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:33.826300 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb145fc-88c9-41ed-90b3-49890fc20242 None admin] PATH_INFO: `/v3/projects/deb0943e980a41b2987f1c69584ddf73` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:33.827635 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb145fc-88c9-41ed-90b3-49890fc20242 None admin] RBAC: Authorizing `identity:get_project(project_id=deb0943e980a41b2987f1c69584ddf73)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:33.829126 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb145fc-88c9-41ed-90b3-49890fc20242 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:33.831084 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 107/219] 10.222.0.36 () {56 vars in 1186 bytes} [Fri Jun 24 22:25:33 2022] GET /identity/v3/projects/deb0943e980a41b2987f1c69584ddf73 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:33.837247 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362bf06d-b59e-443f-bac8-04ceba5fcbc9 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:33.874311 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:33.948360 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362bf06d-b59e-443f-bac8-04ceba5fcbc9 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:33.983578 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5f7925-44d3-42cd-a2e3-ccb70fd476a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:33.984169 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f7925-44d3-42cd-a2e3-ccb70fd476a0 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:33.984453 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f7925-44d3-42cd-a2e3-ccb70fd476a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:33.984795 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f7925-44d3-42cd-a2e3-ccb70fd476a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:33.985646 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5f7925-44d3-42cd-a2e3-ccb70fd476a0 None admin] RBAC: Adding query filter params (role.id=1928787bfcc745419829cd315900ac44, scope.project.id=deb0943e980a41b2987f1c69584ddf73, user.id=418751f793f8460fbe788b798407b9be) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:25:33.986009 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5f7925-44d3-42cd-a2e3-ccb70fd476a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:33.987504 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5f7925-44d3-42cd-a2e3-ccb70fd476a0 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:33.993202 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 113/220] 10.222.0.36 () {56 vars in 1374 bytes} [Fri Jun 24 22:25:33 2022] GET /identity/v3/role_assignments?user.id=418751f793f8460fbe788b798407b9be&scope.project.id=deb0943e980a41b2987f1c69584ddf73&role.id=1928787bfcc745419829cd315900ac44 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:34.784944 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a68647e-d266-4036-821c-a08f208d6ee4 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:34.785464 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a68647e-d266-4036-821c-a08f208d6ee4 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:34.785464 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a68647e-d266-4036-821c-a08f208d6ee4 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:34.787050 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 108/221] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:25:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:25:34.800792 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0484cc31-ceee-4437-a8c0-38d7b7f10e3b None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:34.801269 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0484cc31-ceee-4437-a8c0-38d7b7f10e3b None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:34.801367 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0484cc31-ceee-4437-a8c0-38d7b7f10e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:34.818524 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-0484cc31-ceee-4437-a8c0-38d7b7f10e3b None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:25:34.823800 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-0484cc31-ceee-4437-a8c0-38d7b7f10e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:25:34.844374 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd8aa34-8fc6-434e-a79b-276f9310655e None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:34.844657 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd8aa34-8fc6-434e-a79b-276f9310655e None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:34.844928 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd8aa34-8fc6-434e-a79b-276f9310655e None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:34.847079 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 109/222] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:25:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:25:34.860696 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba878ff6-9213-49ae-815c-c2c0e95a400b None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:34.861009 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba878ff6-9213-49ae-815c-c2c0e95a400b None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:34.861416 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba878ff6-9213-49ae-815c-c2c0e95a400b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:34.900223 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-ba878ff6-9213-49ae-815c-c2c0e95a400b None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:25:34.901459 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-ba878ff6-9213-49ae-815c-c2c0e95a400b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:25:34.925582 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 114/223] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:25:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 22:25:34.947293 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0484cc31-ceee-4437-a8c0-38d7b7f10e3b None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:34.976864 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:35.047172 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 110/224] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:25:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 22:25:35.055797 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0484cc31-ceee-4437-a8c0-38d7b7f10e3b None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:35.083636 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba878ff6-9213-49ae-815c-c2c0e95a400b None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:35.098663 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1227de-f8b0-48d4-b3ed-d18ae8256737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:35.099781 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1227de-f8b0-48d4-b3ed-d18ae8256737 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:35.100263 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1227de-f8b0-48d4-b3ed-d18ae8256737 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:35.100700 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1227de-f8b0-48d4-b3ed-d18ae8256737 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:35.112396 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1227de-f8b0-48d4-b3ed-d18ae8256737 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 22:25:35.120660 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-6f1227de-f8b0-48d4-b3ed-d18ae8256737 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 22:25:35.120660 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:25:35.120660 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:25:35.120660 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:25:35.120660 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:25:35.120660 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:25:35.120660 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:25:35.120660 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:25:35.120660 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:25:35.120660 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:25:35.120660 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:25:35.120660 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:25:35.120660 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 22:25:35.120660 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 22:25:35.120660 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 22:25:35.120660 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 22:25:35.121512 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 22:25:35.121512 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 22:25:35.121512 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 22:25:35.121512 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 22:25:35.121512 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:25:35.121512 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:25:35.121512 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:25:35.121512 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:25:35.121512 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:25:35.121512 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:25:35.121512 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:25:35.121512 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:25:35.121512 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:25:35.121512 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:25:35.121512 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:25:35.121512 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:25:35.122274 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:25:35.122274 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:25:35.122274 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:25:35.122274 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:25:35.122274 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 22:25:35.122274 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 22:25:35.122274 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 22:25:35.122274 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 22:25:35.122274 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 22:25:35.122274 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 22:25:35.122274 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 22:25:35.122274 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:25:35.124942 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 115/225] 10.222.0.36 () {56 vars in 1096 bytes} [Fri Jun 24 22:25:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:25:35.130410 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1227de-f8b0-48d4-b3ed-d18ae8256737 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:35.179536 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:35.254187 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:35.270988 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba878ff6-9213-49ae-815c-c2c0e95a400b None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:35.285145 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1227de-f8b0-48d4-b3ed-d18ae8256737 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:35.310927 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07878fa-0fd5-4035-8aa7-9470a3642e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:35.311792 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07878fa-0fd5-4035-8aa7-9470a3642e64 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:35.312022 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07878fa-0fd5-4035-8aa7-9470a3642e64 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:35.312305 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07878fa-0fd5-4035-8aa7-9470a3642e64 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:35.336086 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18650ef-bd4e-49d4-b8db-65bd2573c728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:35.337135 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18650ef-bd4e-49d4-b8db-65bd2573c728 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:35.338421 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18650ef-bd4e-49d4-b8db-65bd2573c728 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:35.339835 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18650ef-bd4e-49d4-b8db-65bd2573c728 None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:35.340798 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18650ef-bd4e-49d4-b8db-65bd2573c728 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:25:35.341823 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07878fa-0fd5-4035-8aa7-9470a3642e64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 22:25:35.342344 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18650ef-bd4e-49d4-b8db-65bd2573c728 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:35.343996 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18650ef-bd4e-49d4-b8db-65bd2573c728 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:35.358169 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-e07878fa-0fd5-4035-8aa7-9470a3642e64 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 22:25:35.358169 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:25:35.358169 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:25:35.358169 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:25:35.358169 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:25:35.358169 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:25:35.358169 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:25:35.358169 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:25:35.358169 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:25:35.358169 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:25:35.358169 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:25:35.358169 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:25:35.358169 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 22:25:35.358169 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 22:25:35.358169 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 22:25:35.358169 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 22:25:35.359056 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 22:25:35.359056 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 22:25:35.359056 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 22:25:35.359056 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 22:25:35.359056 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:25:35.359056 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:25:35.359056 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:25:35.359056 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:25:35.359056 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:25:35.359056 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:25:35.359056 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:25:35.359056 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:25:35.359056 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:25:35.359056 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:25:35.359056 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:25:35.359056 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:25:35.359857 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:25:35.359857 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:25:35.359857 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:25:35.359857 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:25:35.359857 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 22:25:35.359857 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 22:25:35.359857 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 22:25:35.359857 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 22:25:35.359857 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 22:25:35.359857 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 22:25:35.359857 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 22:25:35.359857 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:25:35.365193 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 111/226] 10.222.0.36 () {56 vars in 1114 bytes} [Fri Jun 24 22:25:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:25:35.366462 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 116/227] 10.222.0.36 () {56 vars in 1099 bytes} [Fri Jun 24 22:25:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:35.372221 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07878fa-0fd5-4035-8aa7-9470a3642e64 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:35.373009 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18650ef-bd4e-49d4-b8db-65bd2573c728 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:35.534515 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18650ef-bd4e-49d4-b8db-65bd2573c728 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:35.547186 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07878fa-0fd5-4035-8aa7-9470a3642e64 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:35.563061 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:35.598507 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4e659d-7181-4ad7-b5f7-b104f333324f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:35.599814 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e659d-7181-4ad7-b5f7-b104f333324f None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:35.599814 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e659d-7181-4ad7-b5f7-b104f333324f None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:35.600365 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e659d-7181-4ad7-b5f7-b104f333324f None admin] PATH_INFO: `/v3/users/2c5a7e7d1a0e4836808b16c2690ea655` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:35.601523 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4164671c-2654-4823-8b97-33e9c222ad37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:35.602207 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4164671c-2654-4823-8b97-33e9c222ad37 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:35.602487 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4164671c-2654-4823-8b97-33e9c222ad37 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:35.602763 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4164671c-2654-4823-8b97-33e9c222ad37 None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:35.603699 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4164671c-2654-4823-8b97-33e9c222ad37 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:25:35.604015 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4164671c-2654-4823-8b97-33e9c222ad37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:35.605451 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4164671c-2654-4823-8b97-33e9c222ad37 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:35.616585 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4e659d-7181-4ad7-b5f7-b104f333324f None admin] RBAC: Authorizing `identity:get_user(user_id=2c5a7e7d1a0e4836808b16c2690ea655)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:35.618136 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4e659d-7181-4ad7-b5f7-b104f333324f None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:35.620143 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 112/228] 10.222.0.36 () {56 vars in 1177 bytes} [Fri Jun 24 22:25:35 2022] GET /identity/v3/users/2c5a7e7d1a0e4836808b16c2690ea655 => generated 283 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:35.628655 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4e659d-7181-4ad7-b5f7-b104f333324f None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:35.643195 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 117/229] 10.222.0.36 () {56 vars in 1111 bytes} [Fri Jun 24 22:25:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:35.652275 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4164671c-2654-4823-8b97-33e9c222ad37 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:35.683693 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:35.766142 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4164671c-2654-4823-8b97-33e9c222ad37 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:35.844797 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7368dc19-5562-4a9d-8779-7e2af31048ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:35.845490 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7368dc19-5562-4a9d-8779-7e2af31048ff None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:35.845490 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7368dc19-5562-4a9d-8779-7e2af31048ff None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:35.845702 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7368dc19-5562-4a9d-8779-7e2af31048ff None admin] PATH_INFO: `/v3/users/2c5a7e7d1a0e4836808b16c2690ea655` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:35.846864 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7368dc19-5562-4a9d-8779-7e2af31048ff None admin] RBAC: Authorizing `identity:get_user(user_id=2c5a7e7d1a0e4836808b16c2690ea655)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:35.848720 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7368dc19-5562-4a9d-8779-7e2af31048ff None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:35.855463 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 118/230] 10.222.0.36 () {56 vars in 1177 bytes} [Fri Jun 24 22:25:35 2022] GET /identity/v3/users/2c5a7e7d1a0e4836808b16c2690ea655 => generated 283 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:35.857194 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e900904d-608e-476c-8b3f-0c3efe3d6764 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:35.857828 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e900904d-608e-476c-8b3f-0c3efe3d6764 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:35.859647 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e900904d-608e-476c-8b3f-0c3efe3d6764 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:35.860246 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4e659d-7181-4ad7-b5f7-b104f333324f None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:35.861511 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 119/231] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:25:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:25:35.867186 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e900904d-608e-476c-8b3f-0c3efe3d6764 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:35.909505 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da965f82-ab9b-4dd0-8864-5569f1e4709b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:35.910768 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da965f82-ab9b-4dd0-8864-5569f1e4709b None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:35.911293 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da965f82-ab9b-4dd0-8864-5569f1e4709b None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:35.911782 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da965f82-ab9b-4dd0-8864-5569f1e4709b None admin] PATH_INFO: `/v3/projects/deb0943e980a41b2987f1c69584ddf73` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:35.913290 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da965f82-ab9b-4dd0-8864-5569f1e4709b None admin] RBAC: Authorizing `identity:get_project(project_id=deb0943e980a41b2987f1c69584ddf73)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:35.915076 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da965f82-ab9b-4dd0-8864-5569f1e4709b None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:35.917642 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 113/232] 10.222.0.36 () {56 vars in 1186 bytes} [Fri Jun 24 22:25:35 2022] GET /identity/v3/projects/deb0943e980a41b2987f1c69584ddf73 => generated 302 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 22:25:35.919388 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2d074d-5873-44fb-b499-f77868bfd7f1 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:35.920003 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2d074d-5873-44fb-b499-f77868bfd7f1 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:35.920471 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2d074d-5873-44fb-b499-f77868bfd7f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:35.938034 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-cf2d074d-5873-44fb-b499-f77868bfd7f1 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:25:35.939293 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-cf2d074d-5873-44fb-b499-f77868bfd7f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:25:35.970073 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:35.987480 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:36.005179 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e900904d-608e-476c-8b3f-0c3efe3d6764 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:36.019274 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 114/233] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:25:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 22:25:36.019274 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2d074d-5873-44fb-b499-f77868bfd7f1 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:36.072080 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e132d80-2f1b-498e-8269-e74e2220efd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:36.073765 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e132d80-2f1b-498e-8269-e74e2220efd1 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:36.074248 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e132d80-2f1b-498e-8269-e74e2220efd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:36.074960 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e132d80-2f1b-498e-8269-e74e2220efd1 None admin] PATH_INFO: `/v3/projects/deb0943e980a41b2987f1c69584ddf73` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:36.077160 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e132d80-2f1b-498e-8269-e74e2220efd1 None admin] RBAC: Authorizing `identity:get_project(project_id=deb0943e980a41b2987f1c69584ddf73)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:36.079105 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e132d80-2f1b-498e-8269-e74e2220efd1 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:36.081771 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 120/234] 10.222.0.36 () {56 vars in 1186 bytes} [Fri Jun 24 22:25:35 2022] GET /identity/v3/projects/deb0943e980a41b2987f1c69584ddf73 => generated 302 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:36.082766 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e132d80-2f1b-498e-8269-e74e2220efd1 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:36.163241 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2d074d-5873-44fb-b499-f77868bfd7f1 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:36.218373 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e132d80-2f1b-498e-8269-e74e2220efd1 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:36.228446 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c21154-eb53-42d0-bf33-ec2f0f54f87c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:36.230154 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c21154-eb53-42d0-bf33-ec2f0f54f87c None admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:36.230913 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c21154-eb53-42d0-bf33-ec2f0f54f87c None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:36.231423 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c21154-eb53-42d0-bf33-ec2f0f54f87c None admin] PATH_INFO: `/v3/projects/deb0943e980a41b2987f1c69584ddf73/users/2c5a7e7d1a0e4836808b16c2690ea655/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:36.234755 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c21154-eb53-42d0-bf33-ec2f0f54f87c None admin] RBAC: Authorizing `identity:create_grant(project_id=deb0943e980a41b2987f1c69584ddf73, user_id=2c5a7e7d1a0e4836808b16c2690ea655, role_id=1a1c43cc97a0407eb7a7c7a1333a9d4a)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:36.237154 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c21154-eb53-42d0-bf33-ec2f0f54f87c None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:36.257346 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 115/235] 10.222.0.36 () {58 vars in 1439 bytes} [Fri Jun 24 22:25:36 2022] PUT /identity/v3/projects/deb0943e980a41b2987f1c69584ddf73/users/2c5a7e7d1a0e4836808b16c2690ea655/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:25:36.263404 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aad2fc-216b-40da-85f4-8eae9e0a0c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:36.263404 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aad2fc-216b-40da-85f4-8eae9e0a0c5b None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:36.263404 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aad2fc-216b-40da-85f4-8eae9e0a0c5b None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:36.263404 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aad2fc-216b-40da-85f4-8eae9e0a0c5b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:36.264964 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c21154-eb53-42d0-bf33-ec2f0f54f87c None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:36.276455 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aad2fc-216b-40da-85f4-8eae9e0a0c5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 22:25:36.286735 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-11aad2fc-216b-40da-85f4-8eae9e0a0c5b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 22:25:36.286735 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:25:36.286735 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:25:36.286735 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:25:36.286735 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:25:36.286735 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:25:36.286735 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:25:36.286735 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:25:36.286735 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:25:36.286735 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:25:36.286735 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:25:36.286735 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:25:36.286735 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 22:25:36.286735 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 22:25:36.286735 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 22:25:36.286735 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 22:25:36.287733 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 22:25:36.287733 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 22:25:36.287733 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 22:25:36.287733 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 22:25:36.287733 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:25:36.287733 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:25:36.287733 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:25:36.287733 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:25:36.287733 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:25:36.287733 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:25:36.287733 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:25:36.287733 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:25:36.287733 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:25:36.287733 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:25:36.287733 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:25:36.287733 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:25:36.288643 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:25:36.288643 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:25:36.288643 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:25:36.288643 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:25:36.288643 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 22:25:36.288643 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 22:25:36.288643 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 22:25:36.288643 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 22:25:36.288643 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 22:25:36.288643 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 22:25:36.288643 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 22:25:36.288643 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:25:36.288643 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 121/236] 10.222.0.36 () {56 vars in 1099 bytes} [Fri Jun 24 22:25:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:25:36.290240 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af53405-99c5-4e99-8a3a-90e87877b858 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:36.290564 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af53405-99c5-4e99-8a3a-90e87877b858 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:36.291137 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af53405-99c5-4e99-8a3a-90e87877b858 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:36.292619 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 122/237] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:25:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:25:36.297950 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af53405-99c5-4e99-8a3a-90e87877b858 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:36.312389 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:36.352389 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:36.465343 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c21154-eb53-42d0-bf33-ec2f0f54f87c None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:36.469972 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af53405-99c5-4e99-8a3a-90e87877b858 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:36.506833 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32bc1ce-78a5-40fe-b7a9-542bebf8fb53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:36.507825 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32bc1ce-78a5-40fe-b7a9-542bebf8fb53 None admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:36.508106 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32bc1ce-78a5-40fe-b7a9-542bebf8fb53 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:36.508384 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32bc1ce-78a5-40fe-b7a9-542bebf8fb53 None admin] PATH_INFO: `/v3/projects/deb0943e980a41b2987f1c69584ddf73/users/2c5a7e7d1a0e4836808b16c2690ea655/roles/bf32f251a7764c7188fd782b65275038` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:36.510917 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32bc1ce-78a5-40fe-b7a9-542bebf8fb53 None admin] RBAC: Authorizing `identity:create_grant(project_id=deb0943e980a41b2987f1c69584ddf73, user_id=2c5a7e7d1a0e4836808b16c2690ea655, role_id=bf32f251a7764c7188fd782b65275038)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:36.512579 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32bc1ce-78a5-40fe-b7a9-542bebf8fb53 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:36.513927 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7fc8ab-f681-44d7-b45e-d71f481ac630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:36.514794 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7fc8ab-f681-44d7-b45e-d71f481ac630 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:36.515241 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7fc8ab-f681-44d7-b45e-d71f481ac630 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:36.515735 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7fc8ab-f681-44d7-b45e-d71f481ac630 None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:36.516571 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7fc8ab-f681-44d7-b45e-d71f481ac630 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:25:36.517008 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7fc8ab-f681-44d7-b45e-d71f481ac630 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:36.518611 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7fc8ab-f681-44d7-b45e-d71f481ac630 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:36.528067 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 116/238] 10.222.0.36 () {58 vars in 1439 bytes} [Fri Jun 24 22:25:36 2022] PUT /identity/v3/projects/deb0943e980a41b2987f1c69584ddf73/users/2c5a7e7d1a0e4836808b16c2690ea655/roles/bf32f251a7764c7188fd782b65275038 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:25:36.529069 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3ce3b2-3516-478c-867e-2736ec91c97b None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:36.529369 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3ce3b2-3516-478c-867e-2736ec91c97b None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:36.529639 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3ce3b2-3516-478c-867e-2736ec91c97b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:36.539568 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 123/239] 10.222.0.36 () {56 vars in 1101 bytes} [Fri Jun 24 22:25:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:36.539568 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1c7a8e-626d-49b7-acf6-3cc7cc534b66 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:36.539568 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1c7a8e-626d-49b7-acf6-3cc7cc534b66 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:36.539568 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1c7a8e-626d-49b7-acf6-3cc7cc534b66 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:36.541161 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 124/240] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:25:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:25:36.542962 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1c7a8e-626d-49b7-acf6-3cc7cc534b66 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:36.551883 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-1a3ce3b2-3516-478c-867e-2736ec91c97b None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:25:36.553129 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-1a3ce3b2-3516-478c-867e-2736ec91c97b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:25:36.632380 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 117/241] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:25:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 22:25:36.633639 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abff565-6bd3-4844-a37a-8af8ef634c28 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:36.633931 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abff565-6bd3-4844-a37a-8af8ef634c28 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:36.634205 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abff565-6bd3-4844-a37a-8af8ef634c28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:36.652108 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:36.656149 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-5abff565-6bd3-4844-a37a-8af8ef634c28 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:25:36.657578 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-5abff565-6bd3-4844-a37a-8af8ef634c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:25:36.697031 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:36.707126 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1c7a8e-626d-49b7-acf6-3cc7cc534b66 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:36.752415 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6860a3f-e06a-4a7c-83f1-507e1843c62d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:36.753297 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6860a3f-e06a-4a7c-83f1-507e1843c62d None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:36.753575 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6860a3f-e06a-4a7c-83f1-507e1843c62d None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:36.753848 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6860a3f-e06a-4a7c-83f1-507e1843c62d None admin] PATH_INFO: `/v3/users/5adbeb93775747b5ae3fe33781605b3c` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:36.755652 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 118/242] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:25:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 22:25:36.757093 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abff565-6bd3-4844-a37a-8af8ef634c28 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:36.781068 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6860a3f-e06a-4a7c-83f1-507e1843c62d None admin] RBAC: Authorizing `identity:get_user(user_id=5adbeb93775747b5ae3fe33781605b3c)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:36.782956 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6860a3f-e06a-4a7c-83f1-507e1843c62d None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:36.786489 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 125/243] 10.222.0.36 () {56 vars in 1177 bytes} [Fri Jun 24 22:25:36 2022] GET /identity/v3/users/5adbeb93775747b5ae3fe33781605b3c => generated 297 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 22:25:36.787633 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6860a3f-e06a-4a7c-83f1-507e1843c62d None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:36.899899 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abff565-6bd3-4844-a37a-8af8ef634c28 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:36.932795 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6860a3f-e06a-4a7c-83f1-507e1843c62d None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:36.940498 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65547070-7d4e-4ecf-a25c-5b712b2127b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:36.941335 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65547070-7d4e-4ecf-a25c-5b712b2127b6 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:36.941676 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65547070-7d4e-4ecf-a25c-5b712b2127b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:36.941951 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65547070-7d4e-4ecf-a25c-5b712b2127b6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:36.943199 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65547070-7d4e-4ecf-a25c-5b712b2127b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:36.944755 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65547070-7d4e-4ecf-a25c-5b712b2127b6 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:36.951529 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 119/244] 10.222.0.36 () {56 vars in 1108 bytes} [Fri Jun 24 22:25:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:36.952379 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65547070-7d4e-4ecf-a25c-5b712b2127b6 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:36.969844 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:36.984354 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb780a5-11d8-463e-ab64-6c6e8fa39818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:36.986254 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:36.987591 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb780a5-11d8-463e-ab64-6c6e8fa39818 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:36.987972 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb780a5-11d8-463e-ab64-6c6e8fa39818 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:36.988612 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb780a5-11d8-463e-ab64-6c6e8fa39818 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:37.006557 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb780a5-11d8-463e-ab64-6c6e8fa39818 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 22:25:37.016528 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-0cb780a5-11d8-463e-ab64-6c6e8fa39818 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 22:25:37.016528 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:25:37.016528 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:25:37.016528 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:25:37.016528 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:25:37.016528 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:25:37.016528 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:25:37.016528 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:25:37.016528 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:25:37.016528 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:25:37.016528 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:25:37.016528 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:25:37.016528 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 22:25:37.016528 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 22:25:37.016528 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 22:25:37.016528 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 22:25:37.017428 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 22:25:37.017428 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 22:25:37.017428 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 22:25:37.017428 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 22:25:37.017428 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:25:37.017428 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:25:37.017428 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:25:37.017428 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:25:37.017428 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:25:37.017428 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:25:37.017428 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:25:37.017428 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:25:37.017428 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:25:37.017428 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:25:37.017428 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:25:37.017428 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:25:37.018181 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:25:37.018181 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:25:37.018181 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:25:37.018181 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:25:37.018181 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 22:25:37.018181 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 22:25:37.018181 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 22:25:37.018181 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 22:25:37.018181 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 22:25:37.018181 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 22:25:37.018181 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 22:25:37.018181 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:25:37.024337 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 126/245] 10.222.0.36 () {56 vars in 1099 bytes} [Fri Jun 24 22:25:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:25:37.024337 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb780a5-11d8-463e-ab64-6c6e8fa39818 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:37.109553 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65547070-7d4e-4ecf-a25c-5b712b2127b6 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:37.153644 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb780a5-11d8-463e-ab64-6c6e8fa39818 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:37.153939 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3b80c2-f84b-401e-8874-527ed3152a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:37.154673 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3b80c2-f84b-401e-8874-527ed3152a24 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:37.155037 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3b80c2-f84b-401e-8874-527ed3152a24 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:37.155399 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3b80c2-f84b-401e-8874-527ed3152a24 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:37.198491 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929ed69a-dfb1-456b-a8dc-f9765f049421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:37.199996 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ed69a-dfb1-456b-a8dc-f9765f049421 None admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:37.200464 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ed69a-dfb1-456b-a8dc-f9765f049421 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:37.200917 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ed69a-dfb1-456b-a8dc-f9765f049421 None admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:37.202323 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929ed69a-dfb1-456b-a8dc-f9765f049421 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:37.204654 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929ed69a-dfb1-456b-a8dc-f9765f049421 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:37.230995 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3b80c2-f84b-401e-8874-527ed3152a24 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:37.232255 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 127/246] 10.222.0.36 () {60 vars in 1132 bytes} [Fri Jun 24 22:25:37 2022] POST /identity/v3/users => generated 293 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:25:37.232682 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3b80c2-f84b-401e-8874-527ed3152a24 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:37.233481 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929ed69a-dfb1-456b-a8dc-f9765f049421 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:37.264552 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:37.298721 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:37.402704 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 120/247] 10.222.0.36 () {58 vars in 1282 bytes} [Fri Jun 24 22:25:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 22:25:37.411024 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3b80c2-f84b-401e-8874-527ed3152a24 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:37.427600 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929ed69a-dfb1-456b-a8dc-f9765f049421 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:37.475363 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e214d1b-dbae-4d30-8219-0af71eca60df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:37.475789 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e214d1b-dbae-4d30-8219-0af71eca60df None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:37.476078 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e214d1b-dbae-4d30-8219-0af71eca60df None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:37.476357 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e214d1b-dbae-4d30-8219-0af71eca60df None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:37.477132 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e214d1b-dbae-4d30-8219-0af71eca60df None admin] RBAC: Adding query filter params (name=member) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:25:37.477445 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e214d1b-dbae-4d30-8219-0af71eca60df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:37.479129 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e214d1b-dbae-4d30-8219-0af71eca60df None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:37.499974 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 128/248] 10.222.0.36 () {56 vars in 1101 bytes} [Fri Jun 24 22:25:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:37.506864 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e214d1b-dbae-4d30-8219-0af71eca60df None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:37.564121 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3b80c2-f84b-401e-8874-527ed3152a24 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:37.596482 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:37.607229 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf3f431-d6ed-4eb9-b909-c8f3b3b6abe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:37.608510 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf3f431-d6ed-4eb9-b909-c8f3b3b6abe6 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:37.608960 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf3f431-d6ed-4eb9-b909-c8f3b3b6abe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:37.609447 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf3f431-d6ed-4eb9-b909-c8f3b3b6abe6 None admin] PATH_INFO: `/v3/projects/deb0943e980a41b2987f1c69584ddf73` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:37.610949 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf3f431-d6ed-4eb9-b909-c8f3b3b6abe6 None admin] RBAC: Authorizing `identity:get_project(project_id=deb0943e980a41b2987f1c69584ddf73)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:37.612632 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf3f431-d6ed-4eb9-b909-c8f3b3b6abe6 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:37.613296 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e214d1b-dbae-4d30-8219-0af71eca60df None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:37.614838 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 121/249] 10.222.0.36 () {56 vars in 1186 bytes} [Fri Jun 24 22:25:37 2022] GET /identity/v3/projects/deb0943e980a41b2987f1c69584ddf73 => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:37.621137 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:37.622972 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf3f431-d6ed-4eb9-b909-c8f3b3b6abe6 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:37.648264 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce17fc2-74b5-4652-831d-1ff32a253675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:37.649160 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce17fc2-74b5-4652-831d-1ff32a253675 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:37.649445 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce17fc2-74b5-4652-831d-1ff32a253675 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:37.649722 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce17fc2-74b5-4652-831d-1ff32a253675 None admin] PATH_INFO: `/v3/users/418751f793f8460fbe788b798407b9be` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:37.651082 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce17fc2-74b5-4652-831d-1ff32a253675 None admin] RBAC: Authorizing `identity:get_user(user_id=418751f793f8460fbe788b798407b9be)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:37.653205 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce17fc2-74b5-4652-831d-1ff32a253675 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:37.655290 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 129/250] 10.222.0.36 () {56 vars in 1177 bytes} [Fri Jun 24 22:25:37 2022] GET /identity/v3/users/418751f793f8460fbe788b798407b9be => generated 297 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 22:25:37.661729 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce17fc2-74b5-4652-831d-1ff32a253675 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:37.736612 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf3f431-d6ed-4eb9-b909-c8f3b3b6abe6 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:37.771292 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce17fc2-74b5-4652-831d-1ff32a253675 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:37.775848 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1c3764-0466-441e-93f7-15b9385b9df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:37.777285 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1c3764-0466-441e-93f7-15b9385b9df9 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:37.777984 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1c3764-0466-441e-93f7-15b9385b9df9 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:37.778681 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1c3764-0466-441e-93f7-15b9385b9df9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:37.780148 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1c3764-0466-441e-93f7-15b9385b9df9 None admin] RBAC: Adding query filter params (role.id=c32d1d4e9658499ca095bd31a1fe816d, scope.project.id=deb0943e980a41b2987f1c69584ddf73, user.id=5adbeb93775747b5ae3fe33781605b3c) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:25:37.780659 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1c3764-0466-441e-93f7-15b9385b9df9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:37.782348 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1c3764-0466-441e-93f7-15b9385b9df9 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:37.788819 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 122/251] 10.222.0.36 () {56 vars in 1374 bytes} [Fri Jun 24 22:25:37 2022] GET /identity/v3/role_assignments?user.id=5adbeb93775747b5ae3fe33781605b3c&scope.project.id=deb0943e980a41b2987f1c69584ddf73&role.id=c32d1d4e9658499ca095bd31a1fe816d => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:37.816483 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4d63b2-cf51-4119-9568-363673011bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:37.817419 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4d63b2-cf51-4119-9568-363673011bb0 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:37.817699 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4d63b2-cf51-4119-9568-363673011bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:37.817972 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4d63b2-cf51-4119-9568-363673011bb0 None admin] PATH_INFO: `/v3/projects/deb0943e980a41b2987f1c69584ddf73` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:37.819277 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4d63b2-cf51-4119-9568-363673011bb0 None admin] RBAC: Authorizing `identity:get_project(project_id=deb0943e980a41b2987f1c69584ddf73)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:37.820821 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4d63b2-cf51-4119-9568-363673011bb0 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:37.823056 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 130/252] 10.222.0.36 () {56 vars in 1186 bytes} [Fri Jun 24 22:25:37 2022] GET /identity/v3/projects/deb0943e980a41b2987f1c69584ddf73 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 22:25:37.829006 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1c3764-0466-441e-93f7-15b9385b9df9 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:37.909457 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:37.961350 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1c3764-0466-441e-93f7-15b9385b9df9 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:38.006464 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4306303-ab7a-42db-9e27-ec82d9133099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:38.007547 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4306303-ab7a-42db-9e27-ec82d9133099 None admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:38.007828 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4306303-ab7a-42db-9e27-ec82d9133099 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:38.008100 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4306303-ab7a-42db-9e27-ec82d9133099 None admin] PATH_INFO: `/v3/projects/deb0943e980a41b2987f1c69584ddf73/users/418751f793f8460fbe788b798407b9be/roles/1928787bfcc745419829cd315900ac44` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:38.010238 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4306303-ab7a-42db-9e27-ec82d9133099 None admin] RBAC: Authorizing `identity:create_grant(project_id=deb0943e980a41b2987f1c69584ddf73, user_id=418751f793f8460fbe788b798407b9be, role_id=1928787bfcc745419829cd315900ac44)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:38.011777 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4306303-ab7a-42db-9e27-ec82d9133099 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:38.028237 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 123/253] 10.222.0.36 () {58 vars in 1439 bytes} [Fri Jun 24 22:25:37 2022] PUT /identity/v3/projects/deb0943e980a41b2987f1c69584ddf73/users/418751f793f8460fbe788b798407b9be/roles/1928787bfcc745419829cd315900ac44 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:25:38.734682 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0eed2b-67ab-4946-a80e-ec10ab438275 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:38.735171 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0eed2b-67ab-4946-a80e-ec10ab438275 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:38.735171 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0eed2b-67ab-4946-a80e-ec10ab438275 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:38.736808 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 131/254] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:25:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:25:38.742395 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a96537-20a0-46e7-9d75-410c4a938835 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:38.742690 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a96537-20a0-46e7-9d75-410c4a938835 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:38.742973 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a96537-20a0-46e7-9d75-410c4a938835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:38.764243 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-d5a96537-20a0-46e7-9d75-410c4a938835 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:25:38.765437 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-d5a96537-20a0-46e7-9d75-410c4a938835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:25:38.857557 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 124/255] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:25:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 22:25:38.892879 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0eed2b-67ab-4946-a80e-ec10ab438275 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:38.952502 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:39.025022 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0eed2b-67ab-4946-a80e-ec10ab438275 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:39.063834 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b7e10a-6105-434e-80aa-4cc9e1cbf449 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:39.064355 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b7e10a-6105-434e-80aa-4cc9e1cbf449 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:39.064355 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b7e10a-6105-434e-80aa-4cc9e1cbf449 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:39.066026 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 125/256] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:25:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:25:39.069593 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578b6dcc-b874-4ece-a502-954105cc4d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:39.070398 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b6dcc-b874-4ece-a502-954105cc4d50 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:39.070675 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b6dcc-b874-4ece-a502-954105cc4d50 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:39.070945 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b6dcc-b874-4ece-a502-954105cc4d50 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:39.080897 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03108a8-eec0-4dfd-9c79-ad4af058957c None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:39.081180 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03108a8-eec0-4dfd-9c79-ad4af058957c None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:39.081524 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03108a8-eec0-4dfd-9c79-ad4af058957c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:39.088279 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578b6dcc-b874-4ece-a502-954105cc4d50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 22:25:39.096318 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-578b6dcc-b874-4ece-a502-954105cc4d50 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 22:25:39.096318 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:25:39.096318 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:25:39.096318 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:25:39.096318 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:25:39.096318 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:25:39.096318 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:25:39.096318 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:25:39.096318 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:25:39.096318 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:25:39.096318 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:25:39.096318 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:25:39.096318 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 22:25:39.096318 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 22:25:39.096318 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 22:25:39.096318 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 22:25:39.097198 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 22:25:39.097198 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 22:25:39.097198 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 22:25:39.097198 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 22:25:39.097198 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:25:39.097198 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:25:39.097198 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:25:39.097198 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:25:39.097198 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:25:39.097198 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:25:39.097198 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:25:39.097198 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:25:39.097198 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:25:39.097198 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:25:39.097198 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:25:39.097198 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:25:39.097973 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:25:39.097973 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:25:39.097973 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:25:39.097973 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:25:39.097973 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 22:25:39.097973 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 22:25:39.097973 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 22:25:39.097973 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 22:25:39.097973 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 22:25:39.097973 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 22:25:39.097973 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 22:25:39.097973 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:25:39.098559 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 132/257] 10.222.0.36 () {56 vars in 1096 bytes} [Fri Jun 24 22:25:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:25:39.105187 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578b6dcc-b874-4ece-a502-954105cc4d50 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:39.127185 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-e03108a8-eec0-4dfd-9c79-ad4af058957c None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:25:39.128477 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-e03108a8-eec0-4dfd-9c79-ad4af058957c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:25:39.255331 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:39.321495 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578b6dcc-b874-4ece-a502-954105cc4d50 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:39.321899 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 126/258] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:25:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 22:25:39.329372 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:39.371963 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03108a8-eec0-4dfd-9c79-ad4af058957c None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:39.376157 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80be027a-c937-4a4e-9e6a-12a7046ebe73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:39.376842 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80be027a-c937-4a4e-9e6a-12a7046ebe73 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:39.377119 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80be027a-c937-4a4e-9e6a-12a7046ebe73 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:39.377389 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80be027a-c937-4a4e-9e6a-12a7046ebe73 None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:39.378145 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80be027a-c937-4a4e-9e6a-12a7046ebe73 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:25:39.378449 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80be027a-c937-4a4e-9e6a-12a7046ebe73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:39.379882 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80be027a-c937-4a4e-9e6a-12a7046ebe73 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:39.401707 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 133/259] 10.222.0.36 () {56 vars in 1099 bytes} [Fri Jun 24 22:25:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:39.410758 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80be027a-c937-4a4e-9e6a-12a7046ebe73 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:39.597394 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03108a8-eec0-4dfd-9c79-ad4af058957c None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:39.638107 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80be027a-c937-4a4e-9e6a-12a7046ebe73 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:39.687990 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4718db65-c01a-4dda-aea2-16ee5b2b4125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:39.688838 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4718db65-c01a-4dda-aea2-16ee5b2b4125 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:39.689144 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4718db65-c01a-4dda-aea2-16ee5b2b4125 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:39.689424 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4718db65-c01a-4dda-aea2-16ee5b2b4125 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:39.720399 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4718db65-c01a-4dda-aea2-16ee5b2b4125 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 22:25:39.721444 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aeb2ac-db84-4bb1-8854-ef72ed401a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:39.722569 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aeb2ac-db84-4bb1-8854-ef72ed401a9b None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:39.723042 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aeb2ac-db84-4bb1-8854-ef72ed401a9b None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:39.723531 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aeb2ac-db84-4bb1-8854-ef72ed401a9b None admin] PATH_INFO: `/v3/users/2c5a7e7d1a0e4836808b16c2690ea655` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:39.727975 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aeb2ac-db84-4bb1-8854-ef72ed401a9b None admin] RBAC: Authorizing `identity:get_user(user_id=2c5a7e7d1a0e4836808b16c2690ea655)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:39.728861 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-4718db65-c01a-4dda-aea2-16ee5b2b4125 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 22:25:39.728861 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:25:39.728861 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:25:39.728861 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:25:39.728861 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:25:39.728861 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:25:39.728861 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:25:39.728861 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:25:39.728861 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:25:39.728861 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:25:39.728861 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:25:39.728861 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:25:39.728861 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 22:25:39.728861 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 22:25:39.728861 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 22:25:39.728861 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 22:25:39.729715 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 22:25:39.729715 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 22:25:39.729715 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 22:25:39.729715 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 22:25:39.729715 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:25:39.729715 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:25:39.729715 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:25:39.729715 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:25:39.729715 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:25:39.729715 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:25:39.729715 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:25:39.729715 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:25:39.729715 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:25:39.729715 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:25:39.729715 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:25:39.729715 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:25:39.730498 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:25:39.730498 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:25:39.730498 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:25:39.730498 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:25:39.730498 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 22:25:39.730498 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 22:25:39.730498 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 22:25:39.730498 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 22:25:39.730498 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 22:25:39.730498 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 22:25:39.730498 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 22:25:39.730498 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:25:39.732974 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aeb2ac-db84-4bb1-8854-ef72ed401a9b None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:39.736154 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 134/260] 10.222.0.36 () {56 vars in 1177 bytes} [Fri Jun 24 22:25:39 2022] GET /identity/v3/users/2c5a7e7d1a0e4836808b16c2690ea655 => generated 283 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 22:25:39.737631 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 127/261] 10.222.0.36 () {56 vars in 1114 bytes} [Fri Jun 24 22:25:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 365 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:25:39.740635 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4718db65-c01a-4dda-aea2-16ee5b2b4125 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:39.742183 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aeb2ac-db84-4bb1-8854-ef72ed401a9b None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:39.807502 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:39.828606 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:39.966896 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aeb2ac-db84-4bb1-8854-ef72ed401a9b None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:39.969430 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4718db65-c01a-4dda-aea2-16ee5b2b4125 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:40.021088 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046aff53-8010-4d8a-8ce7-527263cde1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:40.021750 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046aff53-8010-4d8a-8ce7-527263cde1ac None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:40.022442 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046aff53-8010-4d8a-8ce7-527263cde1ac None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:40.022732 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046aff53-8010-4d8a-8ce7-527263cde1ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:40.120028 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0cf95b-7de2-4141-9cc8-224cea6b10ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:40.120733 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0cf95b-7de2-4141-9cc8-224cea6b10ed None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:40.121024 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0cf95b-7de2-4141-9cc8-224cea6b10ed None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:40.121303 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0cf95b-7de2-4141-9cc8-224cea6b10ed None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:40.122075 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0cf95b-7de2-4141-9cc8-224cea6b10ed None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:25:40.122382 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0cf95b-7de2-4141-9cc8-224cea6b10ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:40.123838 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0cf95b-7de2-4141-9cc8-224cea6b10ed None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:40.138932 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046aff53-8010-4d8a-8ce7-527263cde1ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:40.144896 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046aff53-8010-4d8a-8ce7-527263cde1ac None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:40.151285 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 135/262] 10.222.0.36 () {56 vars in 1111 bytes} [Fri Jun 24 22:25:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 409 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 22:25:40.160184 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0cf95b-7de2-4141-9cc8-224cea6b10ed None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:40.211650 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:40.386748 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 128/263] 10.222.0.36 () {58 vars in 1282 bytes} [Fri Jun 24 22:25:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 646 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 22:25:40.392241 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046aff53-8010-4d8a-8ce7-527263cde1ac None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:40.444874 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:40.457164 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0cf95b-7de2-4141-9cc8-224cea6b10ed None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:40.510918 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31937d82-a2f4-43cb-88e7-96338bd7cc91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:40.512330 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31937d82-a2f4-43cb-88e7-96338bd7cc91 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:40.512859 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31937d82-a2f4-43cb-88e7-96338bd7cc91 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:40.513332 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31937d82-a2f4-43cb-88e7-96338bd7cc91 None admin] PATH_INFO: `/v3/users/2c5a7e7d1a0e4836808b16c2690ea655` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:40.519989 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31937d82-a2f4-43cb-88e7-96338bd7cc91 None admin] RBAC: Authorizing `identity:get_user(user_id=2c5a7e7d1a0e4836808b16c2690ea655)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:40.521787 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31937d82-a2f4-43cb-88e7-96338bd7cc91 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:40.523729 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 136/264] 10.222.0.36 () {56 vars in 1177 bytes} [Fri Jun 24 22:25:40 2022] GET /identity/v3/users/2c5a7e7d1a0e4836808b16c2690ea655 => generated 283 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:40.529602 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31937d82-a2f4-43cb-88e7-96338bd7cc91 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:40.639362 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046aff53-8010-4d8a-8ce7-527263cde1ac None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:40.670234 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ca576e-7bfa-4376-8347-5119e420831e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:40.671131 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ca576e-7bfa-4376-8347-5119e420831e None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:40.671428 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ca576e-7bfa-4376-8347-5119e420831e None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:40.671697 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ca576e-7bfa-4376-8347-5119e420831e None admin] PATH_INFO: `/v3/projects/deb0943e980a41b2987f1c69584ddf73` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:40.672901 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ca576e-7bfa-4376-8347-5119e420831e None admin] RBAC: Authorizing `identity:get_project(project_id=deb0943e980a41b2987f1c69584ddf73)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:40.679548 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ca576e-7bfa-4376-8347-5119e420831e None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:40.679548 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 129/265] 10.222.0.36 () {56 vars in 1186 bytes} [Fri Jun 24 22:25:40 2022] GET /identity/v3/projects/deb0943e980a41b2987f1c69584ddf73 => generated 302 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 22:25:40.681970 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ca576e-7bfa-4376-8347-5119e420831e None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:40.690818 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:40.698700 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31937d82-a2f4-43cb-88e7-96338bd7cc91 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:40.745146 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c7d578-fc17-4ef7-8b98-419f67ed863b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:40.745819 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c7d578-fc17-4ef7-8b98-419f67ed863b None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:40.746257 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c7d578-fc17-4ef7-8b98-419f67ed863b None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:40.746661 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c7d578-fc17-4ef7-8b98-419f67ed863b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:40.808638 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:40.886800 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c7d578-fc17-4ef7-8b98-419f67ed863b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:40.888621 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c7d578-fc17-4ef7-8b98-419f67ed863b None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:40.921503 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ca576e-7bfa-4376-8347-5119e420831e None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:40.975783 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fce51c-1692-4478-b4dc-0c4c3e56c9b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:40.976458 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fce51c-1692-4478-b4dc-0c4c3e56c9b5 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:40.976735 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fce51c-1692-4478-b4dc-0c4c3e56c9b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:40.977009 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fce51c-1692-4478-b4dc-0c4c3e56c9b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:40.977840 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fce51c-1692-4478-b4dc-0c4c3e56c9b5 None admin] RBAC: Adding query filter params (role.id=1a1c43cc97a0407eb7a7c7a1333a9d4a, scope.project.id=deb0943e980a41b2987f1c69584ddf73, user.id=2c5a7e7d1a0e4836808b16c2690ea655) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:25:40.978151 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fce51c-1692-4478-b4dc-0c4c3e56c9b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:40.979748 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fce51c-1692-4478-b4dc-0c4c3e56c9b5 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:40.985897 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 130/266] 10.222.0.36 () {56 vars in 1374 bytes} [Fri Jun 24 22:25:40 2022] GET /identity/v3/role_assignments?user.id=2c5a7e7d1a0e4836808b16c2690ea655&scope.project.id=deb0943e980a41b2987f1c69584ddf73&role.id=1a1c43cc97a0407eb7a7c7a1333a9d4a => generated 608 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:40.987109 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ad6723-b9a1-4974-90da-b9150e3bf77d None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:40.987421 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ad6723-b9a1-4974-90da-b9150e3bf77d None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:40.987699 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ad6723-b9a1-4974-90da-b9150e3bf77d None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:40.988906 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 131/267] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:25:40 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:25:40.989947 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d897a8-593b-4256-90b8-5e1b4ce17069 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:40.990228 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d897a8-593b-4256-90b8-5e1b4ce17069 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:40.990502 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d897a8-593b-4256-90b8-5e1b4ce17069 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:40.991822 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 132/268] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:25:40 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:25:40.993117 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b221c266-4dfe-4191-a81f-5a5ebaca48f6 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:40.993583 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b221c266-4dfe-4191-a81f-5a5ebaca48f6 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:40.994100 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b221c266-4dfe-4191-a81f-5a5ebaca48f6 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:40.999730 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 133/269] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:25:40 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:25:41.001439 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cdcde5-fb3e-4531-8b2a-69ea71e480f2 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:41.001918 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cdcde5-fb3e-4531-8b2a-69ea71e480f2 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:41.002380 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cdcde5-fb3e-4531-8b2a-69ea71e480f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:41.017357 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 137/270] 10.222.0.36 () {58 vars in 1282 bytes} [Fri Jun 24 22:25:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 22:25:41.019118 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f64612-cf75-437b-b14a-01efe4c3385c None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:41.019582 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f64612-cf75-437b-b14a-01efe4c3385c None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:41.020036 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f64612-cf75-437b-b14a-01efe4c3385c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:41.023474 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-74cdcde5-fb3e-4531-8b2a-69ea71e480f2 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:25:41.024712 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-74cdcde5-fb3e-4531-8b2a-69ea71e480f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:25:41.039607 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-77f64612-cf75-437b-b14a-01efe4c3385c None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:25:41.041258 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-77f64612-cf75-437b-b14a-01efe4c3385c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:25:41.096930 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:41.107372 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 134/271] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:25:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 22:25:41.107372 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbf9cd7-814b-40fa-872c-e5c727b735bc None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:41.107372 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbf9cd7-814b-40fa-872c-e5c727b735bc None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:41.107372 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbf9cd7-814b-40fa-872c-e5c727b735bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:41.116060 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:41.128955 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 138/272] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:25:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 22:25:41.130724 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96115258-9c4d-4613-a519-010d21fa898e None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:41.131340 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96115258-9c4d-4613-a519-010d21fa898e None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:41.131648 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96115258-9c4d-4613-a519-010d21fa898e None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:41.132190 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-cbbf9cd7-814b-40fa-872c-e5c727b735bc None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:25:41.133167 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 139/273] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:25:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:25:41.133564 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-cbbf9cd7-814b-40fa-872c-e5c727b735bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:25:41.133738 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96115258-9c4d-4613-a519-010d21fa898e None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:41.218275 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 135/274] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:25:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 22:25:41.220166 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbf9cd7-814b-40fa-872c-e5c727b735bc None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:41.258999 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96115258-9c4d-4613-a519-010d21fa898e None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:41.292151 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857da741-83e7-4151-af91-680eb28917bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:41.293020 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857da741-83e7-4151-af91-680eb28917bc None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:41.293298 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857da741-83e7-4151-af91-680eb28917bc None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:41.293570 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857da741-83e7-4151-af91-680eb28917bc None admin] PATH_INFO: `/v3/projects/deb0943e980a41b2987f1c69584ddf73` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:41.294732 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857da741-83e7-4151-af91-680eb28917bc None admin] RBAC: Authorizing `identity:get_project(project_id=deb0943e980a41b2987f1c69584ddf73)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:41.296232 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857da741-83e7-4151-af91-680eb28917bc None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:41.302613 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 140/275] 10.222.0.36 () {56 vars in 1186 bytes} [Fri Jun 24 22:25:41 2022] GET /identity/v3/projects/deb0943e980a41b2987f1c69584ddf73 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:41.302613 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17a15d8-6cb4-4e78-8f07-85d34a02522f None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:41.302613 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17a15d8-6cb4-4e78-8f07-85d34a02522f None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:41.302613 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17a15d8-6cb4-4e78-8f07-85d34a02522f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:41.316426 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-c17a15d8-6cb4-4e78-8f07-85d34a02522f None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:25:41.317633 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-c17a15d8-6cb4-4e78-8f07-85d34a02522f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:25:41.327234 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbf9cd7-814b-40fa-872c-e5c727b735bc None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:41.356074 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:41.362508 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4090ed9b-60b2-404d-9183-01945f8311fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:41.363341 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4090ed9b-60b2-404d-9183-01945f8311fe None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:41.363625 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4090ed9b-60b2-404d-9183-01945f8311fe None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:41.363900 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4090ed9b-60b2-404d-9183-01945f8311fe None admin] PATH_INFO: `/v3/domains/default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:41.365051 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4090ed9b-60b2-404d-9183-01945f8311fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:41.366520 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4090ed9b-60b2-404d-9183-01945f8311fe None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:41.368163 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 136/276] 10.222.0.36 () {56 vars in 1108 bytes} [Fri Jun 24 22:25:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:41.369184 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4090ed9b-60b2-404d-9183-01945f8311fe None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:41.378313 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:41.390935 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 141/277] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:25:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 22:25:41.391786 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17a15d8-6cb4-4e78-8f07-85d34a02522f None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:41.479840 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4090ed9b-60b2-404d-9183-01945f8311fe None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:41.492236 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17a15d8-6cb4-4e78-8f07-85d34a02522f None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:41.513876 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3546883-67c2-4530-a291-e6394475db54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:41.514676 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3546883-67c2-4530-a291-e6394475db54 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:41.514959 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3546883-67c2-4530-a291-e6394475db54 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:41.515234 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3546883-67c2-4530-a291-e6394475db54 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:41.525601 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3546883-67c2-4530-a291-e6394475db54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 22:25:41.526504 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290eed72-a2be-41f3-97f8-5506f5dc9640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:41.527342 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290eed72-a2be-41f3-97f8-5506f5dc9640 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:41.527626 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290eed72-a2be-41f3-97f8-5506f5dc9640 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:41.527902 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290eed72-a2be-41f3-97f8-5506f5dc9640 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:41.533316 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-a3546883-67c2-4530-a291-e6394475db54 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 22:25:41.533316 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:25:41.533316 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:25:41.533316 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:25:41.533316 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:25:41.533316 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:25:41.533316 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:25:41.533316 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:25:41.533316 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:25:41.533316 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:25:41.533316 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:25:41.533316 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:25:41.533316 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 22:25:41.533316 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 22:25:41.533316 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 22:25:41.533316 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 22:25:41.534144 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 22:25:41.534144 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 22:25:41.534144 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 22:25:41.534144 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 22:25:41.534144 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:25:41.534144 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:25:41.534144 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:25:41.534144 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:25:41.534144 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:25:41.534144 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:25:41.534144 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:25:41.534144 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:25:41.534144 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:25:41.534144 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:25:41.534144 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:25:41.534144 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:25:41.540130 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:25:41.540130 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:25:41.540130 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:25:41.540130 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:25:41.540130 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 22:25:41.540130 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 22:25:41.540130 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 22:25:41.540130 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 22:25:41.540130 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 22:25:41.540130 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 22:25:41.540130 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 22:25:41.540130 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:25:41.540130 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 137/278] 10.222.0.36 () {56 vars in 1099 bytes} [Fri Jun 24 22:25:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:25:41.540130 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3546883-67c2-4530-a291-e6394475db54 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:41.541273 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290eed72-a2be-41f3-97f8-5506f5dc9640 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 22:25:41.547325 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-290eed72-a2be-41f3-97f8-5506f5dc9640 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 22:25:41.547325 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:25:41.547325 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:25:41.547325 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:25:41.547325 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:25:41.547325 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:25:41.547325 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:25:41.547325 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:25:41.547325 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:25:41.547325 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:25:41.547325 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:25:41.547325 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:25:41.547325 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 22:25:41.547325 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 22:25:41.547325 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 22:25:41.547325 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 22:25:41.548188 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 22:25:41.548188 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 22:25:41.548188 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 22:25:41.548188 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 22:25:41.548188 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:25:41.548188 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:25:41.548188 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:25:41.548188 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:25:41.548188 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:25:41.548188 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:25:41.548188 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:25:41.548188 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:25:41.548188 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:25:41.548188 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:25:41.548188 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:25:41.548188 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:25:41.549215 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:25:41.549215 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:25:41.549215 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:25:41.549215 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:25:41.549215 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 22:25:41.549215 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 22:25:41.549215 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 22:25:41.549215 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 22:25:41.549215 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 22:25:41.549215 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 22:25:41.549215 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 22:25:41.549215 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:25:41.549215 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 142/279] 10.222.0.36 () {56 vars in 1099 bytes} [Fri Jun 24 22:25:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:25:41.550011 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290eed72-a2be-41f3-97f8-5506f5dc9640 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:41.595222 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:41.600404 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:41.637438 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3546883-67c2-4530-a291-e6394475db54 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:41.651055 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290eed72-a2be-41f3-97f8-5506f5dc9640 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:41.669381 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a70863-82f7-436f-bbd2-5d620872e338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:41.670044 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a70863-82f7-436f-bbd2-5d620872e338 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:41.670327 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a70863-82f7-436f-bbd2-5d620872e338 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:41.670603 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a70863-82f7-436f-bbd2-5d620872e338 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:41.671471 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a70863-82f7-436f-bbd2-5d620872e338 None admin] RBAC: Adding query filter params (role.id=bf32f251a7764c7188fd782b65275038, scope.project.id=deb0943e980a41b2987f1c69584ddf73, user.id=2c5a7e7d1a0e4836808b16c2690ea655) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:25:41.671785 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a70863-82f7-436f-bbd2-5d620872e338 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:41.673257 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a70863-82f7-436f-bbd2-5d620872e338 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:41.678985 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 138/280] 10.222.0.36 () {56 vars in 1374 bytes} [Fri Jun 24 22:25:41 2022] GET /identity/v3/role_assignments?user.id=2c5a7e7d1a0e4836808b16c2690ea655&scope.project.id=deb0943e980a41b2987f1c69584ddf73&role.id=bf32f251a7764c7188fd782b65275038 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:41.679779 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a70863-82f7-436f-bbd2-5d620872e338 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:41.683275 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79694fc8-b691-4820-8535-86f6b71621bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:41.683964 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79694fc8-b691-4820-8535-86f6b71621bf None admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:41.684248 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79694fc8-b691-4820-8535-86f6b71621bf None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:41.684525 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79694fc8-b691-4820-8535-86f6b71621bf None admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:41.685246 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79694fc8-b691-4820-8535-86f6b71621bf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:41.686782 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79694fc8-b691-4820-8535-86f6b71621bf None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:41.711377 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 143/281] 10.222.0.36 () {60 vars in 1132 bytes} [Fri Jun 24 22:25:41 2022] POST /identity/v3/users => generated 293 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:25:41.712935 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79694fc8-b691-4820-8535-86f6b71621bf None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:41.819454 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a70863-82f7-436f-bbd2-5d620872e338 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:41.847615 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:41.869594 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a222ecb7-b50c-4016-b356-3e36013adc89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:41.870638 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a222ecb7-b50c-4016-b356-3e36013adc89 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:41.870920 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a222ecb7-b50c-4016-b356-3e36013adc89 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:41.871198 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a222ecb7-b50c-4016-b356-3e36013adc89 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:41.877950 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79694fc8-b691-4820-8535-86f6b71621bf None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:41.884916 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a222ecb7-b50c-4016-b356-3e36013adc89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 22:25:41.888334 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:41.893741 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-a222ecb7-b50c-4016-b356-3e36013adc89 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 22:25:41.893741 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:25:41.893741 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:25:41.893741 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:25:41.893741 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:25:41.893741 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:25:41.893741 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:25:41.893741 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:25:41.893741 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:25:41.893741 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:25:41.893741 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:25:41.893741 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:25:41.893741 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 22:25:41.893741 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 22:25:41.893741 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 22:25:41.893741 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 22:25:41.894783 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 22:25:41.894783 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 22:25:41.894783 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 22:25:41.894783 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 22:25:41.894783 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:25:41.894783 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:25:41.894783 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:25:41.894783 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:25:41.894783 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:25:41.894783 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:25:41.894783 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:25:41.894783 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:25:41.894783 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:25:41.894783 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:25:41.894783 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:25:41.894783 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:25:41.896362 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:25:41.896362 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:25:41.896362 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:25:41.896362 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:25:41.896362 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 22:25:41.896362 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 22:25:41.896362 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 22:25:41.896362 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 22:25:41.896362 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 22:25:41.896362 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 22:25:41.896362 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 22:25:41.896362 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:25:41.896362 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 139/282] 10.222.0.36 () {56 vars in 1099 bytes} [Fri Jun 24 22:25:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:25:41.896362 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a222ecb7-b50c-4016-b356-3e36013adc89 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:41.931843 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76835f15-868b-4625-9686-5297dafa7f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:41.933031 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76835f15-868b-4625-9686-5297dafa7f4e None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:41.933349 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76835f15-868b-4625-9686-5297dafa7f4e None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:41.933626 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76835f15-868b-4625-9686-5297dafa7f4e None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:41.934395 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76835f15-868b-4625-9686-5297dafa7f4e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:25:41.934706 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76835f15-868b-4625-9686-5297dafa7f4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:41.936181 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76835f15-868b-4625-9686-5297dafa7f4e None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:41.948588 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 144/283] 10.222.0.36 () {56 vars in 1101 bytes} [Fri Jun 24 22:25:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:41.949447 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76835f15-868b-4625-9686-5297dafa7f4e None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:42.026578 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a222ecb7-b50c-4016-b356-3e36013adc89 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:42.065066 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa0b8a1-5ab2-4944-ba15-ed34746ce38f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:42.066188 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa0b8a1-5ab2-4944-ba15-ed34746ce38f None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:42.066475 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa0b8a1-5ab2-4944-ba15-ed34746ce38f None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:42.066755 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa0b8a1-5ab2-4944-ba15-ed34746ce38f None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:42.067548 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa0b8a1-5ab2-4944-ba15-ed34746ce38f None admin] RBAC: Adding query filter params (name=member) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:25:42.067856 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa0b8a1-5ab2-4944-ba15-ed34746ce38f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:42.068557 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76835f15-868b-4625-9686-5297dafa7f4e None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:42.069267 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa0b8a1-5ab2-4944-ba15-ed34746ce38f None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:42.082861 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 140/284] 10.222.0.36 () {56 vars in 1101 bytes} [Fri Jun 24 22:25:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:42.083707 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa0b8a1-5ab2-4944-ba15-ed34746ce38f None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:42.106436 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e764cfd5-db59-49f6-960d-5fd02a95055a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:42.107528 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e764cfd5-db59-49f6-960d-5fd02a95055a None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:42.107946 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e764cfd5-db59-49f6-960d-5fd02a95055a None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:42.108358 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e764cfd5-db59-49f6-960d-5fd02a95055a None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:42.109276 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e764cfd5-db59-49f6-960d-5fd02a95055a None admin] RBAC: Adding query filter params (name=member) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:25:42.109857 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e764cfd5-db59-49f6-960d-5fd02a95055a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:42.111744 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e764cfd5-db59-49f6-960d-5fd02a95055a None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:42.121878 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 145/285] 10.222.0.36 () {56 vars in 1101 bytes} [Fri Jun 24 22:25:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:42.123047 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e764cfd5-db59-49f6-960d-5fd02a95055a None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:42.131919 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:42.158980 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:42.196103 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa0b8a1-5ab2-4944-ba15-ed34746ce38f None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:42.233693 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf9b1f0-eaec-4fcf-95da-f661ec8279ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:42.234591 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf9b1f0-eaec-4fcf-95da-f661ec8279ae None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:42.234878 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf9b1f0-eaec-4fcf-95da-f661ec8279ae None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:42.235155 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf9b1f0-eaec-4fcf-95da-f661ec8279ae None admin] PATH_INFO: `/v3/users/5adbeb93775747b5ae3fe33781605b3c` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:42.237037 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf9b1f0-eaec-4fcf-95da-f661ec8279ae None admin] RBAC: Authorizing `identity:get_user(user_id=5adbeb93775747b5ae3fe33781605b3c)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:42.238772 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf9b1f0-eaec-4fcf-95da-f661ec8279ae None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:42.239893 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e764cfd5-db59-49f6-960d-5fd02a95055a None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:42.240788 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 141/286] 10.222.0.36 () {56 vars in 1177 bytes} [Fri Jun 24 22:25:42 2022] GET /identity/v3/users/5adbeb93775747b5ae3fe33781605b3c => generated 297 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:42.241634 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf9b1f0-eaec-4fcf-95da-f661ec8279ae None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:42.278448 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f4b09f-15ff-4a96-b23f-e3df6a973f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:42.279762 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f4b09f-15ff-4a96-b23f-e3df6a973f8e None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:42.280217 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f4b09f-15ff-4a96-b23f-e3df6a973f8e None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:42.280660 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f4b09f-15ff-4a96-b23f-e3df6a973f8e None admin] PATH_INFO: `/v3/users/dd4b56cfd9544db588cf2c7c8d59e837` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:42.296959 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f4b09f-15ff-4a96-b23f-e3df6a973f8e None admin] RBAC: Authorizing `identity:get_user(user_id=dd4b56cfd9544db588cf2c7c8d59e837)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:42.298739 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f4b09f-15ff-4a96-b23f-e3df6a973f8e None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:42.301023 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 146/287] 10.222.0.36 () {56 vars in 1177 bytes} [Fri Jun 24 22:25:42 2022] GET /identity/v3/users/dd4b56cfd9544db588cf2c7c8d59e837 => generated 293 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:42.302061 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f4b09f-15ff-4a96-b23f-e3df6a973f8e None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:42.364371 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf9b1f0-eaec-4fcf-95da-f661ec8279ae None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:42.378786 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:42.402094 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:42.405663 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295c0f02-f8c8-4c4f-a0fe-ad2fb93e7c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:42.406715 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c0f02-f8c8-4c4f-a0fe-ad2fb93e7c39 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:42.407002 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c0f02-f8c8-4c4f-a0fe-ad2fb93e7c39 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:42.407305 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c0f02-f8c8-4c4f-a0fe-ad2fb93e7c39 None admin] PATH_INFO: `/v3/users/418751f793f8460fbe788b798407b9be` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:42.408611 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295c0f02-f8c8-4c4f-a0fe-ad2fb93e7c39 None admin] RBAC: Authorizing `identity:get_user(user_id=418751f793f8460fbe788b798407b9be)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:42.410146 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295c0f02-f8c8-4c4f-a0fe-ad2fb93e7c39 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:42.411918 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 142/288] 10.222.0.36 () {56 vars in 1177 bytes} [Fri Jun 24 22:25:42 2022] GET /identity/v3/users/418751f793f8460fbe788b798407b9be => generated 297 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:42.414299 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f4b09f-15ff-4a96-b23f-e3df6a973f8e None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:42.416169 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295c0f02-f8c8-4c4f-a0fe-ad2fb93e7c39 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:42.449919 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f08de31-ac6a-46e1-a11e-d91cbfa14445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:42.450906 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f08de31-ac6a-46e1-a11e-d91cbfa14445 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:42.451188 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f08de31-ac6a-46e1-a11e-d91cbfa14445 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:42.451492 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f08de31-ac6a-46e1-a11e-d91cbfa14445 None admin] PATH_INFO: `/v3/projects/deb0943e980a41b2987f1c69584ddf73` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:42.452691 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f08de31-ac6a-46e1-a11e-d91cbfa14445 None admin] RBAC: Authorizing `identity:get_project(project_id=deb0943e980a41b2987f1c69584ddf73)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:42.454347 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f08de31-ac6a-46e1-a11e-d91cbfa14445 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:42.456273 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 147/289] 10.222.0.36 () {56 vars in 1186 bytes} [Fri Jun 24 22:25:42 2022] GET /identity/v3/projects/deb0943e980a41b2987f1c69584ddf73 => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:42.457045 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f08de31-ac6a-46e1-a11e-d91cbfa14445 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:42.533294 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295c0f02-f8c8-4c4f-a0fe-ad2fb93e7c39 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:42.561062 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f08de31-ac6a-46e1-a11e-d91cbfa14445 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:42.568168 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c2833d-a0b0-4c76-aab2-8d1b749d0c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:42.568878 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c2833d-a0b0-4c76-aab2-8d1b749d0c3e None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:42.569155 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c2833d-a0b0-4c76-aab2-8d1b749d0c3e None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:42.569532 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c2833d-a0b0-4c76-aab2-8d1b749d0c3e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:42.570374 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c2833d-a0b0-4c76-aab2-8d1b749d0c3e None admin] RBAC: Adding query filter params (role.id=1928787bfcc745419829cd315900ac44, user.id=dd4b56cfd9544db588cf2c7c8d59e837, scope.system=all) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:25:42.570685 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c2833d-a0b0-4c76-aab2-8d1b749d0c3e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:42.572463 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c2833d-a0b0-4c76-aab2-8d1b749d0c3e None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:42.578686 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 143/290] 10.222.0.36 () {56 vars in 1308 bytes} [Fri Jun 24 22:25:42 2022] GET /identity/v3/role_assignments?user.id=dd4b56cfd9544db588cf2c7c8d59e837&scope.system=all&role.id=1928787bfcc745419829cd315900ac44 => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:42.579598 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c2833d-a0b0-4c76-aab2-8d1b749d0c3e None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:42.608388 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb003c0-1e5b-4efc-a7ec-7456d49e4b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:42.609174 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb003c0-1e5b-4efc-a7ec-7456d49e4b2a None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:42.609471 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb003c0-1e5b-4efc-a7ec-7456d49e4b2a None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:42.609747 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb003c0-1e5b-4efc-a7ec-7456d49e4b2a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:42.633219 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:42.642404 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:42.692504 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb003c0-1e5b-4efc-a7ec-7456d49e4b2a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:42.694229 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb003c0-1e5b-4efc-a7ec-7456d49e4b2a None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:42.695402 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c2833d-a0b0-4c76-aab2-8d1b749d0c3e None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:42.733016 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d5dea7-53d6-4cae-b2fd-3cd403710ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:42.734234 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d5dea7-53d6-4cae-b2fd-3cd403710ad5 None admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:42.734647 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d5dea7-53d6-4cae-b2fd-3cd403710ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:42.735055 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d5dea7-53d6-4cae-b2fd-3cd403710ad5 None admin] PATH_INFO: `/v3/projects/deb0943e980a41b2987f1c69584ddf73/users/5adbeb93775747b5ae3fe33781605b3c/roles/c32d1d4e9658499ca095bd31a1fe816d` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:42.737274 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d5dea7-53d6-4cae-b2fd-3cd403710ad5 None admin] RBAC: Authorizing `identity:create_grant(project_id=deb0943e980a41b2987f1c69584ddf73, user_id=5adbeb93775747b5ae3fe33781605b3c, role_id=c32d1d4e9658499ca095bd31a1fe816d)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:42.739012 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d5dea7-53d6-4cae-b2fd-3cd403710ad5 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:42.760850 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 144/291] 10.222.0.36 () {58 vars in 1439 bytes} [Fri Jun 24 22:25:42 2022] PUT /identity/v3/projects/deb0943e980a41b2987f1c69584ddf73/users/5adbeb93775747b5ae3fe33781605b3c/roles/c32d1d4e9658499ca095bd31a1fe816d => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:25:42.813718 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 148/292] 10.222.0.36 () {58 vars in 1282 bytes} [Fri Jun 24 22:25:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 22:25:42.819977 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d5dea7-53d6-4cae-b2fd-3cd403710ad5 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:42.928183 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d5dea7-53d6-4cae-b2fd-3cd403710ad5 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:42.931742 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:42.966002 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9400dc-73fc-4459-823f-dd0cd2d9cf92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:42.966895 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9400dc-73fc-4459-823f-dd0cd2d9cf92 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:42.967172 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9400dc-73fc-4459-823f-dd0cd2d9cf92 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:42.967466 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9400dc-73fc-4459-823f-dd0cd2d9cf92 None admin] PATH_INFO: `/v3/projects/deb0943e980a41b2987f1c69584ddf73` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:42.968726 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9400dc-73fc-4459-823f-dd0cd2d9cf92 None admin] RBAC: Authorizing `identity:get_project(project_id=deb0943e980a41b2987f1c69584ddf73)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:42.970195 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9400dc-73fc-4459-823f-dd0cd2d9cf92 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:42.972291 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 145/293] 10.222.0.36 () {56 vars in 1186 bytes} [Fri Jun 24 22:25:42 2022] GET /identity/v3/projects/deb0943e980a41b2987f1c69584ddf73 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:42.978282 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb003c0-1e5b-4efc-a7ec-7456d49e4b2a None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:43.041132 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:43.089478 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb003c0-1e5b-4efc-a7ec-7456d49e4b2a None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:43.127464 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad89d98-6723-4ff8-a53d-d3c2d057e334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:43.128128 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad89d98-6723-4ff8-a53d-d3c2d057e334 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:43.128405 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad89d98-6723-4ff8-a53d-d3c2d057e334 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:43.128680 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad89d98-6723-4ff8-a53d-d3c2d057e334 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:43.129571 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad89d98-6723-4ff8-a53d-d3c2d057e334 None admin] RBAC: Adding query filter params (role.id=1928787bfcc745419829cd315900ac44, scope.project.id=deb0943e980a41b2987f1c69584ddf73, user.id=418751f793f8460fbe788b798407b9be) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:25:43.129888 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad89d98-6723-4ff8-a53d-d3c2d057e334 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:43.131774 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad89d98-6723-4ff8-a53d-d3c2d057e334 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:43.138035 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 149/294] 10.222.0.36 () {56 vars in 1374 bytes} [Fri Jun 24 22:25:42 2022] GET /identity/v3/role_assignments?user.id=418751f793f8460fbe788b798407b9be&scope.project.id=deb0943e980a41b2987f1c69584ddf73&role.id=1928787bfcc745419829cd315900ac44 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:44.051991 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6124e122-67db-45e4-9b5e-8d1a8053b21b None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:44.052548 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6124e122-67db-45e4-9b5e-8d1a8053b21b None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:44.052548 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6124e122-67db-45e4-9b5e-8d1a8053b21b None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:44.054341 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 146/295] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:25:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:25:44.060232 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58175dde-3f3a-4c2a-ae9b-ad7ac41431e0 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:44.060636 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58175dde-3f3a-4c2a-ae9b-ad7ac41431e0 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:44.060812 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58175dde-3f3a-4c2a-ae9b-ad7ac41431e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:44.077998 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-58175dde-3f3a-4c2a-ae9b-ad7ac41431e0 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:25:44.079198 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-58175dde-3f3a-4c2a-ae9b-ad7ac41431e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:25:44.149125 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 150/296] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:25:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 22:25:44.174386 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6124e122-67db-45e4-9b5e-8d1a8053b21b None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:44.202061 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60170a9d-f882-424d-8bf4-0c626de1f1bc None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:44.202347 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60170a9d-f882-424d-8bf4-0c626de1f1bc None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:44.202627 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60170a9d-f882-424d-8bf4-0c626de1f1bc None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:44.204073 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 151/297] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:25:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:25:44.208877 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017e265c-cc5b-49f8-afc3-1808946c8602 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:44.209170 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017e265c-cc5b-49f8-afc3-1808946c8602 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:44.209451 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017e265c-cc5b-49f8-afc3-1808946c8602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:44.226039 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-017e265c-cc5b-49f8-afc3-1808946c8602 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:25:44.227233 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-017e265c-cc5b-49f8-afc3-1808946c8602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:25:44.280513 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:44.286135 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6124e122-67db-45e4-9b5e-8d1a8053b21b None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:44.311589 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 152/298] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:25:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 22:25:44.320445 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fe95b4-4fd3-4ae7-ae1f-4c8c0a9111ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:44.321493 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fe95b4-4fd3-4ae7-ae1f-4c8c0a9111ed None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:44.322036 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fe95b4-4fd3-4ae7-ae1f-4c8c0a9111ed None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:44.322550 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fe95b4-4fd3-4ae7-ae1f-4c8c0a9111ed None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:44.327418 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017e265c-cc5b-49f8-afc3-1808946c8602 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:44.333818 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fe95b4-4fd3-4ae7-ae1f-4c8c0a9111ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 22:25:44.342303 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-56fe95b4-4fd3-4ae7-ae1f-4c8c0a9111ed None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 22:25:44.342303 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:25:44.342303 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:25:44.342303 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:25:44.342303 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:25:44.342303 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:25:44.342303 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:25:44.342303 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:25:44.342303 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:25:44.342303 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:25:44.342303 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:25:44.342303 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:25:44.342303 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 22:25:44.342303 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 22:25:44.342303 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 22:25:44.342303 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 22:25:44.343189 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 22:25:44.343189 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 22:25:44.343189 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 22:25:44.343189 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 22:25:44.343189 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:25:44.343189 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:25:44.343189 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:25:44.343189 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:25:44.343189 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:25:44.343189 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:25:44.343189 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:25:44.343189 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:25:44.343189 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:25:44.343189 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:25:44.343189 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:25:44.343189 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:25:44.343980 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:25:44.343980 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:25:44.343980 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:25:44.343980 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:25:44.343980 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 22:25:44.343980 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 22:25:44.343980 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 22:25:44.343980 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 22:25:44.343980 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 22:25:44.343980 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 22:25:44.343980 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 22:25:44.343980 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:25:44.346662 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 147/299] 10.222.0.36 () {56 vars in 1099 bytes} [Fri Jun 24 22:25:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:25:44.353283 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fe95b4-4fd3-4ae7-ae1f-4c8c0a9111ed None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:44.396330 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:44.451199 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017e265c-cc5b-49f8-afc3-1808946c8602 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:44.478870 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fe95b4-4fd3-4ae7-ae1f-4c8c0a9111ed None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:44.487626 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816ef8b8-253a-4205-9924-eef937fb0996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:44.488781 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ef8b8-253a-4205-9924-eef937fb0996 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:44.489062 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ef8b8-253a-4205-9924-eef937fb0996 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:44.489639 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ef8b8-253a-4205-9924-eef937fb0996 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:44.491077 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816ef8b8-253a-4205-9924-eef937fb0996 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:44.493065 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816ef8b8-253a-4205-9924-eef937fb0996 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:44.495589 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 153/300] 10.222.0.36 () {56 vars in 1108 bytes} [Fri Jun 24 22:25:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:44.500672 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816ef8b8-253a-4205-9924-eef937fb0996 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:44.522885 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e7564a-4e22-4d81-a3f4-24f8ba8206bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:44.524001 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e7564a-4e22-4d81-a3f4-24f8ba8206bb None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:44.524284 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e7564a-4e22-4d81-a3f4-24f8ba8206bb None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:44.524557 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e7564a-4e22-4d81-a3f4-24f8ba8206bb None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:44.525363 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e7564a-4e22-4d81-a3f4-24f8ba8206bb None admin] RBAC: Adding query filter params (name=reader) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:25:44.525670 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e7564a-4e22-4d81-a3f4-24f8ba8206bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:44.527096 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e7564a-4e22-4d81-a3f4-24f8ba8206bb None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:44.539127 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 148/301] 10.222.0.36 () {56 vars in 1101 bytes} [Fri Jun 24 22:25:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:44.551380 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e7564a-4e22-4d81-a3f4-24f8ba8206bb None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:44.561000 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:44.617067 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816ef8b8-253a-4205-9924-eef937fb0996 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:44.658376 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0292730-3101-44f7-9040-1ec4d924dae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:44.659167 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0292730-3101-44f7-9040-1ec4d924dae5 None admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:44.659539 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0292730-3101-44f7-9040-1ec4d924dae5 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:44.659879 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0292730-3101-44f7-9040-1ec4d924dae5 None admin] PATH_INFO: `/v3/groups` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:44.660645 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0292730-3101-44f7-9040-1ec4d924dae5 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:44.662406 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0292730-3101-44f7-9040-1ec4d924dae5 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:44.671791 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:44.680855 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e7564a-4e22-4d81-a3f4-24f8ba8206bb None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:44.687531 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 154/302] 10.222.0.36 () {60 vars in 1134 bytes} [Fri Jun 24 22:25:44 2022] POST /identity/v3/groups => generated 229 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:25:44.727891 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa6edcc-b4fb-4e60-b629-41065533af9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:44.729088 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa6edcc-b4fb-4e60-b629-41065533af9c None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:44.729439 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa6edcc-b4fb-4e60-b629-41065533af9c None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:44.729655 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa6edcc-b4fb-4e60-b629-41065533af9c None admin] PATH_INFO: `/v3/users/71c9560a2b1b4fef945ce4817c1b3816` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:44.746502 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa6edcc-b4fb-4e60-b629-41065533af9c None admin] RBAC: Authorizing `identity:get_user(user_id=71c9560a2b1b4fef945ce4817c1b3816)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:44.748102 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa6edcc-b4fb-4e60-b629-41065533af9c None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:44.755104 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 149/303] 10.222.0.36 () {56 vars in 1177 bytes} [Fri Jun 24 22:25:44 2022] GET /identity/v3/users/71c9560a2b1b4fef945ce4817c1b3816 => generated 293 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:44.756960 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0292730-3101-44f7-9040-1ec4d924dae5 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:44.866769 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0292730-3101-44f7-9040-1ec4d924dae5 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:44.876877 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:44.905579 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254b6ad1-612a-443e-8e5d-fe0806b3d80c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:44.906253 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b6ad1-612a-443e-8e5d-fe0806b3d80c None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:44.906537 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b6ad1-612a-443e-8e5d-fe0806b3d80c None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:44.906812 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b6ad1-612a-443e-8e5d-fe0806b3d80c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:44.907697 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254b6ad1-612a-443e-8e5d-fe0806b3d80c None admin] RBAC: Adding query filter params (role.id=c32d1d4e9658499ca095bd31a1fe816d, user.id=71c9560a2b1b4fef945ce4817c1b3816, scope.system=all) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:25:44.908014 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254b6ad1-612a-443e-8e5d-fe0806b3d80c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:44.909485 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254b6ad1-612a-443e-8e5d-fe0806b3d80c None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:44.915502 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 155/304] 10.222.0.36 () {56 vars in 1308 bytes} [Fri Jun 24 22:25:44 2022] GET /identity/v3/role_assignments?user.id=71c9560a2b1b4fef945ce4817c1b3816&scope.system=all&role.id=c32d1d4e9658499ca095bd31a1fe816d => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:45.018232 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb60666-abde-4176-afac-1bbf88356ec3 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:45.018517 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb60666-abde-4176-afac-1bbf88356ec3 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:45.018799 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb60666-abde-4176-afac-1bbf88356ec3 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:45.020517 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 150/305] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:25:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:25:45.029648 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba98dcf-e623-44e9-ad98-d6c2456644dd None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:45.030089 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba98dcf-e623-44e9-ad98-d6c2456644dd None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:45.030488 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba98dcf-e623-44e9-ad98-d6c2456644dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:45.049104 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-bba98dcf-e623-44e9-ad98-d6c2456644dd None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:25:45.050349 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-bba98dcf-e623-44e9-ad98-d6c2456644dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:25:45.128786 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 156/306] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:25:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 22:25:45.151874 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb60666-abde-4176-afac-1bbf88356ec3 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:45.234112 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a53bdd-4ab9-42dd-964b-f4c08fceaedb None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:45.234443 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a53bdd-4ab9-42dd-964b-f4c08fceaedb None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:45.234762 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a53bdd-4ab9-42dd-964b-f4c08fceaedb None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:45.236603 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 157/307] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:25:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 22:25:45.242595 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703366ca-f2b5-4788-a9bc-5a9e60634830 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:45.242961 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703366ca-f2b5-4788-a9bc-5a9e60634830 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:45.243242 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703366ca-f2b5-4788-a9bc-5a9e60634830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:45.262772 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-703366ca-f2b5-4788-a9bc-5a9e60634830 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:25:45.263816 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb60666-abde-4176-afac-1bbf88356ec3 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:45.264003 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-703366ca-f2b5-4788-a9bc-5a9e60634830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:25:45.301041 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe33f70a-f86f-4547-8cb4-818f1d22e9f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:45.301848 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe33f70a-f86f-4547-8cb4-818f1d22e9f9 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:45.302216 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe33f70a-f86f-4547-8cb4-818f1d22e9f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:45.302487 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe33f70a-f86f-4547-8cb4-818f1d22e9f9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:45.314526 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe33f70a-f86f-4547-8cb4-818f1d22e9f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 22:25:45.322571 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-fe33f70a-f86f-4547-8cb4-818f1d22e9f9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 22:25:45.322571 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:25:45.322571 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:25:45.322571 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:25:45.322571 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:25:45.322571 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:25:45.322571 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:25:45.322571 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:25:45.322571 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:25:45.322571 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:25:45.322571 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:25:45.322571 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:25:45.322571 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 22:25:45.322571 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 22:25:45.322571 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 22:25:45.322571 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 22:25:45.323471 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 22:25:45.323471 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 22:25:45.323471 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 22:25:45.323471 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 22:25:45.323471 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:25:45.323471 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:25:45.323471 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:25:45.323471 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:25:45.323471 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:25:45.323471 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:25:45.323471 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:25:45.323471 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:25:45.323471 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:25:45.323471 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:25:45.323471 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:25:45.323471 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:25:45.324260 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:25:45.324260 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:25:45.324260 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:25:45.324260 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:25:45.324260 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 22:25:45.324260 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 22:25:45.324260 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 22:25:45.324260 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 22:25:45.324260 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 22:25:45.324260 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 22:25:45.324260 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 22:25:45.324260 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:25:45.324260 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 151/308] 10.222.0.36 () {56 vars in 1099 bytes} [Fri Jun 24 22:25:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:25:45.333138 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe33f70a-f86f-4547-8cb4-818f1d22e9f9 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:45.359380 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 158/309] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:25:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 22:25:45.363988 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:45.383952 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703366ca-f2b5-4788-a9bc-5a9e60634830 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:45.422961 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:45.490200 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe33f70a-f86f-4547-8cb4-818f1d22e9f9 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:45.518679 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703366ca-f2b5-4788-a9bc-5a9e60634830 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:45.545349 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f446aa-6c2c-4241-a0e6-2824b4c28de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:45.545945 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f446aa-6c2c-4241-a0e6-2824b4c28de0 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:45.546329 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f446aa-6c2c-4241-a0e6-2824b4c28de0 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:45.547521 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f446aa-6c2c-4241-a0e6-2824b4c28de0 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:45.547521 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f446aa-6c2c-4241-a0e6-2824b4c28de0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:25:45.547852 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f446aa-6c2c-4241-a0e6-2824b4c28de0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:45.549363 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f446aa-6c2c-4241-a0e6-2824b4c28de0 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:45.558772 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40be7d5-001c-459b-9acf-caa12ddf5d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:45.559631 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40be7d5-001c-459b-9acf-caa12ddf5d51 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:45.560068 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40be7d5-001c-459b-9acf-caa12ddf5d51 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:45.560352 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40be7d5-001c-459b-9acf-caa12ddf5d51 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:45.563603 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 152/310] 10.222.0.36 () {56 vars in 1101 bytes} [Fri Jun 24 22:25:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:45.565772 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f446aa-6c2c-4241-a0e6-2824b4c28de0 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:45.577973 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40be7d5-001c-459b-9acf-caa12ddf5d51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 22:25:45.586496 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-b40be7d5-001c-459b-9acf-caa12ddf5d51 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 22:25:45.586496 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:25:45.586496 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:25:45.586496 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:25:45.586496 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:25:45.586496 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:25:45.586496 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:25:45.586496 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:25:45.586496 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:25:45.586496 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:25:45.586496 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:25:45.586496 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:25:45.586496 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 22:25:45.586496 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 22:25:45.586496 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 22:25:45.586496 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 22:25:45.588101 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 22:25:45.588101 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 22:25:45.588101 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 22:25:45.588101 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 22:25:45.588101 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:25:45.588101 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:25:45.588101 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:25:45.588101 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:25:45.588101 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:25:45.588101 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:25:45.588101 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:25:45.588101 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:25:45.588101 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:25:45.588101 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:25:45.588101 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:25:45.588101 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:25:45.589927 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:25:45.589927 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:25:45.589927 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:25:45.589927 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:25:45.589927 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 22:25:45.589927 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 22:25:45.589927 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 22:25:45.589927 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 22:25:45.589927 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 22:25:45.589927 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 22:25:45.589927 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 22:25:45.589927 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:25:45.599276 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 159/311] 10.222.0.36 () {56 vars in 1099 bytes} [Fri Jun 24 22:25:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:25:45.599276 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40be7d5-001c-459b-9acf-caa12ddf5d51 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:45.671200 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:45.702157 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:45.708795 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f446aa-6c2c-4241-a0e6-2824b4c28de0 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:45.711315 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40be7d5-001c-459b-9acf-caa12ddf5d51 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:45.753168 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1a8720-360d-4cd0-8f70-9d2e14f035b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:45.753854 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1a8720-360d-4cd0-8f70-9d2e14f035b5 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:45.754138 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1a8720-360d-4cd0-8f70-9d2e14f035b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:45.754418 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1a8720-360d-4cd0-8f70-9d2e14f035b5 None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:45.755182 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1a8720-360d-4cd0-8f70-9d2e14f035b5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:25:45.755550 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1a8720-360d-4cd0-8f70-9d2e14f035b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:45.757342 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1a8720-360d-4cd0-8f70-9d2e14f035b5 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:45.758144 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b727f2d-0902-4127-88ec-3917684a3871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:45.759335 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b727f2d-0902-4127-88ec-3917684a3871 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:45.759845 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b727f2d-0902-4127-88ec-3917684a3871 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:45.760284 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b727f2d-0902-4127-88ec-3917684a3871 None admin] PATH_INFO: `/v3/users/dd4b56cfd9544db588cf2c7c8d59e837` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:45.761728 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b727f2d-0902-4127-88ec-3917684a3871 None admin] RBAC: Authorizing `identity:get_user(user_id=dd4b56cfd9544db588cf2c7c8d59e837)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:45.763367 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b727f2d-0902-4127-88ec-3917684a3871 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:45.771262 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 153/312] 10.222.0.36 () {56 vars in 1177 bytes} [Fri Jun 24 22:25:45 2022] GET /identity/v3/users/dd4b56cfd9544db588cf2c7c8d59e837 => generated 293 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:45.773382 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 160/313] 10.222.0.36 () {56 vars in 1101 bytes} [Fri Jun 24 22:25:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:45.774459 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b727f2d-0902-4127-88ec-3917684a3871 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:45.778353 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1a8720-360d-4cd0-8f70-9d2e14f035b5 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:45.926068 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1a8720-360d-4cd0-8f70-9d2e14f035b5 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:45.931459 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b727f2d-0902-4127-88ec-3917684a3871 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:45.977373 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595abb4c-216d-4d54-84e3-8bed3387bac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:45.978718 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595abb4c-216d-4d54-84e3-8bed3387bac3 None admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:45.979222 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595abb4c-216d-4d54-84e3-8bed3387bac3 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:45.979768 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595abb4c-216d-4d54-84e3-8bed3387bac3 None admin] PATH_INFO: `/v3/system/users/dd4b56cfd9544db588cf2c7c8d59e837/roles/1928787bfcc745419829cd315900ac44` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:45.981692 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595abb4c-216d-4d54-84e3-8bed3387bac3 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=dd4b56cfd9544db588cf2c7c8d59e837, role_id=1928787bfcc745419829cd315900ac44)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:45.983542 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595abb4c-216d-4d54-84e3-8bed3387bac3 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:45.985013 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252b5302-b1c0-42d7-8964-4d0260ec620e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:45.986637 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252b5302-b1c0-42d7-8964-4d0260ec620e None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:45.986924 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252b5302-b1c0-42d7-8964-4d0260ec620e None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:45.987207 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252b5302-b1c0-42d7-8964-4d0260ec620e None admin] PATH_INFO: `/v3/users/5adbeb93775747b5ae3fe33781605b3c` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:45.988643 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252b5302-b1c0-42d7-8964-4d0260ec620e None admin] RBAC: Authorizing `identity:get_user(user_id=5adbeb93775747b5ae3fe33781605b3c)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:45.991544 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252b5302-b1c0-42d7-8964-4d0260ec620e None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:45.999931 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 154/314] 10.222.0.36 () {56 vars in 1177 bytes} [Fri Jun 24 22:25:45 2022] GET /identity/v3/users/5adbeb93775747b5ae3fe33781605b3c => generated 297 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 22:25:46.007283 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252b5302-b1c0-42d7-8964-4d0260ec620e None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:46.007801 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 161/315] 10.222.0.36 () {58 vars in 1334 bytes} [Fri Jun 24 22:25:45 2022] PUT /identity/v3/system/users/dd4b56cfd9544db588cf2c7c8d59e837/roles/1928787bfcc745419829cd315900ac44 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 22:25:46.018899 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:46.139133 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252b5302-b1c0-42d7-8964-4d0260ec620e None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:46.182576 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e9605c-e1b4-4f8e-b36e-942e31cd3122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:46.183203 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e9605c-e1b4-4f8e-b36e-942e31cd3122 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:46.183491 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e9605c-e1b4-4f8e-b36e-942e31cd3122 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:46.183770 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e9605c-e1b4-4f8e-b36e-942e31cd3122 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:46.272971 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e9605c-e1b4-4f8e-b36e-942e31cd3122 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:46.274515 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e9605c-e1b4-4f8e-b36e-942e31cd3122 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:46.288968 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:46.386025 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 155/316] 10.222.0.36 () {58 vars in 1282 bytes} [Fri Jun 24 22:25:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 22:25:46.391808 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595abb4c-216d-4d54-84e3-8bed3387bac3 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:46.412963 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:46.500232 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595abb4c-216d-4d54-84e3-8bed3387bac3 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:46.535228 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e40f44-d155-4907-bc1f-406929f326ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:46.536137 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e40f44-d155-4907-bc1f-406929f326ac None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:46.536418 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e40f44-d155-4907-bc1f-406929f326ac None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:46.536693 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e40f44-d155-4907-bc1f-406929f326ac None admin] PATH_INFO: `/v3/projects/deb0943e980a41b2987f1c69584ddf73` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:46.537887 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e40f44-d155-4907-bc1f-406929f326ac None admin] RBAC: Authorizing `identity:get_project(project_id=deb0943e980a41b2987f1c69584ddf73)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:46.539381 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e40f44-d155-4907-bc1f-406929f326ac None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:46.541647 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 162/317] 10.222.0.36 () {56 vars in 1186 bytes} [Fri Jun 24 22:25:46 2022] GET /identity/v3/projects/deb0943e980a41b2987f1c69584ddf73 => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:46.547376 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e9605c-e1b4-4f8e-b36e-942e31cd3122 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:46.661129 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e9605c-e1b4-4f8e-b36e-942e31cd3122 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:46.675066 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:46.702120 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb2bd29-f672-4866-aefe-e661d3753945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:46.702786 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb2bd29-f672-4866-aefe-e661d3753945 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:46.703069 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb2bd29-f672-4866-aefe-e661d3753945 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:46.703380 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb2bd29-f672-4866-aefe-e661d3753945 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:46.704225 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb2bd29-f672-4866-aefe-e661d3753945 None admin] RBAC: Adding query filter params (role.id=c32d1d4e9658499ca095bd31a1fe816d, scope.project.id=deb0943e980a41b2987f1c69584ddf73, user.id=5adbeb93775747b5ae3fe33781605b3c) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:25:46.704537 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb2bd29-f672-4866-aefe-e661d3753945 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:46.705995 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb2bd29-f672-4866-aefe-e661d3753945 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:46.712969 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 156/318] 10.222.0.36 () {56 vars in 1374 bytes} [Fri Jun 24 22:25:46 2022] GET /identity/v3/role_assignments?user.id=5adbeb93775747b5ae3fe33781605b3c&scope.project.id=deb0943e980a41b2987f1c69584ddf73&role.id=c32d1d4e9658499ca095bd31a1fe816d => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:46.973850 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa077142-b291-4d80-96b0-ea0b8d0889a4 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:46.974231 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa077142-b291-4d80-96b0-ea0b8d0889a4 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:46.974425 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa077142-b291-4d80-96b0-ea0b8d0889a4 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:46.975989 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 163/319] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:25:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:25:46.981311 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ae28a-db62-4046-91fa-e0db0b2547dc None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:46.981608 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ae28a-db62-4046-91fa-e0db0b2547dc None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:46.981886 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ae28a-db62-4046-91fa-e0db0b2547dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:46.999163 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-349ae28a-db62-4046-91fa-e0db0b2547dc None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:25:47.000397 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-349ae28a-db62-4046-91fa-e0db0b2547dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:25:47.071212 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 157/320] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:25:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 22:25:47.093712 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa077142-b291-4d80-96b0-ea0b8d0889a4 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:47.137181 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be0254c-6394-4eeb-a7ee-7e5b1a386250 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:47.137512 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be0254c-6394-4eeb-a7ee-7e5b1a386250 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:47.137734 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be0254c-6394-4eeb-a7ee-7e5b1a386250 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:47.139291 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 158/321] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:25:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 22:25:47.143963 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c246855e-d9dd-47a3-b72c-3294f2f001ce None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:47.144223 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c246855e-d9dd-47a3-b72c-3294f2f001ce None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:47.144530 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c246855e-d9dd-47a3-b72c-3294f2f001ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:47.164054 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-c246855e-d9dd-47a3-b72c-3294f2f001ce None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:25:47.165227 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-c246855e-d9dd-47a3-b72c-3294f2f001ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:25:47.192362 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:47.211035 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa077142-b291-4d80-96b0-ea0b8d0889a4 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:47.243362 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 159/322] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:25:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 22:25:47.249806 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14261f61-ef94-4cdb-be30-c7bedddade0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:47.250610 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14261f61-ef94-4cdb-be30-c7bedddade0f None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:47.250889 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14261f61-ef94-4cdb-be30-c7bedddade0f None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:47.251158 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14261f61-ef94-4cdb-be30-c7bedddade0f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:47.252468 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14261f61-ef94-4cdb-be30-c7bedddade0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:47.253926 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14261f61-ef94-4cdb-be30-c7bedddade0f None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:47.255705 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 164/323] 10.222.0.36 () {56 vars in 1108 bytes} [Fri Jun 24 22:25:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:47.261669 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c246855e-d9dd-47a3-b72c-3294f2f001ce None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:47.264825 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14261f61-ef94-4cdb-be30-c7bedddade0f None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:47.298420 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:47.367515 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c246855e-d9dd-47a3-b72c-3294f2f001ce None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:47.372949 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14261f61-ef94-4cdb-be30-c7bedddade0f None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:47.402763 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557dbb15-85f8-4355-a98b-abe56327f2b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:47.403486 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557dbb15-85f8-4355-a98b-abe56327f2b3 None admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:47.403742 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557dbb15-85f8-4355-a98b-abe56327f2b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:47.404014 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557dbb15-85f8-4355-a98b-abe56327f2b3 None admin] PATH_INFO: `/v3/groups` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:47.404713 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557dbb15-85f8-4355-a98b-abe56327f2b3 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:47.406170 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557dbb15-85f8-4355-a98b-abe56327f2b3 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:47.411073 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4046c1-dab9-47c8-b8b6-abc112020cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:47.412022 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4046c1-dab9-47c8-b8b6-abc112020cc3 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:47.412286 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4046c1-dab9-47c8-b8b6-abc112020cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:47.412626 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4046c1-dab9-47c8-b8b6-abc112020cc3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:47.424282 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4046c1-dab9-47c8-b8b6-abc112020cc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 22:25:47.432709 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-bf4046c1-dab9-47c8-b8b6-abc112020cc3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 22:25:47.432709 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:25:47.432709 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:25:47.432709 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:25:47.432709 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:25:47.432709 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:25:47.432709 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:25:47.432709 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:25:47.432709 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:25:47.432709 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:25:47.432709 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:25:47.432709 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:25:47.432709 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 22:25:47.432709 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 22:25:47.432709 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 22:25:47.432709 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 22:25:47.433683 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 22:25:47.433683 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 22:25:47.433683 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 22:25:47.433683 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 22:25:47.433683 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:25:47.433683 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:25:47.433683 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:25:47.433683 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:25:47.433683 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:25:47.433683 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:25:47.433683 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:25:47.433683 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:25:47.433683 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:25:47.433683 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:25:47.433683 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:25:47.433683 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:25:47.440067 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:25:47.440067 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:25:47.440067 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:25:47.440067 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:25:47.440067 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 22:25:47.440067 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 22:25:47.440067 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 22:25:47.440067 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 22:25:47.440067 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 22:25:47.440067 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 22:25:47.440067 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 22:25:47.440067 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:25:47.440067 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 165/324] 10.222.0.36 () {56 vars in 1099 bytes} [Fri Jun 24 22:25:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 22:25:47.440709 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 160/325] 10.222.0.36 () {60 vars in 1134 bytes} [Fri Jun 24 22:25:47 2022] POST /identity/v3/groups => generated 226 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:25:47.440779 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4046c1-dab9-47c8-b8b6-abc112020cc3 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:47.459607 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:47.552653 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4046c1-dab9-47c8-b8b6-abc112020cc3 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:47.589501 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29887143-2939-4767-a169-1053a4a5d847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:47.590178 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29887143-2939-4767-a169-1053a4a5d847 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:47.591173 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29887143-2939-4767-a169-1053a4a5d847 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:47.591173 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29887143-2939-4767-a169-1053a4a5d847 None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:47.591515 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29887143-2939-4767-a169-1053a4a5d847 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:25:47.591810 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29887143-2939-4767-a169-1053a4a5d847 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:47.593195 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29887143-2939-4767-a169-1053a4a5d847 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:47.602345 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 166/326] 10.222.0.36 () {56 vars in 1101 bytes} [Fri Jun 24 22:25:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 22:25:47.608154 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557dbb15-85f8-4355-a98b-abe56327f2b3 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:47.706935 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:47.714504 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557dbb15-85f8-4355-a98b-abe56327f2b3 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:47.752792 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea130ce4-91cb-4bfb-bea7-3f3938f6d142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:47.753686 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea130ce4-91cb-4bfb-bea7-3f3938f6d142 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:47.753970 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea130ce4-91cb-4bfb-bea7-3f3938f6d142 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:47.754246 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea130ce4-91cb-4bfb-bea7-3f3938f6d142 None admin] PATH_INFO: `/v3/users/71c9560a2b1b4fef945ce4817c1b3816` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:47.755483 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea130ce4-91cb-4bfb-bea7-3f3938f6d142 None admin] RBAC: Authorizing `identity:get_user(user_id=71c9560a2b1b4fef945ce4817c1b3816)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:47.757293 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea130ce4-91cb-4bfb-bea7-3f3938f6d142 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:47.759405 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 161/327] 10.222.0.36 () {56 vars in 1177 bytes} [Fri Jun 24 22:25:47 2022] GET /identity/v3/users/71c9560a2b1b4fef945ce4817c1b3816 => generated 293 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:47.764750 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29887143-2939-4767-a169-1053a4a5d847 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:47.852598 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:47.877987 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29887143-2939-4767-a169-1053a4a5d847 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:47.918983 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af645f15-d556-4ef6-8e87-a5c1850e488a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:47.919884 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af645f15-d556-4ef6-8e87-a5c1850e488a None admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:47.920214 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af645f15-d556-4ef6-8e87-a5c1850e488a None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:47.920488 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af645f15-d556-4ef6-8e87-a5c1850e488a None admin] PATH_INFO: `/v3/system/users/71c9560a2b1b4fef945ce4817c1b3816/roles/c32d1d4e9658499ca095bd31a1fe816d` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:47.922020 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af645f15-d556-4ef6-8e87-a5c1850e488a None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=71c9560a2b1b4fef945ce4817c1b3816, role_id=c32d1d4e9658499ca095bd31a1fe816d)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:47.923458 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af645f15-d556-4ef6-8e87-a5c1850e488a None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:47.934794 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 167/328] 10.222.0.36 () {58 vars in 1334 bytes} [Fri Jun 24 22:25:47 2022] PUT /identity/v3/system/users/71c9560a2b1b4fef945ce4817c1b3816/roles/c32d1d4e9658499ca095bd31a1fe816d => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:25:48.215756 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041cc9f2-0354-4c76-addd-5d3446495105 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:48.216136 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041cc9f2-0354-4c76-addd-5d3446495105 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:48.216315 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041cc9f2-0354-4c76-addd-5d3446495105 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:48.217712 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 162/329] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:25:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:25:48.223233 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a6e840-fe9a-49c4-8cba-b4c3aad93473 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:48.223588 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a6e840-fe9a-49c4-8cba-b4c3aad93473 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:48.223862 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a6e840-fe9a-49c4-8cba-b4c3aad93473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:48.245057 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-96a6e840-fe9a-49c4-8cba-b4c3aad93473 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:25:48.246245 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-96a6e840-fe9a-49c4-8cba-b4c3aad93473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:25:48.328629 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 168/330] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:25:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 22:25:48.354148 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041cc9f2-0354-4c76-addd-5d3446495105 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:48.500172 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041cc9f2-0354-4c76-addd-5d3446495105 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:48.548853 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e61776-3bbd-45c5-8f93-46a0254d5c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:48.550050 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e61776-3bbd-45c5-8f93-46a0254d5c9b None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:48.550540 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e61776-3bbd-45c5-8f93-46a0254d5c9b None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:48.550995 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e61776-3bbd-45c5-8f93-46a0254d5c9b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:48.569072 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e61776-3bbd-45c5-8f93-46a0254d5c9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 22:25:48.577263 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-b7e61776-3bbd-45c5-8f93-46a0254d5c9b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 22:25:48.577263 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:25:48.577263 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:25:48.577263 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:25:48.577263 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:25:48.577263 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:25:48.577263 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:25:48.577263 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:25:48.577263 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:25:48.577263 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:25:48.577263 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:25:48.577263 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:25:48.577263 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 22:25:48.577263 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 22:25:48.577263 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 22:25:48.577263 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 22:25:48.578122 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 22:25:48.578122 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 22:25:48.578122 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 22:25:48.578122 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 22:25:48.578122 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:25:48.578122 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:25:48.578122 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:25:48.578122 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:25:48.578122 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:25:48.578122 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:25:48.578122 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:25:48.578122 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:25:48.578122 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:25:48.578122 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:25:48.578122 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:25:48.578122 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:25:48.578892 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:25:48.578892 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:25:48.578892 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:25:48.578892 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:25:48.578892 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 22:25:48.578892 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 22:25:48.578892 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 22:25:48.578892 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 22:25:48.578892 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 22:25:48.578892 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 22:25:48.578892 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 22:25:48.578892 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:25:48.581560 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 163/331] 10.222.0.36 () {56 vars in 1099 bytes} [Fri Jun 24 22:25:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:25:48.587158 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a6e840-fe9a-49c4-8cba-b4c3aad93473 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:48.667923 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:48.714059 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a6e840-fe9a-49c4-8cba-b4c3aad93473 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:48.758635 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b0b41e-49e2-4d4f-aee5-cc7fbc880fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:48.759317 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b0b41e-49e2-4d4f-aee5-cc7fbc880fac None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:48.759747 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b0b41e-49e2-4d4f-aee5-cc7fbc880fac None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:48.760057 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b0b41e-49e2-4d4f-aee5-cc7fbc880fac None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:48.760842 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b0b41e-49e2-4d4f-aee5-cc7fbc880fac None admin] RBAC: Adding query filter params (name=member) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:25:48.761140 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b0b41e-49e2-4d4f-aee5-cc7fbc880fac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:48.762544 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b0b41e-49e2-4d4f-aee5-cc7fbc880fac None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:48.775619 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 169/332] 10.222.0.36 () {56 vars in 1101 bytes} [Fri Jun 24 22:25:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:48.777214 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e61776-3bbd-45c5-8f93-46a0254d5c9b None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:48.811459 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:48.902210 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e61776-3bbd-45c5-8f93-46a0254d5c9b None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:48.942310 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ce935c-6050-4887-bd21-f5f79e61f009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:48.943787 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ce935c-6050-4887-bd21-f5f79e61f009 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:48.944270 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ce935c-6050-4887-bd21-f5f79e61f009 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:48.944747 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ce935c-6050-4887-bd21-f5f79e61f009 None admin] PATH_INFO: `/v3/users/dd4b56cfd9544db588cf2c7c8d59e837` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:48.946174 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ce935c-6050-4887-bd21-f5f79e61f009 None admin] RBAC: Authorizing `identity:get_user(user_id=dd4b56cfd9544db588cf2c7c8d59e837)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:48.948094 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ce935c-6050-4887-bd21-f5f79e61f009 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:48.950327 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 164/333] 10.222.0.36 () {56 vars in 1177 bytes} [Fri Jun 24 22:25:48 2022] GET /identity/v3/users/dd4b56cfd9544db588cf2c7c8d59e837 => generated 293 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:48.955811 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b0b41e-49e2-4d4f-aee5-cc7fbc880fac None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:49.100610 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b0b41e-49e2-4d4f-aee5-cc7fbc880fac None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:49.136279 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:49.141404 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60bba17-4294-421d-98f9-d49a2be8cd0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:49.142100 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60bba17-4294-421d-98f9-d49a2be8cd0e None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:49.142359 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60bba17-4294-421d-98f9-d49a2be8cd0e None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:49.143044 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60bba17-4294-421d-98f9-d49a2be8cd0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:49.143925 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60bba17-4294-421d-98f9-d49a2be8cd0e None admin] RBAC: Adding query filter params (role.id=1928787bfcc745419829cd315900ac44, user.id=dd4b56cfd9544db588cf2c7c8d59e837, scope.system=all) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:25:49.144252 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60bba17-4294-421d-98f9-d49a2be8cd0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:49.145996 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60bba17-4294-421d-98f9-d49a2be8cd0e None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:49.166599 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 170/334] 10.222.0.36 () {56 vars in 1308 bytes} [Fri Jun 24 22:25:48 2022] GET /identity/v3/role_assignments?user.id=dd4b56cfd9544db588cf2c7c8d59e837&scope.system=all&role.id=1928787bfcc745419829cd315900ac44 => generated 510 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:49.990860 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235a1f61-6dd8-4bf9-91a6-c88e206c7873 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:49.991435 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235a1f61-6dd8-4bf9-91a6-c88e206c7873 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:49.991513 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235a1f61-6dd8-4bf9-91a6-c88e206c7873 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:49.993113 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 165/335] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:25:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:25:49.998358 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7e553b-0b20-454b-bf40-ff7b44786c76 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:49.998763 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7e553b-0b20-454b-bf40-ff7b44786c76 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:49.998928 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7e553b-0b20-454b-bf40-ff7b44786c76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:50.022036 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-0a7e553b-0b20-454b-bf40-ff7b44786c76 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:25:50.023235 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-0a7e553b-0b20-454b-bf40-ff7b44786c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:25:50.108291 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 171/336] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:25:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 22:25:50.134095 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235a1f61-6dd8-4bf9-91a6-c88e206c7873 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:50.240964 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:50.253502 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235a1f61-6dd8-4bf9-91a6-c88e206c7873 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:50.297331 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2d2cfd-255d-4f95-b1c3-b638119bc6e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:50.298138 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2d2cfd-255d-4f95-b1c3-b638119bc6e5 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:50.298418 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2d2cfd-255d-4f95-b1c3-b638119bc6e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:50.298687 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2d2cfd-255d-4f95-b1c3-b638119bc6e5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:50.312650 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2d2cfd-255d-4f95-b1c3-b638119bc6e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 22:25:50.320378 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-6c2d2cfd-255d-4f95-b1c3-b638119bc6e5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 22:25:50.320378 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:25:50.320378 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:25:50.320378 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:25:50.320378 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:25:50.320378 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:25:50.320378 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:25:50.320378 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:25:50.320378 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:25:50.320378 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:25:50.320378 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:25:50.320378 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:25:50.320378 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 22:25:50.320378 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 22:25:50.320378 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 22:25:50.320378 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 22:25:50.321244 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 22:25:50.321244 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 22:25:50.321244 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 22:25:50.321244 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 22:25:50.321244 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:25:50.321244 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:25:50.321244 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:25:50.321244 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:25:50.321244 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:25:50.321244 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:25:50.321244 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:25:50.321244 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:25:50.321244 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:25:50.321244 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:25:50.321244 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:25:50.321244 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:25:50.322179 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:25:50.322179 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:25:50.322179 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:25:50.322179 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:25:50.322179 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 22:25:50.322179 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 22:25:50.322179 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 22:25:50.322179 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 22:25:50.322179 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 22:25:50.322179 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 22:25:50.322179 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 22:25:50.322179 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:25:50.322179 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 166/337] 10.222.0.36 () {56 vars in 1099 bytes} [Fri Jun 24 22:25:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:25:50.327535 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7e553b-0b20-454b-bf40-ff7b44786c76 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:50.440155 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7e553b-0b20-454b-bf40-ff7b44786c76 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:50.465406 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:50.480930 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa53e474-e74d-4558-81da-69eb7b41dd55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:50.481614 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa53e474-e74d-4558-81da-69eb7b41dd55 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:50.481894 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa53e474-e74d-4558-81da-69eb7b41dd55 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:50.482165 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa53e474-e74d-4558-81da-69eb7b41dd55 None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:50.482919 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa53e474-e74d-4558-81da-69eb7b41dd55 None admin] RBAC: Adding query filter params (name=member) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:25:50.483220 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa53e474-e74d-4558-81da-69eb7b41dd55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:50.484634 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa53e474-e74d-4558-81da-69eb7b41dd55 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:50.493741 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 172/338] 10.222.0.36 () {56 vars in 1101 bytes} [Fri Jun 24 22:25:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:50.499588 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2d2cfd-255d-4f95-b1c3-b638119bc6e5 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:50.600401 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce2005e-df42-4e43-aa22-99c9080a3b4a None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:50.600687 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce2005e-df42-4e43-aa22-99c9080a3b4a None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:50.600956 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce2005e-df42-4e43-aa22-99c9080a3b4a None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:50.602594 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 173/339] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:25:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:25:50.607649 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbbbb41-d7e4-49bf-b7ae-9d3ca8d03068 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:50.607930 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbbbb41-d7e4-49bf-b7ae-9d3ca8d03068 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:50.608211 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbbbb41-d7e4-49bf-b7ae-9d3ca8d03068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:50.620090 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2d2cfd-255d-4f95-b1c3-b638119bc6e5 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:50.655157 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-dcbbbb41-d7e4-49bf-b7ae-9d3ca8d03068 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:25:50.656412 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-dcbbbb41-d7e4-49bf-b7ae-9d3ca8d03068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:25:50.666633 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfc38ee-f2c7-4b26-84d0-f049e328abce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:50.667757 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc38ee-f2c7-4b26-84d0-f049e328abce None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:50.668046 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc38ee-f2c7-4b26-84d0-f049e328abce None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:50.668325 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc38ee-f2c7-4b26-84d0-f049e328abce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:50.703679 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:50.775958 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfc38ee-f2c7-4b26-84d0-f049e328abce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:50.777383 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfc38ee-f2c7-4b26-84d0-f049e328abce None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:50.840946 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 174/340] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:25:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 22:25:50.872429 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbbbb41-d7e4-49bf-b7ae-9d3ca8d03068 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:50.916411 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 167/341] 10.222.0.36 () {58 vars in 1282 bytes} [Fri Jun 24 22:25:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 22:25:50.922561 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfc38ee-f2c7-4b26-84d0-f049e328abce None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:51.030403 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbbbb41-d7e4-49bf-b7ae-9d3ca8d03068 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:51.044483 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:51.045899 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:51.073024 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06947fb4-4e64-4dca-9205-4e0212ee6ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:51.074155 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06947fb4-4e64-4dca-9205-4e0212ee6ff9 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:51.074635 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06947fb4-4e64-4dca-9205-4e0212ee6ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:51.075078 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06947fb4-4e64-4dca-9205-4e0212ee6ff9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:51.085786 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06947fb4-4e64-4dca-9205-4e0212ee6ff9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 22:25:51.094336 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-06947fb4-4e64-4dca-9205-4e0212ee6ff9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 22:25:51.094336 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:25:51.094336 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:25:51.094336 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:25:51.094336 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:25:51.094336 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:25:51.094336 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:25:51.094336 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:25:51.094336 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:25:51.094336 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:25:51.094336 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:25:51.094336 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:25:51.094336 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 22:25:51.094336 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 22:25:51.094336 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 22:25:51.094336 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 22:25:51.095228 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 22:25:51.095228 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 22:25:51.095228 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 22:25:51.095228 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 22:25:51.095228 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:25:51.095228 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:25:51.095228 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:25:51.095228 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:25:51.095228 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:25:51.095228 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:25:51.095228 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:25:51.095228 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:25:51.095228 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:25:51.095228 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:25:51.095228 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:25:51.095228 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:25:51.096046 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:25:51.096046 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:25:51.096046 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:25:51.096046 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:25:51.096046 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 22:25:51.096046 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 22:25:51.096046 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 22:25:51.096046 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 22:25:51.096046 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 22:25:51.096046 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 22:25:51.096046 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 22:25:51.096046 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:25:51.098028 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 175/342] 10.222.0.36 () {56 vars in 1114 bytes} [Fri Jun 24 22:25:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:25:51.103492 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664bcd06-ce81-49f5-b8d3-19fefd9dee7e None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:51.103951 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664bcd06-ce81-49f5-b8d3-19fefd9dee7e None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:51.104370 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664bcd06-ce81-49f5-b8d3-19fefd9dee7e None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:51.106121 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 176/343] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:25:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:25:51.107137 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfc38ee-f2c7-4b26-84d0-f049e328abce None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:51.107457 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b79d6e-3b82-482c-be0f-91157d869ff0 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:51.107745 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b79d6e-3b82-482c-be0f-91157d869ff0 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:51.108023 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b79d6e-3b82-482c-be0f-91157d869ff0 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:51.109454 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 177/344] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:25:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:25:51.113433 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b79d6e-3b82-482c-be0f-91157d869ff0 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:51.150526 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d076e63-d33b-45e8-917c-e4a728d4b635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:51.151924 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d076e63-d33b-45e8-917c-e4a728d4b635 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:51.152355 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d076e63-d33b-45e8-917c-e4a728d4b635 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:51.152808 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d076e63-d33b-45e8-917c-e4a728d4b635 None admin] PATH_INFO: `/v3/projects/8130cc4553114edcaa7ac3278c906eed` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:51.154333 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d076e63-d33b-45e8-917c-e4a728d4b635 None admin] RBAC: Authorizing `identity:get_project(project_id=8130cc4553114edcaa7ac3278c906eed)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:51.156301 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d076e63-d33b-45e8-917c-e4a728d4b635 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:51.158811 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 168/345] 10.222.0.36 () {56 vars in 1186 bytes} [Fri Jun 24 22:25:50 2022] GET /identity/v3/projects/8130cc4553114edcaa7ac3278c906eed => generated 298 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 22:25:51.160256 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306a71b3-bc31-43ec-9173-54899a84e374 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:51.160718 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306a71b3-bc31-43ec-9173-54899a84e374 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:51.161167 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306a71b3-bc31-43ec-9173-54899a84e374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:51.181613 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-306a71b3-bc31-43ec-9173-54899a84e374 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:25:51.183118 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-306a71b3-bc31-43ec-9173-54899a84e374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:25:51.239844 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b79d6e-3b82-482c-be0f-91157d869ff0 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:51.281563 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 169/346] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:25:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 22:25:51.283339 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1330b487-7423-43f6-ba63-8098fda20a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:51.284029 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1330b487-7423-43f6-ba63-8098fda20a21 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:51.284314 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1330b487-7423-43f6-ba63-8098fda20a21 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:51.284588 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1330b487-7423-43f6-ba63-8098fda20a21 None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:51.285068 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e76ca66-4ba3-4029-ac3c-4e00dfc9d4c9 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:51.285344 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1330b487-7423-43f6-ba63-8098fda20a21 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:25:51.285657 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1330b487-7423-43f6-ba63-8098fda20a21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:51.286002 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e76ca66-4ba3-4029-ac3c-4e00dfc9d4c9 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:51.286468 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e76ca66-4ba3-4029-ac3c-4e00dfc9d4c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:51.287044 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1330b487-7423-43f6-ba63-8098fda20a21 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:51.304509 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-5e76ca66-4ba3-4029-ac3c-4e00dfc9d4c9 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:25:51.305783 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 178/347] 10.222.0.36 () {56 vars in 1111 bytes} [Fri Jun 24 22:25:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 22:25:51.306492 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-5e76ca66-4ba3-4029-ac3c-4e00dfc9d4c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:25:51.306988 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1330b487-7423-43f6-ba63-8098fda20a21 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:51.353464 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:51.364090 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:51.401606 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 170/348] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:25:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 22:25:51.402481 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e76ca66-4ba3-4029-ac3c-4e00dfc9d4c9 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:51.447144 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1330b487-7423-43f6-ba63-8098fda20a21 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:51.492076 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31f8139-9f15-4a00-aa1b-b6917b8e3acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:51.493839 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31f8139-9f15-4a00-aa1b-b6917b8e3acc None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:51.494123 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31f8139-9f15-4a00-aa1b-b6917b8e3acc None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:51.494403 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31f8139-9f15-4a00-aa1b-b6917b8e3acc None admin] PATH_INFO: `/v3/groups/f3036b8220214ed49774b88ee620ee6c` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:51.503394 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31f8139-9f15-4a00-aa1b-b6917b8e3acc None admin] RBAC: Authorizing `identity:get_group(group_id=f3036b8220214ed49774b88ee620ee6c)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:51.505418 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31f8139-9f15-4a00-aa1b-b6917b8e3acc None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:51.509313 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 179/349] 10.222.0.36 () {56 vars in 1180 bytes} [Fri Jun 24 22:25:51 2022] GET /identity/v3/groups/f3036b8220214ed49774b88ee620ee6c => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:51.510207 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31f8139-9f15-4a00-aa1b-b6917b8e3acc None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:51.532778 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e76ca66-4ba3-4029-ac3c-4e00dfc9d4c9 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:51.571658 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e11fbd9-6fb5-4a6c-b17a-c1b63b1d7092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:51.572901 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e11fbd9-6fb5-4a6c-b17a-c1b63b1d7092 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:51.573253 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e11fbd9-6fb5-4a6c-b17a-c1b63b1d7092 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:51.573603 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e11fbd9-6fb5-4a6c-b17a-c1b63b1d7092 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:51.585207 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e11fbd9-6fb5-4a6c-b17a-c1b63b1d7092 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 22:25:51.593850 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-2e11fbd9-6fb5-4a6c-b17a-c1b63b1d7092 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 22:25:51.593850 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:25:51.593850 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:25:51.593850 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:25:51.593850 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:25:51.593850 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:25:51.593850 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:25:51.593850 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:25:51.593850 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:25:51.593850 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:25:51.593850 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:25:51.593850 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:25:51.593850 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 22:25:51.593850 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 22:25:51.593850 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 22:25:51.593850 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 22:25:51.594851 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 22:25:51.594851 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 22:25:51.594851 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 22:25:51.594851 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 22:25:51.594851 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:25:51.594851 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:25:51.594851 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:25:51.594851 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:25:51.594851 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:25:51.594851 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:25:51.594851 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:25:51.594851 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:25:51.594851 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:25:51.594851 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:25:51.594851 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:25:51.594851 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:25:51.595678 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:25:51.595678 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:25:51.595678 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:25:51.595678 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:25:51.595678 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 22:25:51.595678 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 22:25:51.595678 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 22:25:51.595678 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 22:25:51.595678 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 22:25:51.595678 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 22:25:51.595678 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 22:25:51.595678 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:25:51.595678 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 171/350] 10.222.0.36 () {56 vars in 1099 bytes} [Fri Jun 24 22:25:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:25:51.596441 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e11fbd9-6fb5-4a6c-b17a-c1b63b1d7092 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:51.625318 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:51.630284 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31f8139-9f15-4a00-aa1b-b6917b8e3acc None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:51.652879 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:51.671343 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f6434f-a663-40ce-b5d2-072ca5d500d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:51.672453 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f6434f-a663-40ce-b5d2-072ca5d500d5 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:51.672831 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f6434f-a663-40ce-b5d2-072ca5d500d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:51.673204 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f6434f-a663-40ce-b5d2-072ca5d500d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:51.715901 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e11fbd9-6fb5-4a6c-b17a-c1b63b1d7092 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:51.756402 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f6434f-a663-40ce-b5d2-072ca5d500d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:51.757986 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f6434f-a663-40ce-b5d2-072ca5d500d5 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:51.764550 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea5f801-172a-4585-b793-3605c51bcc58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:51.765657 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea5f801-172a-4585-b793-3605c51bcc58 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:51.766223 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea5f801-172a-4585-b793-3605c51bcc58 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:51.766701 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea5f801-172a-4585-b793-3605c51bcc58 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:51.782262 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea5f801-172a-4585-b793-3605c51bcc58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 22:25:51.792628 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-9ea5f801-172a-4585-b793-3605c51bcc58 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 22:25:51.792628 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:25:51.792628 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:25:51.792628 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:25:51.792628 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:25:51.792628 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:25:51.792628 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:25:51.792628 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:25:51.792628 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:25:51.792628 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:25:51.792628 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:25:51.792628 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:25:51.792628 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 22:25:51.792628 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 22:25:51.792628 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 22:25:51.792628 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 22:25:51.793502 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 22:25:51.793502 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 22:25:51.793502 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 22:25:51.793502 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 22:25:51.793502 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:25:51.793502 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:25:51.793502 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:25:51.793502 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:25:51.793502 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:25:51.793502 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:25:51.793502 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:25:51.793502 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:25:51.793502 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:25:51.793502 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:25:51.793502 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:25:51.793502 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:25:51.794292 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:25:51.794292 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:25:51.794292 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:25:51.794292 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:25:51.794292 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 22:25:51.794292 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 22:25:51.794292 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 22:25:51.794292 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 22:25:51.794292 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 22:25:51.794292 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 22:25:51.794292 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 22:25:51.794292 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:25:51.796885 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 172/351] 10.222.0.36 () {56 vars in 1099 bytes} [Fri Jun 24 22:25:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:25:51.797996 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea5f801-172a-4585-b793-3605c51bcc58 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:51.870735 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:51.876352 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 180/352] 10.222.0.36 () {58 vars in 1282 bytes} [Fri Jun 24 22:25:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 22:25:51.877167 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f6434f-a663-40ce-b5d2-072ca5d500d5 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:51.919671 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:51.924544 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea5f801-172a-4585-b793-3605c51bcc58 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:51.964720 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431209ca-524d-4e01-8ddd-a8b7fd3bcbc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:51.965546 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431209ca-524d-4e01-8ddd-a8b7fd3bcbc9 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:51.965928 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431209ca-524d-4e01-8ddd-a8b7fd3bcbc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:51.966323 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431209ca-524d-4e01-8ddd-a8b7fd3bcbc9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:51.967286 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431209ca-524d-4e01-8ddd-a8b7fd3bcbc9 None admin] RBAC: Adding query filter params (group.id=f3036b8220214ed49774b88ee620ee6c, role.id=1928787bfcc745419829cd315900ac44, scope.project.id=8130cc4553114edcaa7ac3278c906eed) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:25:51.967773 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431209ca-524d-4e01-8ddd-a8b7fd3bcbc9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:51.969346 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431209ca-524d-4e01-8ddd-a8b7fd3bcbc9 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:51.975600 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 173/353] 10.222.0.36 () {56 vars in 1376 bytes} [Fri Jun 24 22:25:51 2022] GET /identity/v3/role_assignments?group.id=f3036b8220214ed49774b88ee620ee6c&scope.project.id=8130cc4553114edcaa7ac3278c906eed&role.id=1928787bfcc745419829cd315900ac44 => generated 260 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:51.976599 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431209ca-524d-4e01-8ddd-a8b7fd3bcbc9 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:52.002186 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f6434f-a663-40ce-b5d2-072ca5d500d5 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:52.078458 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b542d7c-4534-48b8-9e40-a97f44d85455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:52.079883 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b542d7c-4534-48b8-9e40-a97f44d85455 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:52.081399 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b542d7c-4534-48b8-9e40-a97f44d85455 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:52.081837 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b542d7c-4534-48b8-9e40-a97f44d85455 None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:52.085989 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b542d7c-4534-48b8-9e40-a97f44d85455 None admin] RBAC: Adding query filter params (name=member) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:25:52.086545 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b542d7c-4534-48b8-9e40-a97f44d85455 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:52.088273 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b542d7c-4534-48b8-9e40-a97f44d85455 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:52.104739 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 181/354] 10.222.0.36 () {56 vars in 1101 bytes} [Fri Jun 24 22:25:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:52.107141 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b542d7c-4534-48b8-9e40-a97f44d85455 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:52.181827 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431209ca-524d-4e01-8ddd-a8b7fd3bcbc9 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:52.199703 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:52.231859 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161f3543-0fda-46d0-8509-836332de941d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:52.232552 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161f3543-0fda-46d0-8509-836332de941d None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:52.232838 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161f3543-0fda-46d0-8509-836332de941d None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:52.233293 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161f3543-0fda-46d0-8509-836332de941d None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:52.234400 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161f3543-0fda-46d0-8509-836332de941d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:25:52.234717 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161f3543-0fda-46d0-8509-836332de941d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:52.236149 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161f3543-0fda-46d0-8509-836332de941d None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:52.249659 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 174/355] 10.222.0.36 () {56 vars in 1101 bytes} [Fri Jun 24 22:25:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:52.250524 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161f3543-0fda-46d0-8509-836332de941d None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:52.250651 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b542d7c-4534-48b8-9e40-a97f44d85455 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:52.291893 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:52.305433 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd8bbdb-3126-4386-aed9-1c975259118e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:52.306349 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd8bbdb-3126-4386-aed9-1c975259118e None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:52.306710 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd8bbdb-3126-4386-aed9-1c975259118e None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:52.306989 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd8bbdb-3126-4386-aed9-1c975259118e None admin] PATH_INFO: `/v3/projects/8130cc4553114edcaa7ac3278c906eed` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:52.308267 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd8bbdb-3126-4386-aed9-1c975259118e None admin] RBAC: Authorizing `identity:get_project(project_id=8130cc4553114edcaa7ac3278c906eed)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:52.309735 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd8bbdb-3126-4386-aed9-1c975259118e None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:52.311489 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 182/356] 10.222.0.36 () {56 vars in 1186 bytes} [Fri Jun 24 22:25:52 2022] GET /identity/v3/projects/8130cc4553114edcaa7ac3278c906eed => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:52.312847 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dc40df-b9d8-4737-8d91-e1383c7b8a50 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:52.313134 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dc40df-b9d8-4737-8d91-e1383c7b8a50 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:52.313412 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dc40df-b9d8-4737-8d91-e1383c7b8a50 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:52.314647 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 183/357] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:25:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:25:52.317415 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dc40df-b9d8-4737-8d91-e1383c7b8a50 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:52.398610 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161f3543-0fda-46d0-8509-836332de941d None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:52.434932 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e4fff8-9729-42b1-a631-2fd9467be1fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:52.435668 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e4fff8-9729-42b1-a631-2fd9467be1fb None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:52.435949 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e4fff8-9729-42b1-a631-2fd9467be1fb None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:52.436237 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e4fff8-9729-42b1-a631-2fd9467be1fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:52.445376 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dc40df-b9d8-4737-8d91-e1383c7b8a50 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:52.472972 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:52.486475 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6881a508-8b4c-433d-aef6-c56cc4cc4427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:52.487885 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6881a508-8b4c-433d-aef6-c56cc4cc4427 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:52.488168 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6881a508-8b4c-433d-aef6-c56cc4cc4427 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:52.488442 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6881a508-8b4c-433d-aef6-c56cc4cc4427 None admin] PATH_INFO: `/v3/users/71c9560a2b1b4fef945ce4817c1b3816` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:52.489744 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6881a508-8b4c-433d-aef6-c56cc4cc4427 None admin] RBAC: Authorizing `identity:get_user(user_id=71c9560a2b1b4fef945ce4817c1b3816)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:52.491807 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6881a508-8b4c-433d-aef6-c56cc4cc4427 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:52.494333 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 184/358] 10.222.0.36 () {56 vars in 1177 bytes} [Fri Jun 24 22:25:52 2022] GET /identity/v3/users/71c9560a2b1b4fef945ce4817c1b3816 => generated 293 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:52.495707 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6881a508-8b4c-433d-aef6-c56cc4cc4427 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:52.530474 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e4fff8-9729-42b1-a631-2fd9467be1fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:52.532120 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e4fff8-9729-42b1-a631-2fd9467be1fb None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:52.563354 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:52.628237 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6881a508-8b4c-433d-aef6-c56cc4cc4427 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:52.660077 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 175/359] 10.222.0.36 () {58 vars in 1282 bytes} [Fri Jun 24 22:25:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 22:25:52.662376 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5feedeb-b323-4201-b977-6b4441610304 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:52.662827 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5feedeb-b323-4201-b977-6b4441610304 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:52.663526 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5feedeb-b323-4201-b977-6b4441610304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:52.674207 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9538f6b8-cc12-42c3-8f44-d1b03236bbbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:52.675092 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9538f6b8-cc12-42c3-8f44-d1b03236bbbb None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:52.675404 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9538f6b8-cc12-42c3-8f44-d1b03236bbbb None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:52.675680 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9538f6b8-cc12-42c3-8f44-d1b03236bbbb None admin] PATH_INFO: `/v3/groups/f3036b8220214ed49774b88ee620ee6c` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:52.677383 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9538f6b8-cc12-42c3-8f44-d1b03236bbbb None admin] RBAC: Authorizing `identity:get_group(group_id=f3036b8220214ed49774b88ee620ee6c)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:52.678847 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9538f6b8-cc12-42c3-8f44-d1b03236bbbb None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:52.683418 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 185/360] 10.222.0.36 () {56 vars in 1180 bytes} [Fri Jun 24 22:25:52 2022] GET /identity/v3/groups/f3036b8220214ed49774b88ee620ee6c => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:52.684238 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9538f6b8-cc12-42c3-8f44-d1b03236bbbb None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:52.688242 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-f5feedeb-b323-4201-b977-6b4441610304 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:25:52.689433 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-f5feedeb-b323-4201-b977-6b4441610304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:25:52.770428 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:52.777857 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 176/361] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:25:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 22:25:52.779014 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c878c-ad9d-4b34-9b61-27ceb9e073b4 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:52.779323 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c878c-ad9d-4b34-9b61-27ceb9e073b4 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:52.779858 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c878c-ad9d-4b34-9b61-27ceb9e073b4 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:52.781523 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 177/362] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:25:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:25:52.782412 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29c878c-ad9d-4b34-9b61-27ceb9e073b4 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:52.817455 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9538f6b8-cc12-42c3-8f44-d1b03236bbbb None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:52.860810 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:52.863366 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397862d6-d97e-4c04-9a19-a553ea4ce051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:52.864263 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397862d6-d97e-4c04-9a19-a553ea4ce051 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:52.864713 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397862d6-d97e-4c04-9a19-a553ea4ce051 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:52.864979 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397862d6-d97e-4c04-9a19-a553ea4ce051 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:52.865829 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397862d6-d97e-4c04-9a19-a553ea4ce051 None admin] RBAC: Adding query filter params (role.id=c32d1d4e9658499ca095bd31a1fe816d, user.id=71c9560a2b1b4fef945ce4817c1b3816, scope.system=all) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:25:52.866139 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397862d6-d97e-4c04-9a19-a553ea4ce051 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:52.867959 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397862d6-d97e-4c04-9a19-a553ea4ce051 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:52.884329 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 186/363] 10.222.0.36 () {56 vars in 1308 bytes} [Fri Jun 24 22:25:52 2022] GET /identity/v3/role_assignments?user.id=71c9560a2b1b4fef945ce4817c1b3816&scope.system=all&role.id=c32d1d4e9658499ca095bd31a1fe816d => generated 510 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:52.885194 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397862d6-d97e-4c04-9a19-a553ea4ce051 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:52.934369 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29c878c-ad9d-4b34-9b61-27ceb9e073b4 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:52.983873 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fac564d-cb1f-4c50-9865-65bc8d5fb75d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:52.985350 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fac564d-cb1f-4c50-9865-65bc8d5fb75d None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:52.985634 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fac564d-cb1f-4c50-9865-65bc8d5fb75d None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:52.985912 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fac564d-cb1f-4c50-9865-65bc8d5fb75d None admin] PATH_INFO: `/v3/projects/deb0943e980a41b2987f1c69584ddf73` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:52.987322 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fac564d-cb1f-4c50-9865-65bc8d5fb75d None admin] RBAC: Authorizing `identity:get_project(project_id=deb0943e980a41b2987f1c69584ddf73)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:52.989352 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fac564d-cb1f-4c50-9865-65bc8d5fb75d None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:52.992590 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 178/364] 10.222.0.36 () {56 vars in 1186 bytes} [Fri Jun 24 22:25:52 2022] GET /identity/v3/projects/deb0943e980a41b2987f1c69584ddf73 => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:52.997834 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b07c38a-7b0f-4e6c-871c-d356b6c2a487 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:52.997834 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b07c38a-7b0f-4e6c-871c-d356b6c2a487 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:52.997834 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b07c38a-7b0f-4e6c-871c-d356b6c2a487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:53.020362 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-7b07c38a-7b0f-4e6c-871c-d356b6c2a487 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:25:53.022280 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-7b07c38a-7b0f-4e6c-871c-d356b6c2a487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:25:53.026288 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397862d6-d97e-4c04-9a19-a553ea4ce051 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:53.054609 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:53.069564 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6499587-067d-4820-90a7-578805b3d2a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:53.070668 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6499587-067d-4820-90a7-578805b3d2a1 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:53.071154 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6499587-067d-4820-90a7-578805b3d2a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:53.071694 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6499587-067d-4820-90a7-578805b3d2a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:53.073013 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6499587-067d-4820-90a7-578805b3d2a1 None admin] RBAC: Adding query filter params (group.id=f3036b8220214ed49774b88ee620ee6c, role.id=bf32f251a7764c7188fd782b65275038, scope.project.id=8130cc4553114edcaa7ac3278c906eed) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:25:53.073538 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6499587-067d-4820-90a7-578805b3d2a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:53.075439 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6499587-067d-4820-90a7-578805b3d2a1 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:53.084486 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 187/365] 10.222.0.36 () {56 vars in 1376 bytes} [Fri Jun 24 22:25:52 2022] GET /identity/v3/role_assignments?group.id=f3036b8220214ed49774b88ee620ee6c&scope.project.id=8130cc4553114edcaa7ac3278c906eed&role.id=bf32f251a7764c7188fd782b65275038 => generated 260 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:53.086138 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6499587-067d-4820-90a7-578805b3d2a1 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:53.104764 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 179/366] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:25:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 22:25:53.107806 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b07c38a-7b0f-4e6c-871c-d356b6c2a487 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:53.173403 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:53.214970 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6499587-067d-4820-90a7-578805b3d2a1 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:53.231921 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b07c38a-7b0f-4e6c-871c-d356b6c2a487 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:53.252707 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2be2ed-00de-4833-8c8f-dfd0ad4170c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:53.254510 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2be2ed-00de-4833-8c8f-dfd0ad4170c3 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:53.254510 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2be2ed-00de-4833-8c8f-dfd0ad4170c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:53.254510 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2be2ed-00de-4833-8c8f-dfd0ad4170c3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:53.267099 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2be2ed-00de-4833-8c8f-dfd0ad4170c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 22:25:53.275683 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-1c2be2ed-00de-4833-8c8f-dfd0ad4170c3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 22:25:53.275683 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:25:53.275683 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:25:53.275683 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:25:53.275683 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:25:53.275683 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:25:53.275683 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:25:53.275683 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:25:53.275683 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:25:53.275683 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:25:53.275683 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:25:53.275683 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:25:53.275683 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 22:25:53.275683 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 22:25:53.275683 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 22:25:53.275683 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 22:25:53.276705 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 22:25:53.276705 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 22:25:53.276705 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 22:25:53.276705 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 22:25:53.276705 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:25:53.276705 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:25:53.276705 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:25:53.276705 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:25:53.276705 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:25:53.276705 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:25:53.276705 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:25:53.276705 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:25:53.276705 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:25:53.276705 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:25:53.276705 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:25:53.276705 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:25:53.277578 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:25:53.277578 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:25:53.277578 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:25:53.277578 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:25:53.277578 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 22:25:53.277578 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 22:25:53.277578 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 22:25:53.277578 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 22:25:53.277578 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 22:25:53.277578 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 22:25:53.277578 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 22:25:53.277578 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:25:53.277578 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 188/367] 10.222.0.36 () {56 vars in 1114 bytes} [Fri Jun 24 22:25:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:25:53.278279 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2be2ed-00de-4833-8c8f-dfd0ad4170c3 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:53.292329 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f4f7eb-05ff-4447-b0ff-9b8bf98e0496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:53.293422 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f4f7eb-05ff-4447-b0ff-9b8bf98e0496 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:53.293802 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f4f7eb-05ff-4447-b0ff-9b8bf98e0496 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:53.294172 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f4f7eb-05ff-4447-b0ff-9b8bf98e0496 None admin] PATH_INFO: `/v3/groups/f3036b8220214ed49774b88ee620ee6c` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:53.296253 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f4f7eb-05ff-4447-b0ff-9b8bf98e0496 None admin] RBAC: Authorizing `identity:get_group(group_id=f3036b8220214ed49774b88ee620ee6c)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:53.297964 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f4f7eb-05ff-4447-b0ff-9b8bf98e0496 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:53.307379 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 180/368] 10.222.0.36 () {56 vars in 1180 bytes} [Fri Jun 24 22:25:53 2022] GET /identity/v3/groups/f3036b8220214ed49774b88ee620ee6c => generated 226 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:53.307379 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f4f7eb-05ff-4447-b0ff-9b8bf98e0496 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:53.355031 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:53.434983 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f4f7eb-05ff-4447-b0ff-9b8bf98e0496 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:53.439218 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2be2ed-00de-4833-8c8f-dfd0ad4170c3 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:53.456959 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:53.473245 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8cccc2-519a-4d27-a37a-0b26e791ff4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:53.473847 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8cccc2-519a-4d27-a37a-0b26e791ff4a None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:53.474132 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8cccc2-519a-4d27-a37a-0b26e791ff4a None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:53.474408 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8cccc2-519a-4d27-a37a-0b26e791ff4a None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:53.475315 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8cccc2-519a-4d27-a37a-0b26e791ff4a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:25:53.475734 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8cccc2-519a-4d27-a37a-0b26e791ff4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:53.477243 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8cccc2-519a-4d27-a37a-0b26e791ff4a None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:53.478247 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccd3417-7cfc-4b3a-ac17-db33bf34df5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:53.478978 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccd3417-7cfc-4b3a-ac17-db33bf34df5c None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:53.479285 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccd3417-7cfc-4b3a-ac17-db33bf34df5c None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:53.479664 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccd3417-7cfc-4b3a-ac17-db33bf34df5c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:53.486781 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 181/369] 10.222.0.36 () {56 vars in 1111 bytes} [Fri Jun 24 22:25:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:53.490767 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccd3417-7cfc-4b3a-ac17-db33bf34df5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 22:25:53.491860 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8cccc2-519a-4d27-a37a-0b26e791ff4a None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:53.499901 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-7ccd3417-7cfc-4b3a-ac17-db33bf34df5c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 22:25:53.499901 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:25:53.499901 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:25:53.499901 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:25:53.499901 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:25:53.499901 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:25:53.499901 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:25:53.499901 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:25:53.499901 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:25:53.499901 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:25:53.499901 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:25:53.499901 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:25:53.499901 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 22:25:53.499901 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 22:25:53.499901 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 22:25:53.499901 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 22:25:53.500798 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 22:25:53.500798 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 22:25:53.500798 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 22:25:53.500798 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 22:25:53.500798 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:25:53.500798 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:25:53.500798 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:25:53.500798 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:25:53.500798 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:25:53.500798 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:25:53.500798 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:25:53.500798 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:25:53.500798 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:25:53.500798 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:25:53.500798 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:25:53.500798 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:25:53.502161 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:25:53.502161 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:25:53.502161 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:25:53.502161 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:25:53.502161 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 22:25:53.502161 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 22:25:53.502161 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 22:25:53.502161 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 22:25:53.502161 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 22:25:53.502161 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 22:25:53.502161 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 22:25:53.502161 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:25:53.502161 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 189/370] 10.222.0.36 () {56 vars in 1096 bytes} [Fri Jun 24 22:25:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:25:53.503284 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccd3417-7cfc-4b3a-ac17-db33bf34df5c None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:53.596526 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8cccc2-519a-4d27-a37a-0b26e791ff4a None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:53.612939 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccd3417-7cfc-4b3a-ac17-db33bf34df5c None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:53.620959 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:53.635088 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0ac876-6756-4a59-8ca2-0b760888817b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:53.635552 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ac876-6756-4a59-8ca2-0b760888817b None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:53.635840 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ac876-6756-4a59-8ca2-0b760888817b None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:53.636124 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ac876-6756-4a59-8ca2-0b760888817b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:53.636970 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0ac876-6756-4a59-8ca2-0b760888817b None admin] RBAC: Adding query filter params (group.id=f3036b8220214ed49774b88ee620ee6c, role.id=1928787bfcc745419829cd315900ac44, scope.project.id=deb0943e980a41b2987f1c69584ddf73) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:25:53.637288 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0ac876-6756-4a59-8ca2-0b760888817b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:53.638754 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0ac876-6756-4a59-8ca2-0b760888817b None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:53.644989 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 182/371] 10.222.0.36 () {56 vars in 1376 bytes} [Fri Jun 24 22:25:53 2022] GET /identity/v3/role_assignments?group.id=f3036b8220214ed49774b88ee620ee6c&scope.project.id=deb0943e980a41b2987f1c69584ddf73&role.id=1928787bfcc745419829cd315900ac44 => generated 260 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:53.645790 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0ac876-6756-4a59-8ca2-0b760888817b None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:53.655622 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4968287-930b-42d1-8e4f-97fa1e16b4d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:53.656297 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4968287-930b-42d1-8e4f-97fa1e16b4d1 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:53.656578 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4968287-930b-42d1-8e4f-97fa1e16b4d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:53.656852 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4968287-930b-42d1-8e4f-97fa1e16b4d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:53.710466 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:53.736406 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4968287-930b-42d1-8e4f-97fa1e16b4d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:53.737837 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4968287-930b-42d1-8e4f-97fa1e16b4d1 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:53.781944 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0ac876-6756-4a59-8ca2-0b760888817b None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:53.820698 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dcf3c8-5257-487d-9c31-dedeb0b261e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:53.821397 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dcf3c8-5257-487d-9c31-dedeb0b261e5 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:53.821705 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dcf3c8-5257-487d-9c31-dedeb0b261e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:53.822018 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dcf3c8-5257-487d-9c31-dedeb0b261e5 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:53.822801 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dcf3c8-5257-487d-9c31-dedeb0b261e5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:25:53.823110 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dcf3c8-5257-487d-9c31-dedeb0b261e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:53.824685 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dcf3c8-5257-487d-9c31-dedeb0b261e5 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:53.834391 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 183/372] 10.222.0.36 () {56 vars in 1099 bytes} [Fri Jun 24 22:25:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:53.840141 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dcf3c8-5257-487d-9c31-dedeb0b261e5 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:53.853824 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 190/373] 10.222.0.36 () {58 vars in 1282 bytes} [Fri Jun 24 22:25:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 22:25:53.859461 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4968287-930b-42d1-8e4f-97fa1e16b4d1 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:53.868564 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:53.956056 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dcf3c8-5257-487d-9c31-dedeb0b261e5 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:53.968471 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:53.978383 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4968287-930b-42d1-8e4f-97fa1e16b4d1 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:53.994827 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7c3c05-8f99-499e-869a-451109f2f8e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:53.995469 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7c3c05-8f99-499e-869a-451109f2f8e8 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:53.995757 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7c3c05-8f99-499e-869a-451109f2f8e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:53.996035 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7c3c05-8f99-499e-869a-451109f2f8e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:54.017466 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0b9c69-fa97-4671-b98e-23e4c4a5df38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:54.018355 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0b9c69-fa97-4671-b98e-23e4c4a5df38 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:54.018355 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0b9c69-fa97-4671-b98e-23e4c4a5df38 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:54.019087 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0b9c69-fa97-4671-b98e-23e4c4a5df38 None admin] PATH_INFO: `/v3/projects/deb0943e980a41b2987f1c69584ddf73` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:54.020217 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0b9c69-fa97-4671-b98e-23e4c4a5df38 None admin] RBAC: Authorizing `identity:get_project(project_id=deb0943e980a41b2987f1c69584ddf73)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:54.021822 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0b9c69-fa97-4671-b98e-23e4c4a5df38 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:54.024123 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 191/374] 10.222.0.36 () {56 vars in 1186 bytes} [Fri Jun 24 22:25:53 2022] GET /identity/v3/projects/deb0943e980a41b2987f1c69584ddf73 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:54.031553 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0b9c69-fa97-4671-b98e-23e4c4a5df38 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:54.116131 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7c3c05-8f99-499e-869a-451109f2f8e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:54.117863 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7c3c05-8f99-499e-869a-451109f2f8e8 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:54.137228 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:54.167913 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0b9c69-fa97-4671-b98e-23e4c4a5df38 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:54.206785 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8c2ed4-96bf-46ac-aa60-236732c3430d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:54.208063 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c2ed4-96bf-46ac-aa60-236732c3430d None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:54.208565 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c2ed4-96bf-46ac-aa60-236732c3430d None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:54.209022 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c2ed4-96bf-46ac-aa60-236732c3430d None admin] PATH_INFO: `/v3/groups/f3036b8220214ed49774b88ee620ee6c` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:54.210445 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8c2ed4-96bf-46ac-aa60-236732c3430d None admin] RBAC: Authorizing `identity:get_group(group_id=f3036b8220214ed49774b88ee620ee6c)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:54.212651 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8c2ed4-96bf-46ac-aa60-236732c3430d None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:54.214858 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 192/375] 10.222.0.36 () {56 vars in 1180 bytes} [Fri Jun 24 22:25:54 2022] GET /identity/v3/groups/f3036b8220214ed49774b88ee620ee6c => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 22:25:54.224164 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8c2ed4-96bf-46ac-aa60-236732c3430d None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:54.346274 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8c2ed4-96bf-46ac-aa60-236732c3430d None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:54.382730 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 184/376] 10.222.0.36 () {58 vars in 1282 bytes} [Fri Jun 24 22:25:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 24 22:25:54.384989 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa4291c-5195-481a-a239-f524a4175972 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:54.385473 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa4291c-5195-481a-a239-f524a4175972 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:54.385951 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa4291c-5195-481a-a239-f524a4175972 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:54.387806 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 185/377] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:25:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:25:54.388801 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa4291c-5195-481a-a239-f524a4175972 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:54.403772 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:54.410081 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3efd78-b30a-45e6-bc63-d11df40a2f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:54.410962 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3efd78-b30a-45e6-bc63-d11df40a2f1f None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:54.411448 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3efd78-b30a-45e6-bc63-d11df40a2f1f None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:54.411878 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3efd78-b30a-45e6-bc63-d11df40a2f1f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:54.412981 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3efd78-b30a-45e6-bc63-d11df40a2f1f None admin] RBAC: Adding query filter params (group.id=f3036b8220214ed49774b88ee620ee6c, role.id=bf32f251a7764c7188fd782b65275038, scope.project.id=deb0943e980a41b2987f1c69584ddf73) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:25:54.413438 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3efd78-b30a-45e6-bc63-d11df40a2f1f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:54.415173 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3efd78-b30a-45e6-bc63-d11df40a2f1f None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:54.423188 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 193/378] 10.222.0.36 () {56 vars in 1376 bytes} [Fri Jun 24 22:25:54 2022] GET /identity/v3/role_assignments?group.id=f3036b8220214ed49774b88ee620ee6c&scope.project.id=deb0943e980a41b2987f1c69584ddf73&role.id=bf32f251a7764c7188fd782b65275038 => generated 260 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 22:25:54.424823 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae23154-2adb-40dd-8b49-5c115a228a41 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:54.425325 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae23154-2adb-40dd-8b49-5c115a228a41 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:54.425780 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae23154-2adb-40dd-8b49-5c115a228a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:54.451615 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:54.464541 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-bae23154-2adb-40dd-8b49-5c115a228a41 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:25:54.465884 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-bae23154-2adb-40dd-8b49-5c115a228a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:25:54.530500 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa4291c-5195-481a-a239-f524a4175972 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:54.572286 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0fd45b-928c-4638-b3cb-3bbfa1b3bbda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:54.573756 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0fd45b-928c-4638-b3cb-3bbfa1b3bbda None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:54.574251 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0fd45b-928c-4638-b3cb-3bbfa1b3bbda None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:54.574731 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0fd45b-928c-4638-b3cb-3bbfa1b3bbda None admin] PATH_INFO: `/v3/projects/ed521bc1cbbe4ae1823626f007bced73` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:54.576344 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0fd45b-928c-4638-b3cb-3bbfa1b3bbda None admin] RBAC: Authorizing `identity:get_project(project_id=ed521bc1cbbe4ae1823626f007bced73)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:54.578217 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0fd45b-928c-4638-b3cb-3bbfa1b3bbda None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:54.580737 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 186/379] 10.222.0.36 () {56 vars in 1186 bytes} [Fri Jun 24 22:25:54 2022] GET /identity/v3/projects/ed521bc1cbbe4ae1823626f007bced73 => generated 344 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:54.584989 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 194/380] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:25:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 22:25:54.585934 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0fd45b-928c-4638-b3cb-3bbfa1b3bbda None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:54.616221 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae23154-2adb-40dd-8b49-5c115a228a41 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:54.736242 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:54.782367 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae23154-2adb-40dd-8b49-5c115a228a41 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:54.817217 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0fd45b-928c-4638-b3cb-3bbfa1b3bbda None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:54.827425 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a80581-09c1-49a5-b982-22716e949a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:54.828273 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a80581-09c1-49a5-b982-22716e949a17 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:54.829006 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a80581-09c1-49a5-b982-22716e949a17 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:54.829295 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a80581-09c1-49a5-b982-22716e949a17 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:54.835563 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:54.853837 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a80581-09c1-49a5-b982-22716e949a17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 22:25:54.864302 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-c3a80581-09c1-49a5-b982-22716e949a17 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 22:25:54.864302 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:25:54.864302 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:25:54.864302 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:25:54.864302 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:25:54.864302 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:25:54.864302 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:25:54.864302 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:25:54.864302 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:25:54.864302 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:25:54.864302 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:25:54.864302 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:25:54.864302 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 22:25:54.864302 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 22:25:54.864302 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 22:25:54.864302 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 22:25:54.865253 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 22:25:54.865253 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 22:25:54.865253 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 22:25:54.865253 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 22:25:54.865253 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:25:54.865253 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:25:54.865253 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:25:54.865253 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:25:54.865253 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:25:54.865253 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:25:54.865253 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:25:54.865253 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:25:54.865253 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:25:54.865253 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:25:54.865253 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:25:54.865253 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:25:54.866024 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:25:54.866024 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:25:54.866024 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:25:54.866024 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:25:54.866024 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 22:25:54.866024 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 22:25:54.866024 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 22:25:54.866024 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 22:25:54.866024 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 22:25:54.866024 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 22:25:54.866024 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 22:25:54.866024 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:25:54.875453 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 195/381] 10.222.0.36 () {56 vars in 1099 bytes} [Fri Jun 24 22:25:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 22:25:54.876320 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a80581-09c1-49a5-b982-22716e949a17 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:54.882730 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d93041-d040-45a2-b285-04cd8f1f13ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:54.883655 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d93041-d040-45a2-b285-04cd8f1f13ce None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:54.883939 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d93041-d040-45a2-b285-04cd8f1f13ce None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:54.884572 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d93041-d040-45a2-b285-04cd8f1f13ce None admin] PATH_INFO: `/v3/groups/017ee6bbe36848adac764167d7da2f78` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:54.900681 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d93041-d040-45a2-b285-04cd8f1f13ce None admin] RBAC: Authorizing `identity:get_group(group_id=017ee6bbe36848adac764167d7da2f78)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:54.902159 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d93041-d040-45a2-b285-04cd8f1f13ce None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:54.912488 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 187/382] 10.222.0.36 () {56 vars in 1180 bytes} [Fri Jun 24 22:25:54 2022] GET /identity/v3/groups/017ee6bbe36848adac764167d7da2f78 => generated 229 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:54.925254 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d93041-d040-45a2-b285-04cd8f1f13ce None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:55.077724 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d93041-d040-45a2-b285-04cd8f1f13ce None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:55.105404 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a80581-09c1-49a5-b982-22716e949a17 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:55.116813 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3329dd-8816-45a3-a2ea-5d17501885c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:55.117856 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3329dd-8816-45a3-a2ea-5d17501885c5 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:55.118255 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3329dd-8816-45a3-a2ea-5d17501885c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:55.118580 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3329dd-8816-45a3-a2ea-5d17501885c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:55.119447 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3329dd-8816-45a3-a2ea-5d17501885c5 None admin] RBAC: Adding query filter params (group.id=017ee6bbe36848adac764167d7da2f78, role.id=1a1c43cc97a0407eb7a7c7a1333a9d4a, scope.project.id=ed521bc1cbbe4ae1823626f007bced73) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:25:55.119765 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3329dd-8816-45a3-a2ea-5d17501885c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:55.121663 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3329dd-8816-45a3-a2ea-5d17501885c5 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:55.128836 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 188/383] 10.222.0.36 () {56 vars in 1376 bytes} [Fri Jun 24 22:25:54 2022] GET /identity/v3/role_assignments?group.id=017ee6bbe36848adac764167d7da2f78&scope.project.id=ed521bc1cbbe4ae1823626f007bced73&role.id=1a1c43cc97a0407eb7a7c7a1333a9d4a => generated 260 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 22:25:55.154766 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e13af21-618f-4a05-83b7-a6142d38614b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:55.155553 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e13af21-618f-4a05-83b7-a6142d38614b None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:55.155839 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e13af21-618f-4a05-83b7-a6142d38614b None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:55.156113 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e13af21-618f-4a05-83b7-a6142d38614b None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:55.157037 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e13af21-618f-4a05-83b7-a6142d38614b None admin] RBAC: Adding query filter params (name=member) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:25:55.157348 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e13af21-618f-4a05-83b7-a6142d38614b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:55.158973 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e13af21-618f-4a05-83b7-a6142d38614b None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:55.169181 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 196/384] 10.222.0.36 () {56 vars in 1101 bytes} [Fri Jun 24 22:25:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:55.174444 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3329dd-8816-45a3-a2ea-5d17501885c5 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:55.178658 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:55.288478 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3329dd-8816-45a3-a2ea-5d17501885c5 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:55.326087 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f845d9-5c0b-4a86-9e67-e7cabf2aa09a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:55.326978 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f845d9-5c0b-4a86-9e67-e7cabf2aa09a None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:55.327282 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f845d9-5c0b-4a86-9e67-e7cabf2aa09a None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:55.327561 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f845d9-5c0b-4a86-9e67-e7cabf2aa09a None admin] PATH_INFO: `/v3/groups/f3036b8220214ed49774b88ee620ee6c` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:55.328755 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f845d9-5c0b-4a86-9e67-e7cabf2aa09a None admin] RBAC: Authorizing `identity:get_group(group_id=f3036b8220214ed49774b88ee620ee6c)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:55.330221 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f845d9-5c0b-4a86-9e67-e7cabf2aa09a None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:55.332192 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 189/385] 10.222.0.36 () {56 vars in 1180 bytes} [Fri Jun 24 22:25:55 2022] GET /identity/v3/groups/f3036b8220214ed49774b88ee620ee6c => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:55.337830 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e13af21-618f-4a05-83b7-a6142d38614b None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:55.434773 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:55.487406 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e13af21-618f-4a05-83b7-a6142d38614b None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:55.527636 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bc3a9f-5485-447e-8ddf-db272a6b903c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:55.528527 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bc3a9f-5485-447e-8ddf-db272a6b903c None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:55.528804 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bc3a9f-5485-447e-8ddf-db272a6b903c None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:55.529188 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bc3a9f-5485-447e-8ddf-db272a6b903c None admin] PATH_INFO: `/v3/projects/8130cc4553114edcaa7ac3278c906eed` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:55.530828 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bc3a9f-5485-447e-8ddf-db272a6b903c None admin] RBAC: Authorizing `identity:get_project(project_id=8130cc4553114edcaa7ac3278c906eed)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:55.532328 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bc3a9f-5485-447e-8ddf-db272a6b903c None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:55.535037 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 197/386] 10.222.0.36 () {56 vars in 1186 bytes} [Fri Jun 24 22:25:55 2022] GET /identity/v3/projects/8130cc4553114edcaa7ac3278c906eed => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:55.539724 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f845d9-5c0b-4a86-9e67-e7cabf2aa09a None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:55.647029 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:55.681217 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f845d9-5c0b-4a86-9e67-e7cabf2aa09a None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:55.721404 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9afe259-4ce8-40fa-9642-7c95ed9bcdf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:55.722222 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9afe259-4ce8-40fa-9642-7c95ed9bcdf4 None admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:55.722507 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9afe259-4ce8-40fa-9642-7c95ed9bcdf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:55.722782 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9afe259-4ce8-40fa-9642-7c95ed9bcdf4 None admin] PATH_INFO: `/v3/projects/8130cc4553114edcaa7ac3278c906eed/groups/f3036b8220214ed49774b88ee620ee6c/roles/1928787bfcc745419829cd315900ac44` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:55.724811 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9afe259-4ce8-40fa-9642-7c95ed9bcdf4 None admin] RBAC: Authorizing `identity:create_grant(project_id=8130cc4553114edcaa7ac3278c906eed, group_id=f3036b8220214ed49774b88ee620ee6c, role_id=1928787bfcc745419829cd315900ac44)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:55.726271 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9afe259-4ce8-40fa-9642-7c95ed9bcdf4 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:55.743655 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 190/387] 10.222.0.36 () {58 vars in 1442 bytes} [Fri Jun 24 22:25:55 2022] PUT /identity/v3/projects/8130cc4553114edcaa7ac3278c906eed/groups/f3036b8220214ed49774b88ee620ee6c/roles/1928787bfcc745419829cd315900ac44 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:25:55.927008 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdab25b3-e525-4711-b469-36ab7c732677 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:55.927405 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdab25b3-e525-4711-b469-36ab7c732677 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:55.927595 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdab25b3-e525-4711-b469-36ab7c732677 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:55.928995 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 198/388] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:25:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:25:55.941421 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf46d9b-b7f7-48c8-96df-30054e234f20 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:55.941753 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf46d9b-b7f7-48c8-96df-30054e234f20 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:55.941993 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf46d9b-b7f7-48c8-96df-30054e234f20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:55.968439 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-9cf46d9b-b7f7-48c8-96df-30054e234f20 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:25:55.969685 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-9cf46d9b-b7f7-48c8-96df-30054e234f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:25:56.058809 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 191/389] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:25:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 22:25:56.084389 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdab25b3-e525-4711-b469-36ab7c732677 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:56.221317 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdab25b3-e525-4711-b469-36ab7c732677 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:56.257341 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:56.269077 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c04177-66b7-4cc4-a8f1-eab2d1ad9bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:56.269915 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c04177-66b7-4cc4-a8f1-eab2d1ad9bcb None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:56.270199 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c04177-66b7-4cc4-a8f1-eab2d1ad9bcb None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:56.270478 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c04177-66b7-4cc4-a8f1-eab2d1ad9bcb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:56.287031 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c04177-66b7-4cc4-a8f1-eab2d1ad9bcb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 22:25:56.299403 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-22c04177-66b7-4cc4-a8f1-eab2d1ad9bcb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 22:25:56.299403 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:25:56.299403 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:25:56.299403 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:25:56.299403 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:25:56.299403 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:25:56.299403 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:25:56.299403 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:25:56.299403 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:25:56.299403 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:25:56.299403 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:25:56.299403 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:25:56.299403 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 22:25:56.299403 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 22:25:56.299403 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 22:25:56.299403 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 22:25:56.300297 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 22:25:56.300297 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 22:25:56.300297 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 22:25:56.300297 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 22:25:56.300297 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:25:56.300297 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:25:56.300297 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:25:56.300297 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:25:56.300297 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:25:56.300297 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:25:56.300297 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:25:56.300297 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:25:56.300297 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:25:56.300297 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:25:56.300297 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:25:56.300297 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:25:56.301058 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:25:56.301058 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:25:56.301058 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:25:56.301058 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:25:56.301058 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 22:25:56.301058 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 22:25:56.301058 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 22:25:56.301058 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 22:25:56.301058 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 22:25:56.301058 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 22:25:56.301058 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 22:25:56.301058 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:25:56.301058 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 199/390] 10.222.0.36 () {56 vars in 1114 bytes} [Fri Jun 24 22:25:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:25:56.307333 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf46d9b-b7f7-48c8-96df-30054e234f20 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:56.388253 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:56.442277 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf46d9b-b7f7-48c8-96df-30054e234f20 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:56.495151 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debbbb66-cffc-44c4-996c-6d5aca03e623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:56.495863 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debbbb66-cffc-44c4-996c-6d5aca03e623 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:56.496149 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debbbb66-cffc-44c4-996c-6d5aca03e623 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:56.496427 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debbbb66-cffc-44c4-996c-6d5aca03e623 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:56.497189 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debbbb66-cffc-44c4-996c-6d5aca03e623 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:25:56.497500 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debbbb66-cffc-44c4-996c-6d5aca03e623 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:56.498903 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debbbb66-cffc-44c4-996c-6d5aca03e623 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:56.511033 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 192/391] 10.222.0.36 () {56 vars in 1111 bytes} [Fri Jun 24 22:25:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:56.516673 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c04177-66b7-4cc4-a8f1-eab2d1ad9bcb None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:56.572494 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21441f6-95e3-4eb1-a26c-8f0aebda57ee None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:56.573032 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21441f6-95e3-4eb1-a26c-8f0aebda57ee None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:56.573032 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21441f6-95e3-4eb1-a26c-8f0aebda57ee None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:56.574417 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 193/392] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:25:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 22:25:56.580512 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af35284f-83be-4649-84fa-238b701efc7c None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:56.580810 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af35284f-83be-4649-84fa-238b701efc7c None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:56.581455 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af35284f-83be-4649-84fa-238b701efc7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:56.610562 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-af35284f-83be-4649-84fa-238b701efc7c None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:25:56.611802 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-af35284f-83be-4649-84fa-238b701efc7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:25:56.688734 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c04177-66b7-4cc4-a8f1-eab2d1ad9bcb None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:56.741552 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e07cf9-8318-4bff-b8ae-7f070c5d5271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:56.742449 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e07cf9-8318-4bff-b8ae-7f070c5d5271 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:56.742731 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e07cf9-8318-4bff-b8ae-7f070c5d5271 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:56.743009 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e07cf9-8318-4bff-b8ae-7f070c5d5271 None admin] PATH_INFO: `/v3/groups/f3036b8220214ed49774b88ee620ee6c` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:56.747674 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e07cf9-8318-4bff-b8ae-7f070c5d5271 None admin] RBAC: Authorizing `identity:get_group(group_id=f3036b8220214ed49774b88ee620ee6c)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:56.749241 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e07cf9-8318-4bff-b8ae-7f070c5d5271 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:56.751372 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 200/393] 10.222.0.36 () {56 vars in 1180 bytes} [Fri Jun 24 22:25:56 2022] GET /identity/v3/groups/f3036b8220214ed49774b88ee620ee6c => generated 226 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:56.756796 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e07cf9-8318-4bff-b8ae-7f070c5d5271 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:56.769012 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 194/394] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:25:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 22:25:56.804080 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af35284f-83be-4649-84fa-238b701efc7c None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:56.832591 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:56.876935 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:56.891408 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e07cf9-8318-4bff-b8ae-7f070c5d5271 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:56.923759 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af35284f-83be-4649-84fa-238b701efc7c None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:56.930009 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909e7f19-8769-491f-9854-5d085b40b2b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:56.930895 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909e7f19-8769-491f-9854-5d085b40b2b8 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:56.931229 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909e7f19-8769-491f-9854-5d085b40b2b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:56.931743 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909e7f19-8769-491f-9854-5d085b40b2b8 None admin] PATH_INFO: `/v3/projects/8130cc4553114edcaa7ac3278c906eed` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:56.933482 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909e7f19-8769-491f-9854-5d085b40b2b8 None admin] RBAC: Authorizing `identity:get_project(project_id=8130cc4553114edcaa7ac3278c906eed)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:56.934750 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909e7f19-8769-491f-9854-5d085b40b2b8 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:56.936999 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 201/395] 10.222.0.36 () {56 vars in 1186 bytes} [Fri Jun 24 22:25:56 2022] GET /identity/v3/projects/8130cc4553114edcaa7ac3278c906eed => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 22:25:56.938375 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85425a36-f514-4436-a387-445fda6dec59 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:56.938705 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85425a36-f514-4436-a387-445fda6dec59 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:56.938988 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85425a36-f514-4436-a387-445fda6dec59 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:56.940365 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 202/396] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:25:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:25:56.945339 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85425a36-f514-4436-a387-445fda6dec59 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:56.967960 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634f73b4-802d-4643-90a8-e563f73ee54a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:56.969144 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634f73b4-802d-4643-90a8-e563f73ee54a None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:56.969637 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634f73b4-802d-4643-90a8-e563f73ee54a None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:56.970525 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634f73b4-802d-4643-90a8-e563f73ee54a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:56.984353 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634f73b4-802d-4643-90a8-e563f73ee54a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 22:25:56.994143 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-634f73b4-802d-4643-90a8-e563f73ee54a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 22:25:56.994143 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:25:56.994143 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:25:56.994143 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:25:56.994143 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:25:56.994143 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:25:56.994143 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:25:56.994143 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:25:56.994143 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:25:56.994143 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:25:56.994143 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:25:56.994143 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:25:56.994143 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 22:25:56.994143 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 22:25:56.994143 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 22:25:56.994143 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 22:25:56.995033 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 22:25:56.995033 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 22:25:56.995033 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 22:25:56.995033 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 22:25:56.995033 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:25:56.995033 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:25:56.995033 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:25:56.995033 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:25:56.995033 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:25:56.995033 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:25:56.995033 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:25:56.995033 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:25:56.995033 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:25:56.995033 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:25:56.995033 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:25:56.995033 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:25:56.995813 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:25:56.995813 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:25:56.995813 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:25:56.995813 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:25:56.995813 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 22:25:56.995813 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 22:25:56.995813 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 22:25:56.995813 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 22:25:56.995813 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 22:25:56.995813 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 22:25:56.995813 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 22:25:56.995813 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:25:56.999089 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 195/397] 10.222.0.36 () {56 vars in 1099 bytes} [Fri Jun 24 22:25:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 22:25:57.001096 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a725437-9363-4b14-8422-df8bbf08487d None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:57.001711 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a725437-9363-4b14-8422-df8bbf08487d None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:57.002277 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a725437-9363-4b14-8422-df8bbf08487d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:57.023086 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-8a725437-9363-4b14-8422-df8bbf08487d None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:25:57.024879 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-8a725437-9363-4b14-8422-df8bbf08487d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:25:57.068735 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85425a36-f514-4436-a387-445fda6dec59 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:57.092874 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:57.111957 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616ba2ca-56b4-48b8-bd10-6ef4214f4537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:57.113005 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616ba2ca-56b4-48b8-bd10-6ef4214f4537 None admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:57.113290 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616ba2ca-56b4-48b8-bd10-6ef4214f4537 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:57.113567 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616ba2ca-56b4-48b8-bd10-6ef4214f4537 None admin] PATH_INFO: `/v3/projects/8130cc4553114edcaa7ac3278c906eed/groups/f3036b8220214ed49774b88ee620ee6c/roles/bf32f251a7764c7188fd782b65275038` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:57.115922 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616ba2ca-56b4-48b8-bd10-6ef4214f4537 None admin] RBAC: Authorizing `identity:create_grant(project_id=8130cc4553114edcaa7ac3278c906eed, group_id=f3036b8220214ed49774b88ee620ee6c, role_id=bf32f251a7764c7188fd782b65275038)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:57.117465 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616ba2ca-56b4-48b8-bd10-6ef4214f4537 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:57.119910 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 196/398] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:25:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 22:25:57.121981 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a725437-9363-4b14-8422-df8bbf08487d None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:57.145586 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 203/399] 10.222.0.36 () {58 vars in 1442 bytes} [Fri Jun 24 22:25:56 2022] PUT /identity/v3/projects/8130cc4553114edcaa7ac3278c906eed/groups/f3036b8220214ed49774b88ee620ee6c/roles/bf32f251a7764c7188fd782b65275038 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:25:57.160047 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616ba2ca-56b4-48b8-bd10-6ef4214f4537 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:57.179360 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:57.257843 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a725437-9363-4b14-8422-df8bbf08487d None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:57.276076 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616ba2ca-56b4-48b8-bd10-6ef4214f4537 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:57.302877 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262dd87f-350f-4b7e-a481-f36487f3a775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:57.304004 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262dd87f-350f-4b7e-a481-f36487f3a775 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:57.304534 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262dd87f-350f-4b7e-a481-f36487f3a775 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:57.305104 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262dd87f-350f-4b7e-a481-f36487f3a775 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:57.306289 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262dd87f-350f-4b7e-a481-f36487f3a775 None admin] RBAC: Adding query filter params (name=member) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:25:57.306865 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262dd87f-350f-4b7e-a481-f36487f3a775 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:57.308731 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262dd87f-350f-4b7e-a481-f36487f3a775 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:57.318103 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a770c6f1-0be0-4049-9f4c-95805ecfa341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:57.318959 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a770c6f1-0be0-4049-9f4c-95805ecfa341 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:57.319328 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a770c6f1-0be0-4049-9f4c-95805ecfa341 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:57.319615 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a770c6f1-0be0-4049-9f4c-95805ecfa341 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:57.320250 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 197/400] 10.222.0.36 () {56 vars in 1101 bytes} [Fri Jun 24 22:25:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:57.325630 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262dd87f-350f-4b7e-a481-f36487f3a775 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:57.337399 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a770c6f1-0be0-4049-9f4c-95805ecfa341 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 22:25:57.350993 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-a770c6f1-0be0-4049-9f4c-95805ecfa341 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 22:25:57.350993 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:25:57.350993 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:25:57.350993 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:25:57.350993 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:25:57.350993 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:25:57.350993 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:25:57.350993 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:25:57.350993 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:25:57.350993 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:25:57.350993 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:25:57.350993 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:25:57.350993 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 22:25:57.350993 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 22:25:57.350993 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 22:25:57.350993 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 22:25:57.351987 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 22:25:57.351987 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 22:25:57.351987 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 22:25:57.351987 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 22:25:57.351987 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:25:57.351987 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:25:57.351987 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:25:57.351987 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:25:57.351987 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:25:57.351987 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:25:57.351987 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:25:57.351987 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:25:57.351987 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:25:57.351987 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:25:57.351987 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:25:57.351987 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:25:57.352751 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:25:57.352751 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:25:57.352751 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:25:57.352751 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:25:57.352751 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 22:25:57.352751 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 22:25:57.352751 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 22:25:57.352751 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 22:25:57.352751 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 22:25:57.352751 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 22:25:57.352751 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 22:25:57.352751 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:25:57.356999 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 204/401] 10.222.0.36 () {56 vars in 1114 bytes} [Fri Jun 24 22:25:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 22:25:57.359531 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a770c6f1-0be0-4049-9f4c-95805ecfa341 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:57.411762 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:57.492963 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262dd87f-350f-4b7e-a481-f36487f3a775 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:57.494035 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a770c6f1-0be0-4049-9f4c-95805ecfa341 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:57.502127 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:57.540094 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a512077-e835-4b7f-8f0d-7233e8689966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:57.541560 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a512077-e835-4b7f-8f0d-7233e8689966 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:57.542052 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a512077-e835-4b7f-8f0d-7233e8689966 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:57.542514 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a512077-e835-4b7f-8f0d-7233e8689966 None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:57.543743 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a512077-e835-4b7f-8f0d-7233e8689966 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:25:57.544313 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a512077-e835-4b7f-8f0d-7233e8689966 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:57.544590 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3273f942-4a04-45af-9926-cb0e2bc444a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:57.545467 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3273f942-4a04-45af-9926-cb0e2bc444a8 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:57.545752 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3273f942-4a04-45af-9926-cb0e2bc444a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:57.546027 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3273f942-4a04-45af-9926-cb0e2bc444a8 None admin] PATH_INFO: `/v3/groups/f3036b8220214ed49774b88ee620ee6c` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:57.546795 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a512077-e835-4b7f-8f0d-7233e8689966 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:57.547204 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3273f942-4a04-45af-9926-cb0e2bc444a8 None admin] RBAC: Authorizing `identity:get_group(group_id=f3036b8220214ed49774b88ee620ee6c)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:57.548663 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3273f942-4a04-45af-9926-cb0e2bc444a8 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:57.552478 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 198/402] 10.222.0.36 () {56 vars in 1180 bytes} [Fri Jun 24 22:25:57 2022] GET /identity/v3/groups/f3036b8220214ed49774b88ee620ee6c => generated 226 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:57.559400 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3273f942-4a04-45af-9926-cb0e2bc444a8 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:57.560273 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 205/403] 10.222.0.36 () {56 vars in 1111 bytes} [Fri Jun 24 22:25:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 22:25:57.566405 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a512077-e835-4b7f-8f0d-7233e8689966 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:57.683132 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a512077-e835-4b7f-8f0d-7233e8689966 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:57.689963 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:57.706673 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3273f942-4a04-45af-9926-cb0e2bc444a8 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:57.738347 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7202510-73f0-4a06-9e97-31dab76ffb70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:57.739360 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7202510-73f0-4a06-9e97-31dab76ffb70 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:57.739645 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7202510-73f0-4a06-9e97-31dab76ffb70 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:57.739922 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7202510-73f0-4a06-9e97-31dab76ffb70 None admin] PATH_INFO: `/v3/groups/f3036b8220214ed49774b88ee620ee6c` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:57.741111 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7202510-73f0-4a06-9e97-31dab76ffb70 None admin] RBAC: Authorizing `identity:get_group(group_id=f3036b8220214ed49774b88ee620ee6c)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:57.742883 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7202510-73f0-4a06-9e97-31dab76ffb70 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:57.744872 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b3da3d-b797-4f01-a265-23bf3af72f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:57.746004 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b3da3d-b797-4f01-a265-23bf3af72f36 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:57.746475 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b3da3d-b797-4f01-a265-23bf3af72f36 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:57.746946 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b3da3d-b797-4f01-a265-23bf3af72f36 None admin] PATH_INFO: `/v3/projects/deb0943e980a41b2987f1c69584ddf73` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:57.747829 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 206/404] 10.222.0.36 () {56 vars in 1180 bytes} [Fri Jun 24 22:25:57 2022] GET /identity/v3/groups/f3036b8220214ed49774b88ee620ee6c => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 22:25:57.748586 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b3da3d-b797-4f01-a265-23bf3af72f36 None admin] RBAC: Authorizing `identity:get_project(project_id=deb0943e980a41b2987f1c69584ddf73)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:57.750313 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b3da3d-b797-4f01-a265-23bf3af72f36 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:57.750589 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7202510-73f0-4a06-9e97-31dab76ffb70 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:57.753073 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 199/405] 10.222.0.36 () {56 vars in 1186 bytes} [Fri Jun 24 22:25:57 2022] GET /identity/v3/projects/deb0943e980a41b2987f1c69584ddf73 => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:57.758862 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b3da3d-b797-4f01-a265-23bf3af72f36 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:57.809751 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:57.861385 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7202510-73f0-4a06-9e97-31dab76ffb70 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:57.878315 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b3da3d-b797-4f01-a265-23bf3af72f36 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:57.896957 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a03b2cd-4a3d-4880-9841-ffb4b9afbda9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:57.897942 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a03b2cd-4a3d-4880-9841-ffb4b9afbda9 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:57.898229 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a03b2cd-4a3d-4880-9841-ffb4b9afbda9 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:57.898503 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a03b2cd-4a3d-4880-9841-ffb4b9afbda9 None admin] PATH_INFO: `/v3/projects/deb0943e980a41b2987f1c69584ddf73` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:57.899908 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a03b2cd-4a3d-4880-9841-ffb4b9afbda9 None admin] RBAC: Authorizing `identity:get_project(project_id=deb0943e980a41b2987f1c69584ddf73)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:57.901452 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a03b2cd-4a3d-4880-9841-ffb4b9afbda9 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:57.907435 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 207/406] 10.222.0.36 () {56 vars in 1186 bytes} [Fri Jun 24 22:25:57 2022] GET /identity/v3/projects/deb0943e980a41b2987f1c69584ddf73 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:57.909618 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a03b2cd-4a3d-4880-9841-ffb4b9afbda9 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:57.917996 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1562a5b-cb48-4cce-9b9e-0c3636eecd1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:57.919459 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1562a5b-cb48-4cce-9b9e-0c3636eecd1a None admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:57.919932 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1562a5b-cb48-4cce-9b9e-0c3636eecd1a None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:57.920394 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1562a5b-cb48-4cce-9b9e-0c3636eecd1a None admin] PATH_INFO: `/v3/projects/deb0943e980a41b2987f1c69584ddf73/groups/f3036b8220214ed49774b88ee620ee6c/roles/1928787bfcc745419829cd315900ac44` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:57.922614 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1562a5b-cb48-4cce-9b9e-0c3636eecd1a None admin] RBAC: Authorizing `identity:create_grant(project_id=deb0943e980a41b2987f1c69584ddf73, group_id=f3036b8220214ed49774b88ee620ee6c, role_id=1928787bfcc745419829cd315900ac44)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:57.924662 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1562a5b-cb48-4cce-9b9e-0c3636eecd1a None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:57.949596 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 200/407] 10.222.0.36 () {58 vars in 1442 bytes} [Fri Jun 24 22:25:57 2022] PUT /identity/v3/projects/deb0943e980a41b2987f1c69584ddf73/groups/f3036b8220214ed49774b88ee620ee6c/roles/1928787bfcc745419829cd315900ac44 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:25:57.956376 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:57.963887 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1285cf-94a6-4488-968b-dd282cb953d1 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:57.964559 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1285cf-94a6-4488-968b-dd282cb953d1 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:57.965025 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1285cf-94a6-4488-968b-dd282cb953d1 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:57.967295 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 201/408] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:25:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:25:57.972759 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed974d29-78d7-47ee-beb0-770b22f75344 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:57.973377 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed974d29-78d7-47ee-beb0-770b22f75344 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:57.973953 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed974d29-78d7-47ee-beb0-770b22f75344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:58.004379 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-ed974d29-78d7-47ee-beb0-770b22f75344 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:25:58.006526 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-ed974d29-78d7-47ee-beb0-770b22f75344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:25:58.027114 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a03b2cd-4a3d-4880-9841-ffb4b9afbda9 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:58.066599 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb17fcc-ed9e-441a-a73a-3a3378129b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:58.067459 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb17fcc-ed9e-441a-a73a-3a3378129b28 None admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:58.067742 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb17fcc-ed9e-441a-a73a-3a3378129b28 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:58.068024 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb17fcc-ed9e-441a-a73a-3a3378129b28 None admin] PATH_INFO: `/v3/projects/deb0943e980a41b2987f1c69584ddf73/groups/f3036b8220214ed49774b88ee620ee6c/roles/bf32f251a7764c7188fd782b65275038` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:58.070540 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb17fcc-ed9e-441a-a73a-3a3378129b28 None admin] RBAC: Authorizing `identity:create_grant(project_id=deb0943e980a41b2987f1c69584ddf73, group_id=f3036b8220214ed49774b88ee620ee6c, role_id=bf32f251a7764c7188fd782b65275038)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:58.072254 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb17fcc-ed9e-441a-a73a-3a3378129b28 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:58.098315 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 208/409] 10.222.0.36 () {58 vars in 1442 bytes} [Fri Jun 24 22:25:57 2022] PUT /identity/v3/projects/deb0943e980a41b2987f1c69584ddf73/groups/f3036b8220214ed49774b88ee620ee6c/roles/bf32f251a7764c7188fd782b65275038 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 22:25:58.125992 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 202/410] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:25:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 22:25:58.162359 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb17fcc-ed9e-441a-a73a-3a3378129b28 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:58.283903 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:58.286835 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb17fcc-ed9e-441a-a73a-3a3378129b28 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:58.330357 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a564f4-fd8a-4daf-a335-a6f10f7bdf72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:58.331082 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a564f4-fd8a-4daf-a335-a6f10f7bdf72 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:58.331390 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a564f4-fd8a-4daf-a335-a6f10f7bdf72 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:58.331665 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a564f4-fd8a-4daf-a335-a6f10f7bdf72 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:58.343856 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a564f4-fd8a-4daf-a335-a6f10f7bdf72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 22:25:58.353813 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-92a564f4-fd8a-4daf-a335-a6f10f7bdf72 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 22:25:58.353813 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:25:58.353813 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:25:58.353813 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:25:58.353813 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:25:58.353813 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:25:58.353813 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:25:58.353813 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:25:58.353813 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:25:58.353813 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:25:58.353813 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:25:58.353813 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:25:58.353813 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 22:25:58.353813 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 22:25:58.353813 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 22:25:58.353813 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 22:25:58.354708 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 22:25:58.354708 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 22:25:58.354708 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 22:25:58.354708 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 22:25:58.354708 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:25:58.354708 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:25:58.354708 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:25:58.354708 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:25:58.354708 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:25:58.354708 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:25:58.354708 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:25:58.354708 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:25:58.354708 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:25:58.354708 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:25:58.354708 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:25:58.354708 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:25:58.355559 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:25:58.355559 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:25:58.355559 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:25:58.355559 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:25:58.355559 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 22:25:58.355559 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 22:25:58.355559 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 22:25:58.355559 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 22:25:58.355559 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 22:25:58.355559 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 22:25:58.355559 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 22:25:58.355559 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:25:58.355559 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 209/411] 10.222.0.36 () {56 vars in 1096 bytes} [Fri Jun 24 22:25:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:25:58.361705 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed974d29-78d7-47ee-beb0-770b22f75344 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:58.405025 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:58.509869 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed974d29-78d7-47ee-beb0-770b22f75344 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:58.565078 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54301df3-079b-45f1-9d33-d1ba6d799323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:58.565763 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54301df3-079b-45f1-9d33-d1ba6d799323 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:58.566047 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54301df3-079b-45f1-9d33-d1ba6d799323 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:58.566326 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54301df3-079b-45f1-9d33-d1ba6d799323 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:58.567091 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54301df3-079b-45f1-9d33-d1ba6d799323 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:25:58.567430 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54301df3-079b-45f1-9d33-d1ba6d799323 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:58.568839 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54301df3-079b-45f1-9d33-d1ba6d799323 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:58.583080 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 203/412] 10.222.0.36 () {56 vars in 1099 bytes} [Fri Jun 24 22:25:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:58.588630 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a564f4-fd8a-4daf-a335-a6f10f7bdf72 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:58.672795 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f46c87-edf3-45e0-a9e7-b285f423eb35 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:58.673150 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f46c87-edf3-45e0-a9e7-b285f423eb35 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:58.673363 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f46c87-edf3-45e0-a9e7-b285f423eb35 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:58.674921 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 204/413] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:25:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:25:58.680485 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d5186b-015d-4c9b-b6b5-acc0d06faf28 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:58.681142 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d5186b-015d-4c9b-b6b5-acc0d06faf28 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:58.681642 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d5186b-015d-4c9b-b6b5-acc0d06faf28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:58.717327 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-82d5186b-015d-4c9b-b6b5-acc0d06faf28 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:25:58.725495 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-82d5186b-015d-4c9b-b6b5-acc0d06faf28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:25:58.755337 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a564f4-fd8a-4daf-a335-a6f10f7bdf72 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:58.796371 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bfb31c-328e-463e-8cf8-1e940fbcfbea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:58.797642 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bfb31c-328e-463e-8cf8-1e940fbcfbea None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:58.798062 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bfb31c-328e-463e-8cf8-1e940fbcfbea None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:58.798478 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bfb31c-328e-463e-8cf8-1e940fbcfbea None admin] PATH_INFO: `/v3/groups/017ee6bbe36848adac764167d7da2f78` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:58.799965 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bfb31c-328e-463e-8cf8-1e940fbcfbea None admin] RBAC: Authorizing `identity:get_group(group_id=017ee6bbe36848adac764167d7da2f78)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:58.802369 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bfb31c-328e-463e-8cf8-1e940fbcfbea None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:58.804500 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 210/414] 10.222.0.36 () {56 vars in 1180 bytes} [Fri Jun 24 22:25:58 2022] GET /identity/v3/groups/017ee6bbe36848adac764167d7da2f78 => generated 229 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:58.811053 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bfb31c-328e-463e-8cf8-1e940fbcfbea None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:58.871371 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 205/415] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:25:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 22:25:58.876843 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:58.908235 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d5186b-015d-4c9b-b6b5-acc0d06faf28 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:58.946976 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:58.969951 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bfb31c-328e-463e-8cf8-1e940fbcfbea None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:59.012497 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87807a7-510f-4525-9830-3a2423a0c24a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:59.013909 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87807a7-510f-4525-9830-3a2423a0c24a None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:59.014387 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87807a7-510f-4525-9830-3a2423a0c24a None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:59.014871 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87807a7-510f-4525-9830-3a2423a0c24a None admin] PATH_INFO: `/v3/projects/ed521bc1cbbe4ae1823626f007bced73` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:59.016323 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87807a7-510f-4525-9830-3a2423a0c24a None admin] RBAC: Authorizing `identity:get_project(project_id=ed521bc1cbbe4ae1823626f007bced73)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:59.018002 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87807a7-510f-4525-9830-3a2423a0c24a None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:59.026522 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 211/416] 10.222.0.36 () {56 vars in 1186 bytes} [Fri Jun 24 22:25:58 2022] GET /identity/v3/projects/ed521bc1cbbe4ae1823626f007bced73 => generated 344 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 22:25:59.032357 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87807a7-510f-4525-9830-3a2423a0c24a None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:59.115110 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d5186b-015d-4c9b-b6b5-acc0d06faf28 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:59.181685 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3258f14c-1378-44e0-a364-b7ffaa620804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:59.184459 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3258f14c-1378-44e0-a364-b7ffaa620804 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:59.184939 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3258f14c-1378-44e0-a364-b7ffaa620804 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:59.185423 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3258f14c-1378-44e0-a364-b7ffaa620804 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:59.209270 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3258f14c-1378-44e0-a364-b7ffaa620804 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 22:25:59.217698 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-3258f14c-1378-44e0-a364-b7ffaa620804 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 22:25:59.217698 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:25:59.217698 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:25:59.217698 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:25:59.217698 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:25:59.217698 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:25:59.217698 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:25:59.217698 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:25:59.217698 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:25:59.217698 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:25:59.217698 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:25:59.217698 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:25:59.217698 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 22:25:59.217698 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 22:25:59.217698 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 22:25:59.217698 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 22:25:59.218551 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 22:25:59.218551 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 22:25:59.218551 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 22:25:59.218551 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 22:25:59.218551 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:25:59.218551 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:25:59.218551 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:25:59.218551 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:25:59.218551 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:25:59.218551 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:25:59.218551 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:25:59.218551 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:25:59.218551 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:25:59.218551 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:25:59.218551 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:25:59.218551 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:25:59.219363 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:25:59.219363 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:25:59.219363 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:25:59.219363 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:25:59.219363 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 22:25:59.219363 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 22:25:59.219363 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 22:25:59.219363 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 22:25:59.219363 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 22:25:59.219363 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 22:25:59.219363 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 22:25:59.219363 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:25:59.225956 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:59.232894 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 206/417] 10.222.0.36 () {56 vars in 1099 bytes} [Fri Jun 24 22:25:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 22:25:59.235230 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87807a7-510f-4525-9830-3a2423a0c24a None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:59.238633 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3258f14c-1378-44e0-a364-b7ffaa620804 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:59.287642 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58783710-d8a2-470a-9aaa-4ab09a877929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:59.289221 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58783710-d8a2-470a-9aaa-4ab09a877929 None admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:59.289706 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58783710-d8a2-470a-9aaa-4ab09a877929 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:59.290174 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58783710-d8a2-470a-9aaa-4ab09a877929 None admin] PATH_INFO: `/v3/projects/ed521bc1cbbe4ae1823626f007bced73/groups/017ee6bbe36848adac764167d7da2f78/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:59.292437 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58783710-d8a2-470a-9aaa-4ab09a877929 None admin] RBAC: Authorizing `identity:create_grant(project_id=ed521bc1cbbe4ae1823626f007bced73, group_id=017ee6bbe36848adac764167d7da2f78, role_id=1a1c43cc97a0407eb7a7c7a1333a9d4a)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:59.294145 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58783710-d8a2-470a-9aaa-4ab09a877929 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:59.319761 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 212/418] 10.222.0.36 () {58 vars in 1442 bytes} [Fri Jun 24 22:25:59 2022] PUT /identity/v3/projects/ed521bc1cbbe4ae1823626f007bced73/groups/017ee6bbe36848adac764167d7da2f78/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 22:25:59.401981 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:59.437895 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3258f14c-1378-44e0-a364-b7ffaa620804 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:59.490784 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e864ec7f-3be7-40ff-8b39-52607c26f4d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:59.491850 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e864ec7f-3be7-40ff-8b39-52607c26f4d8 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:59.492334 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e864ec7f-3be7-40ff-8b39-52607c26f4d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:59.492800 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e864ec7f-3be7-40ff-8b39-52607c26f4d8 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:59.493910 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e864ec7f-3be7-40ff-8b39-52607c26f4d8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:25:59.494439 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e864ec7f-3be7-40ff-8b39-52607c26f4d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:59.496054 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e864ec7f-3be7-40ff-8b39-52607c26f4d8 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:59.512169 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 207/419] 10.222.0.36 () {56 vars in 1101 bytes} [Fri Jun 24 22:25:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:25:59.517651 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58783710-d8a2-470a-9aaa-4ab09a877929 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:59.675967 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58783710-d8a2-470a-9aaa-4ab09a877929 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:25:59.716238 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0734d8-2c71-43b6-8ebc-779b959be23c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:25:59.716883 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0734d8-2c71-43b6-8ebc-779b959be23c None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:59.717172 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0734d8-2c71-43b6-8ebc-779b959be23c None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:59.717453 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0734d8-2c71-43b6-8ebc-779b959be23c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:59.744904 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:25:59.795416 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0734d8-2c71-43b6-8ebc-779b959be23c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:25:59.797140 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0734d8-2c71-43b6-8ebc-779b959be23c None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:25:59.888061 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931b0699-8128-4508-a571-536a9c81373e None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:59.889055 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931b0699-8128-4508-a571-536a9c81373e None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:59.889523 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931b0699-8128-4508-a571-536a9c81373e None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:59.891314 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 208/420] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:25:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:25:59.896689 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9c2864-3633-497d-80c7-071f343c4f30 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:25:59.897233 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9c2864-3633-497d-80c7-071f343c4f30 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:25:59.897747 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9c2864-3633-497d-80c7-071f343c4f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:25:59.903714 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 213/421] 10.222.0.36 () {58 vars in 1282 bytes} [Fri Jun 24 22:25:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 22:25:59.909421 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0734d8-2c71-43b6-8ebc-779b959be23c None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:25:59.928612 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-1a9c2864-3633-497d-80c7-071f343c4f30 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:25:59.930139 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-1a9c2864-3633-497d-80c7-071f343c4f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:25:59.971770 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:00.054491 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 209/422] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:25:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 22:26:00.059850 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0734d8-2c71-43b6-8ebc-779b959be23c None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:00.087042 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9c2864-3633-497d-80c7-071f343c4f30 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:00.106906 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19349f91-7dfc-4ce3-86b7-768e2ede0474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:00.108186 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19349f91-7dfc-4ce3-86b7-768e2ede0474 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:00.108970 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19349f91-7dfc-4ce3-86b7-768e2ede0474 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:00.109453 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19349f91-7dfc-4ce3-86b7-768e2ede0474 None admin] PATH_INFO: `/v3/projects/8130cc4553114edcaa7ac3278c906eed` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:00.110875 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19349f91-7dfc-4ce3-86b7-768e2ede0474 None admin] RBAC: Authorizing `identity:get_project(project_id=8130cc4553114edcaa7ac3278c906eed)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:00.112650 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19349f91-7dfc-4ce3-86b7-768e2ede0474 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:00.119898 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 214/423] 10.222.0.36 () {56 vars in 1186 bytes} [Fri Jun 24 22:25:59 2022] GET /identity/v3/projects/8130cc4553114edcaa7ac3278c906eed => generated 298 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 22:26:00.121705 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19349f91-7dfc-4ce3-86b7-768e2ede0474 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:00.231492 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19349f91-7dfc-4ce3-86b7-768e2ede0474 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:00.241808 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:00.259619 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:00.276157 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723a578d-77cc-454d-ae00-d9cf92db572d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:00.277045 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723a578d-77cc-454d-ae00-d9cf92db572d None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:00.277465 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723a578d-77cc-454d-ae00-d9cf92db572d None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:00.277746 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723a578d-77cc-454d-ae00-d9cf92db572d None admin] PATH_INFO: `/v3/groups/f3036b8220214ed49774b88ee620ee6c` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:00.281702 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723a578d-77cc-454d-ae00-d9cf92db572d None admin] RBAC: Authorizing `identity:get_group(group_id=f3036b8220214ed49774b88ee620ee6c)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:00.283169 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723a578d-77cc-454d-ae00-d9cf92db572d None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:00.284849 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 215/424] 10.222.0.36 () {56 vars in 1180 bytes} [Fri Jun 24 22:26:00 2022] GET /identity/v3/groups/f3036b8220214ed49774b88ee620ee6c => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 22:26:00.296978 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723a578d-77cc-454d-ae00-d9cf92db572d None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:00.309062 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9c2864-3633-497d-80c7-071f343c4f30 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:00.358519 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cfd9c2-84dd-4a35-9811-7a7335ba46ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:00.359366 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cfd9c2-84dd-4a35-9811-7a7335ba46ad None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:00.359790 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cfd9c2-84dd-4a35-9811-7a7335ba46ad None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:00.360223 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cfd9c2-84dd-4a35-9811-7a7335ba46ad None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:00.373275 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cfd9c2-84dd-4a35-9811-7a7335ba46ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 22:26:00.384213 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-29cfd9c2-84dd-4a35-9811-7a7335ba46ad None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 22:26:00.384213 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:00.384213 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:00.384213 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:00.384213 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:00.384213 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:00.384213 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:00.384213 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:00.384213 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:00.384213 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:00.384213 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:00.384213 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:00.384213 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 22:26:00.384213 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 22:26:00.384213 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 22:26:00.384213 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 22:26:00.385269 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 22:26:00.385269 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 22:26:00.385269 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 22:26:00.385269 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 22:26:00.385269 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:00.385269 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:00.385269 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:00.385269 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:00.385269 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:00.385269 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:00.385269 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:00.385269 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:00.385269 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:00.385269 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:00.385269 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:00.385269 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:00.386235 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:00.386235 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:00.386235 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:00.386235 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:00.386235 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 22:26:00.386235 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 22:26:00.386235 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 22:26:00.386235 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 22:26:00.386235 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 22:26:00.386235 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 22:26:00.386235 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 22:26:00.386235 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:26:00.388982 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 210/425] 10.222.0.36 () {56 vars in 1114 bytes} [Fri Jun 24 22:26:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 22:26:00.390986 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d4a991-c44b-4409-af86-1df5e48fa61c None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:00.391436 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d4a991-c44b-4409-af86-1df5e48fa61c None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:00.392092 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d4a991-c44b-4409-af86-1df5e48fa61c None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:00.394282 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 211/426] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:26:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:26:00.395105 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d4a991-c44b-4409-af86-1df5e48fa61c None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:00.448747 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723a578d-77cc-454d-ae00-d9cf92db572d None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:00.490570 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a740c900-b98d-4a35-982b-a9a7f565f2db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:00.491339 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a740c900-b98d-4a35-982b-a9a7f565f2db None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:00.491725 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a740c900-b98d-4a35-982b-a9a7f565f2db None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:00.492129 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a740c900-b98d-4a35-982b-a9a7f565f2db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:00.493075 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a740c900-b98d-4a35-982b-a9a7f565f2db None admin] RBAC: Adding query filter params (group.id=f3036b8220214ed49774b88ee620ee6c, role.id=1928787bfcc745419829cd315900ac44, scope.project.id=8130cc4553114edcaa7ac3278c906eed) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:00.493555 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a740c900-b98d-4a35-982b-a9a7f565f2db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:00.495118 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a740c900-b98d-4a35-982b-a9a7f565f2db None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:00.507540 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 216/427] 10.222.0.36 () {56 vars in 1376 bytes} [Fri Jun 24 22:26:00 2022] GET /identity/v3/role_assignments?group.id=f3036b8220214ed49774b88ee620ee6c&scope.project.id=8130cc4553114edcaa7ac3278c906eed&role.id=1928787bfcc745419829cd315900ac44 => generated 611 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 22:26:00.509530 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5488712-b71a-429a-bc5e-8070fe7ab617 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:00.509927 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5488712-b71a-429a-bc5e-8070fe7ab617 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:00.510308 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5488712-b71a-429a-bc5e-8070fe7ab617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:00.524453 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d4a991-c44b-4409-af86-1df5e48fa61c None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:00.544342 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-d5488712-b71a-429a-bc5e-8070fe7ab617 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:26:00.545741 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-d5488712-b71a-429a-bc5e-8070fe7ab617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:26:00.575027 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fc27f3-02ab-4663-9ddd-8d14ec2d5947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:00.576094 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fc27f3-02ab-4663-9ddd-8d14ec2d5947 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:00.576641 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fc27f3-02ab-4663-9ddd-8d14ec2d5947 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:00.577149 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fc27f3-02ab-4663-9ddd-8d14ec2d5947 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:00.579068 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fc27f3-02ab-4663-9ddd-8d14ec2d5947 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:00.579806 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fc27f3-02ab-4663-9ddd-8d14ec2d5947 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:00.583194 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fc27f3-02ab-4663-9ddd-8d14ec2d5947 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:00.595655 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:00.605551 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 212/428] 10.222.0.36 () {56 vars in 1111 bytes} [Fri Jun 24 22:26:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:00.614997 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fc27f3-02ab-4663-9ddd-8d14ec2d5947 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:00.643703 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:00.658713 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 217/429] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:26:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 22:26:00.688344 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5488712-b71a-429a-bc5e-8070fe7ab617 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:00.776829 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fc27f3-02ab-4663-9ddd-8d14ec2d5947 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:00.805894 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5488712-b71a-429a-bc5e-8070fe7ab617 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:00.818449 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de61517-d52b-4a4a-86f5-f4c050789376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:00.819417 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de61517-d52b-4a4a-86f5-f4c050789376 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:00.819871 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de61517-d52b-4a4a-86f5-f4c050789376 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:00.820306 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de61517-d52b-4a4a-86f5-f4c050789376 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:00.845166 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583abc5d-4e58-44dd-abaf-18fb4c63bd3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:00.846088 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583abc5d-4e58-44dd-abaf-18fb4c63bd3a None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:00.846370 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583abc5d-4e58-44dd-abaf-18fb4c63bd3a None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:00.846644 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583abc5d-4e58-44dd-abaf-18fb4c63bd3a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:00.861792 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583abc5d-4e58-44dd-abaf-18fb4c63bd3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 22:26:00.870336 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-583abc5d-4e58-44dd-abaf-18fb4c63bd3a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 22:26:00.870336 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:00.870336 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:00.870336 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:00.870336 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:00.870336 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:00.870336 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:00.870336 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:00.870336 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:00.870336 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:00.870336 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:00.870336 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:00.870336 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 22:26:00.870336 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 22:26:00.870336 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 22:26:00.870336 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 22:26:00.871290 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 22:26:00.871290 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 22:26:00.871290 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 22:26:00.871290 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 22:26:00.871290 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:00.871290 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:00.871290 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:00.871290 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:00.871290 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:00.871290 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:00.871290 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:00.871290 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:00.871290 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:00.871290 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:00.871290 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:00.871290 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:00.872933 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:00.872933 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:00.872933 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:00.872933 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:00.872933 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 22:26:00.872933 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 22:26:00.872933 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 22:26:00.872933 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 22:26:00.872933 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 22:26:00.872933 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 22:26:00.872933 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 22:26:00.872933 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:26:00.872933 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 218/430] 10.222.0.36 () {56 vars in 1099 bytes} [Fri Jun 24 22:26:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:00.873595 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49233124-23fb-4135-bbc9-5329efde3bb7 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:00.873595 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49233124-23fb-4135-bbc9-5329efde3bb7 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:00.873973 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49233124-23fb-4135-bbc9-5329efde3bb7 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:00.875125 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 219/431] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:26:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:26:00.880622 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49233124-23fb-4135-bbc9-5329efde3bb7 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:00.912728 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:00.919099 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de61517-d52b-4a4a-86f5-f4c050789376 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:00.919099 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de61517-d52b-4a4a-86f5-f4c050789376 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:00.953574 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:01.044715 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49233124-23fb-4135-bbc9-5329efde3bb7 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:01.061004 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 213/432] 10.222.0.36 () {58 vars in 1282 bytes} [Fri Jun 24 22:26:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 22:26:01.062182 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2905d36-9cbc-42e1-9c3c-d28176347e75 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:01.062473 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2905d36-9cbc-42e1-9c3c-d28176347e75 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:01.062752 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2905d36-9cbc-42e1-9c3c-d28176347e75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:01.080936 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-d2905d36-9cbc-42e1-9c3c-d28176347e75 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:26:01.082148 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-d2905d36-9cbc-42e1-9c3c-d28176347e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:26:01.101826 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6c6a5b-c479-43c3-bc6b-e3be11ec6554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:01.102519 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c6a5b-c479-43c3-bc6b-e3be11ec6554 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:01.103316 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c6a5b-c479-43c3-bc6b-e3be11ec6554 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:01.103576 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c6a5b-c479-43c3-bc6b-e3be11ec6554 None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:01.104432 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6c6a5b-c479-43c3-bc6b-e3be11ec6554 None admin] RBAC: Adding query filter params (name=member) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:01.104739 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6c6a5b-c479-43c3-bc6b-e3be11ec6554 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:01.106718 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6c6a5b-c479-43c3-bc6b-e3be11ec6554 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:01.131765 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 220/433] 10.222.0.36 () {56 vars in 1101 bytes} [Fri Jun 24 22:26:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:01.133224 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6c6a5b-c479-43c3-bc6b-e3be11ec6554 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:01.202683 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 214/434] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:26:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 22:26:01.203034 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2905d36-9cbc-42e1-9c3c-d28176347e75 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:01.236997 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:01.267936 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6c6a5b-c479-43c3-bc6b-e3be11ec6554 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:01.278534 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:01.305082 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af7a8e6-da04-4d70-8044-8c67b49e750d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:01.306218 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af7a8e6-da04-4d70-8044-8c67b49e750d None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:01.306346 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af7a8e6-da04-4d70-8044-8c67b49e750d None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:01.306842 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af7a8e6-da04-4d70-8044-8c67b49e750d None admin] PATH_INFO: `/v3/projects/8130cc4553114edcaa7ac3278c906eed` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:01.308243 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af7a8e6-da04-4d70-8044-8c67b49e750d None admin] RBAC: Authorizing `identity:get_project(project_id=8130cc4553114edcaa7ac3278c906eed)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:01.309802 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af7a8e6-da04-4d70-8044-8c67b49e750d None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:01.312278 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 221/435] 10.222.0.36 () {56 vars in 1186 bytes} [Fri Jun 24 22:26:01 2022] GET /identity/v3/projects/8130cc4553114edcaa7ac3278c906eed => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:01.313014 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af7a8e6-da04-4d70-8044-8c67b49e750d None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:01.335872 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2905d36-9cbc-42e1-9c3c-d28176347e75 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:01.378988 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec605eb-a164-43df-9b5d-aa7bf7d3f7a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:01.379696 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec605eb-a164-43df-9b5d-aa7bf7d3f7a4 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:01.379983 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec605eb-a164-43df-9b5d-aa7bf7d3f7a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:01.380265 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec605eb-a164-43df-9b5d-aa7bf7d3f7a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:01.437484 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af7a8e6-da04-4d70-8044-8c67b49e750d None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:01.461022 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec605eb-a164-43df-9b5d-aa7bf7d3f7a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:01.462791 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec605eb-a164-43df-9b5d-aa7bf7d3f7a4 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:01.479798 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bf7dcc-e84f-46ad-8f2b-490a02bce7db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:01.481026 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf7dcc-e84f-46ad-8f2b-490a02bce7db None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:01.481485 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf7dcc-e84f-46ad-8f2b-490a02bce7db None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:01.481940 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf7dcc-e84f-46ad-8f2b-490a02bce7db None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:01.489024 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:01.494049 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bf7dcc-e84f-46ad-8f2b-490a02bce7db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 22:26:01.503427 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-69bf7dcc-e84f-46ad-8f2b-490a02bce7db None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 22:26:01.503427 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:01.503427 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:01.503427 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:01.503427 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:01.503427 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:01.503427 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:01.503427 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:01.503427 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:01.503427 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:01.503427 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:01.503427 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:01.503427 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 22:26:01.503427 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 22:26:01.503427 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 22:26:01.503427 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 22:26:01.504307 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 22:26:01.504307 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 22:26:01.504307 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 22:26:01.504307 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 22:26:01.504307 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:01.504307 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:01.504307 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:01.504307 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:01.504307 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:01.504307 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:01.504307 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:01.504307 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:01.504307 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:01.504307 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:01.504307 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:01.504307 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:01.505144 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:01.505144 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:01.505144 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:01.505144 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:01.505144 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 22:26:01.505144 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 22:26:01.505144 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 22:26:01.505144 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 22:26:01.505144 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 22:26:01.505144 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 22:26:01.505144 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 22:26:01.505144 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:26:01.507870 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 222/436] 10.222.0.36 () {56 vars in 1114 bytes} [Fri Jun 24 22:26:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:01.508790 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bf7dcc-e84f-46ad-8f2b-490a02bce7db None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:01.548815 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:01.574895 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 215/437] 10.222.0.36 () {58 vars in 1282 bytes} [Fri Jun 24 22:26:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 22:26:01.575684 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec605eb-a164-43df-9b5d-aa7bf7d3f7a4 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:01.622109 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bf7dcc-e84f-46ad-8f2b-490a02bce7db None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:01.657801 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ecd4d2-7e20-4770-a424-2b06845219e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:01.658678 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ecd4d2-7e20-4770-a424-2b06845219e6 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:01.658988 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ecd4d2-7e20-4770-a424-2b06845219e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:01.659279 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ecd4d2-7e20-4770-a424-2b06845219e6 None admin] PATH_INFO: `/v3/groups/f3036b8220214ed49774b88ee620ee6c` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:01.660477 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ecd4d2-7e20-4770-a424-2b06845219e6 None admin] RBAC: Authorizing `identity:get_group(group_id=f3036b8220214ed49774b88ee620ee6c)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:01.661977 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ecd4d2-7e20-4770-a424-2b06845219e6 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:01.668415 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 223/438] 10.222.0.36 () {56 vars in 1180 bytes} [Fri Jun 24 22:26:01 2022] GET /identity/v3/groups/f3036b8220214ed49774b88ee620ee6c => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:01.668415 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ecd4d2-7e20-4770-a424-2b06845219e6 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:01.685266 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec605eb-a164-43df-9b5d-aa7bf7d3f7a4 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:01.712684 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:01.722336 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b1b6a7-687c-411c-9512-e3d94804f8f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:01.723013 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b1b6a7-687c-411c-9512-e3d94804f8f3 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:01.723319 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b1b6a7-687c-411c-9512-e3d94804f8f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:01.723593 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b1b6a7-687c-411c-9512-e3d94804f8f3 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:01.724340 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b1b6a7-687c-411c-9512-e3d94804f8f3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:01.724644 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b1b6a7-687c-411c-9512-e3d94804f8f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:01.726033 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b1b6a7-687c-411c-9512-e3d94804f8f3 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:01.735337 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 216/439] 10.222.0.36 () {56 vars in 1111 bytes} [Fri Jun 24 22:26:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:01.736120 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b1b6a7-687c-411c-9512-e3d94804f8f3 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:01.783718 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ecd4d2-7e20-4770-a424-2b06845219e6 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:01.786139 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:01.821694 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2517d2b8-dd47-496a-b365-24a691d3aebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:01.822673 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2517d2b8-dd47-496a-b365-24a691d3aebd None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:01.822962 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2517d2b8-dd47-496a-b365-24a691d3aebd None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:01.823242 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2517d2b8-dd47-496a-b365-24a691d3aebd None admin] PATH_INFO: `/v3/projects/deb0943e980a41b2987f1c69584ddf73` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:01.824483 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2517d2b8-dd47-496a-b365-24a691d3aebd None admin] RBAC: Authorizing `identity:get_project(project_id=deb0943e980a41b2987f1c69584ddf73)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:01.826002 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2517d2b8-dd47-496a-b365-24a691d3aebd None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:01.827857 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 224/440] 10.222.0.36 () {56 vars in 1186 bytes} [Fri Jun 24 22:26:01 2022] GET /identity/v3/projects/deb0943e980a41b2987f1c69584ddf73 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:01.832863 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2517d2b8-dd47-496a-b365-24a691d3aebd None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:01.848548 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b1b6a7-687c-411c-9512-e3d94804f8f3 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:01.886554 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1cabf6-a3ba-459b-b32c-dca4da4f3b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:01.887519 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1cabf6-a3ba-459b-b32c-dca4da4f3b14 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:01.887971 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1cabf6-a3ba-459b-b32c-dca4da4f3b14 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:01.888411 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1cabf6-a3ba-459b-b32c-dca4da4f3b14 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:01.889434 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1cabf6-a3ba-459b-b32c-dca4da4f3b14 None admin] RBAC: Adding query filter params (group.id=f3036b8220214ed49774b88ee620ee6c, role.id=bf32f251a7764c7188fd782b65275038, scope.project.id=8130cc4553114edcaa7ac3278c906eed) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:01.889930 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1cabf6-a3ba-459b-b32c-dca4da4f3b14 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:01.891509 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1cabf6-a3ba-459b-b32c-dca4da4f3b14 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:01.897932 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 217/441] 10.222.0.36 () {56 vars in 1376 bytes} [Fri Jun 24 22:26:01 2022] GET /identity/v3/role_assignments?group.id=f3036b8220214ed49774b88ee620ee6c&scope.project.id=8130cc4553114edcaa7ac3278c906eed&role.id=bf32f251a7764c7188fd782b65275038 => generated 611 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:01.905043 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1cabf6-a3ba-459b-b32c-dca4da4f3b14 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:01.944280 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2517d2b8-dd47-496a-b365-24a691d3aebd None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:01.978714 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:01.991874 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066d8696-35a0-4c3f-8180-d3914a01e759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:01.992588 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d8696-35a0-4c3f-8180-d3914a01e759 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:01.992877 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d8696-35a0-4c3f-8180-d3914a01e759 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:01.993154 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d8696-35a0-4c3f-8180-d3914a01e759 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:02.028695 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1cabf6-a3ba-459b-b32c-dca4da4f3b14 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:02.040851 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:02.070818 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4c7023-7e5d-4022-a727-1d1c6fa26c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:02.072654 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c7023-7e5d-4022-a727-1d1c6fa26c22 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:02.072654 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c7023-7e5d-4022-a727-1d1c6fa26c22 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:02.072654 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c7023-7e5d-4022-a727-1d1c6fa26c22 None admin] PATH_INFO: `/v3/groups/f3036b8220214ed49774b88ee620ee6c` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:02.073805 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4c7023-7e5d-4022-a727-1d1c6fa26c22 None admin] RBAC: Authorizing `identity:get_group(group_id=f3036b8220214ed49774b88ee620ee6c)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:02.075294 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4c7023-7e5d-4022-a727-1d1c6fa26c22 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:02.077009 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 218/442] 10.222.0.36 () {56 vars in 1180 bytes} [Fri Jun 24 22:26:01 2022] GET /identity/v3/groups/f3036b8220214ed49774b88ee620ee6c => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:02.077558 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066d8696-35a0-4c3f-8180-d3914a01e759 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:02.078159 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0bed5a-8940-4c0d-88ca-48bc60dd27e2 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:02.078444 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0bed5a-8940-4c0d-88ca-48bc60dd27e2 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:02.078720 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0bed5a-8940-4c0d-88ca-48bc60dd27e2 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:02.079877 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066d8696-35a0-4c3f-8180-d3914a01e759 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:02.080237 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 219/443] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:26:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:26:02.084865 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0bed5a-8940-4c0d-88ca-48bc60dd27e2 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:02.211494 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 225/444] 10.222.0.36 () {58 vars in 1282 bytes} [Fri Jun 24 22:26:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 22:26:02.213252 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13361ec-ff54-41af-b2da-9d5e44351b9b None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:02.213527 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13361ec-ff54-41af-b2da-9d5e44351b9b None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:02.213792 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13361ec-ff54-41af-b2da-9d5e44351b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:02.224594 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0bed5a-8940-4c0d-88ca-48bc60dd27e2 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:02.232698 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-e13361ec-ff54-41af-b2da-9d5e44351b9b None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:26:02.233882 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-e13361ec-ff54-41af-b2da-9d5e44351b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:26:02.250682 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:02.265121 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65481a15-10ca-4983-98de-7bc56f8b29a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:02.265791 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65481a15-10ca-4983-98de-7bc56f8b29a2 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:02.266076 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65481a15-10ca-4983-98de-7bc56f8b29a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:02.266363 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65481a15-10ca-4983-98de-7bc56f8b29a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:02.267204 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65481a15-10ca-4983-98de-7bc56f8b29a2 None admin] RBAC: Adding query filter params (group.id=f3036b8220214ed49774b88ee620ee6c, role.id=1928787bfcc745419829cd315900ac44, scope.project.id=deb0943e980a41b2987f1c69584ddf73) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:02.267549 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65481a15-10ca-4983-98de-7bc56f8b29a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:02.268998 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65481a15-10ca-4983-98de-7bc56f8b29a2 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:02.276722 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 220/445] 10.222.0.36 () {56 vars in 1376 bytes} [Fri Jun 24 22:26:02 2022] GET /identity/v3/role_assignments?group.id=f3036b8220214ed49774b88ee620ee6c&scope.project.id=deb0943e980a41b2987f1c69584ddf73&role.id=1928787bfcc745419829cd315900ac44 => generated 611 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:02.276722 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65481a15-10ca-4983-98de-7bc56f8b29a2 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:02.330733 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 226/446] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:26:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 22:26:02.355203 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13361ec-ff54-41af-b2da-9d5e44351b9b None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:02.357280 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:02.401644 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65481a15-10ca-4983-98de-7bc56f8b29a2 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:02.443748 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea9c401-fe8c-49c3-af5f-f74269f7ed5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:02.444718 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea9c401-fe8c-49c3-af5f-f74269f7ed5b None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:02.445060 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea9c401-fe8c-49c3-af5f-f74269f7ed5b None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:02.445742 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea9c401-fe8c-49c3-af5f-f74269f7ed5b None admin] PATH_INFO: `/v3/projects/deb0943e980a41b2987f1c69584ddf73` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:02.446611 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea9c401-fe8c-49c3-af5f-f74269f7ed5b None admin] RBAC: Authorizing `identity:get_project(project_id=deb0943e980a41b2987f1c69584ddf73)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:02.448166 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea9c401-fe8c-49c3-af5f-f74269f7ed5b None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:02.449885 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 221/447] 10.222.0.36 () {56 vars in 1186 bytes} [Fri Jun 24 22:26:02 2022] GET /identity/v3/projects/deb0943e980a41b2987f1c69584ddf73 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:02.455442 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea9c401-fe8c-49c3-af5f-f74269f7ed5b None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:02.476844 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13361ec-ff54-41af-b2da-9d5e44351b9b None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:02.517601 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605fdcc1-fe39-48c9-8f54-8fd2f2420975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:02.518441 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605fdcc1-fe39-48c9-8f54-8fd2f2420975 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:02.518724 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605fdcc1-fe39-48c9-8f54-8fd2f2420975 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:02.518997 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605fdcc1-fe39-48c9-8f54-8fd2f2420975 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:02.523693 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:02.532016 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605fdcc1-fe39-48c9-8f54-8fd2f2420975 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 22:26:02.539599 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-605fdcc1-fe39-48c9-8f54-8fd2f2420975 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 22:26:02.539599 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:02.539599 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:02.539599 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:02.539599 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:02.539599 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:02.539599 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:02.539599 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:02.539599 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:02.539599 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:02.539599 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:02.539599 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:02.539599 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 22:26:02.539599 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 22:26:02.539599 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 22:26:02.539599 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 22:26:02.541019 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 22:26:02.541019 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 22:26:02.541019 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 22:26:02.541019 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 22:26:02.541019 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:02.541019 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:02.541019 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:02.541019 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:02.541019 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:02.541019 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:02.541019 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:02.541019 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:02.541019 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:02.541019 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:02.541019 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:02.541019 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:02.541878 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:02.541878 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:02.541878 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:02.541878 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:02.541878 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 22:26:02.541878 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 22:26:02.541878 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 22:26:02.541878 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 22:26:02.541878 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 22:26:02.541878 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 22:26:02.541878 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 22:26:02.541878 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:26:02.541878 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 227/448] 10.222.0.36 () {56 vars in 1096 bytes} [Fri Jun 24 22:26:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:02.547595 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605fdcc1-fe39-48c9-8f54-8fd2f2420975 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:02.574703 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea9c401-fe8c-49c3-af5f-f74269f7ed5b None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:02.616133 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64730f21-66ed-4b6c-8561-25e48267d4b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:02.617004 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64730f21-66ed-4b6c-8561-25e48267d4b7 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:02.617285 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64730f21-66ed-4b6c-8561-25e48267d4b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:02.617558 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64730f21-66ed-4b6c-8561-25e48267d4b7 None admin] PATH_INFO: `/v3/groups/f3036b8220214ed49774b88ee620ee6c` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:02.618874 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64730f21-66ed-4b6c-8561-25e48267d4b7 None admin] RBAC: Authorizing `identity:get_group(group_id=f3036b8220214ed49774b88ee620ee6c)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:02.619840 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:02.620434 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64730f21-66ed-4b6c-8561-25e48267d4b7 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:02.623294 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 222/449] 10.222.0.36 () {56 vars in 1180 bytes} [Fri Jun 24 22:26:02 2022] GET /identity/v3/groups/f3036b8220214ed49774b88ee620ee6c => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:02.628317 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64730f21-66ed-4b6c-8561-25e48267d4b7 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:02.662908 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605fdcc1-fe39-48c9-8f54-8fd2f2420975 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:02.695344 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1e9215-e107-4d48-be51-45d01a595100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:02.696014 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1e9215-e107-4d48-be51-45d01a595100 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:02.696302 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1e9215-e107-4d48-be51-45d01a595100 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:02.696632 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1e9215-e107-4d48-be51-45d01a595100 None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:02.697389 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1e9215-e107-4d48-be51-45d01a595100 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:02.697691 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1e9215-e107-4d48-be51-45d01a595100 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:02.699100 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1e9215-e107-4d48-be51-45d01a595100 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:02.706978 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 228/450] 10.222.0.36 () {56 vars in 1099 bytes} [Fri Jun 24 22:26:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 22:26:02.712516 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1e9215-e107-4d48-be51-45d01a595100 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:02.726511 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64730f21-66ed-4b6c-8561-25e48267d4b7 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:02.748486 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:02.760035 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bb3f58-2c97-46fa-a2a8-28db6dee70ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:02.760693 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bb3f58-2c97-46fa-a2a8-28db6dee70ab None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:02.760974 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bb3f58-2c97-46fa-a2a8-28db6dee70ab None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:02.761252 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bb3f58-2c97-46fa-a2a8-28db6dee70ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:02.762083 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bb3f58-2c97-46fa-a2a8-28db6dee70ab None admin] RBAC: Adding query filter params (group.id=f3036b8220214ed49774b88ee620ee6c, role.id=bf32f251a7764c7188fd782b65275038, scope.project.id=deb0943e980a41b2987f1c69584ddf73) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:02.762392 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bb3f58-2c97-46fa-a2a8-28db6dee70ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:02.763866 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bb3f58-2c97-46fa-a2a8-28db6dee70ab None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:02.769543 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 223/451] 10.222.0.36 () {56 vars in 1376 bytes} [Fri Jun 24 22:26:02 2022] GET /identity/v3/role_assignments?group.id=f3036b8220214ed49774b88ee620ee6c&scope.project.id=deb0943e980a41b2987f1c69584ddf73&role.id=bf32f251a7764c7188fd782b65275038 => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 22:26:02.812001 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1e9215-e107-4d48-be51-45d01a595100 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:02.837723 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:02.849735 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea0b70f-0fd5-4bea-8c75-d2c0ee9cf6c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:02.850414 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0b70f-0fd5-4bea-8c75-d2c0ee9cf6c6 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:02.850695 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0b70f-0fd5-4bea-8c75-d2c0ee9cf6c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:02.850969 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0b70f-0fd5-4bea-8c75-d2c0ee9cf6c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:02.923159 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea0b70f-0fd5-4bea-8c75-d2c0ee9cf6c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:02.924640 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea0b70f-0fd5-4bea-8c75-d2c0ee9cf6c6 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:03.024233 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 229/452] 10.222.0.36 () {58 vars in 1282 bytes} [Fri Jun 24 22:26:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 24 22:26:03.030203 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bb3f58-2c97-46fa-a2a8-28db6dee70ab None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:03.135007 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bb3f58-2c97-46fa-a2a8-28db6dee70ab None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:03.182298 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1586cc3d-1573-4944-9a8d-698427694b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:03.183125 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1586cc3d-1573-4944-9a8d-698427694b21 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:03.183410 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1586cc3d-1573-4944-9a8d-698427694b21 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:03.183683 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1586cc3d-1573-4944-9a8d-698427694b21 None admin] PATH_INFO: `/v3/projects/ed521bc1cbbe4ae1823626f007bced73` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:03.184973 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1586cc3d-1573-4944-9a8d-698427694b21 None admin] RBAC: Authorizing `identity:get_project(project_id=ed521bc1cbbe4ae1823626f007bced73)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:03.186442 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1586cc3d-1573-4944-9a8d-698427694b21 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:03.188181 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 224/453] 10.222.0.36 () {56 vars in 1186 bytes} [Fri Jun 24 22:26:03 2022] GET /identity/v3/projects/ed521bc1cbbe4ae1823626f007bced73 => generated 344 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:03.193953 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea0b70f-0fd5-4bea-8c75-d2c0ee9cf6c6 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:03.219024 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:03.299896 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea0b70f-0fd5-4bea-8c75-d2c0ee9cf6c6 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:03.334629 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b9c7cf-cbb8-42dd-9778-945f267be6ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:03.335499 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b9c7cf-cbb8-42dd-9778-945f267be6ab None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:03.335785 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b9c7cf-cbb8-42dd-9778-945f267be6ab None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:03.336067 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b9c7cf-cbb8-42dd-9778-945f267be6ab None admin] PATH_INFO: `/v3/groups/017ee6bbe36848adac764167d7da2f78` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:03.337391 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b9c7cf-cbb8-42dd-9778-945f267be6ab None admin] RBAC: Authorizing `identity:get_group(group_id=017ee6bbe36848adac764167d7da2f78)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:03.338856 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b9c7cf-cbb8-42dd-9778-945f267be6ab None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:03.340508 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 230/454] 10.222.0.36 () {56 vars in 1180 bytes} [Fri Jun 24 22:26:03 2022] GET /identity/v3/groups/017ee6bbe36848adac764167d7da2f78 => generated 229 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:03.347069 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1586cc3d-1573-4944-9a8d-698427694b21 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:03.404149 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:03.453964 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1586cc3d-1573-4944-9a8d-698427694b21 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:03.491674 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e359631-f578-4caf-b77f-e03e72d01ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:03.492325 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e359631-f578-4caf-b77f-e03e72d01ae4 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:03.492602 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e359631-f578-4caf-b77f-e03e72d01ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:03.492872 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e359631-f578-4caf-b77f-e03e72d01ae4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:03.493722 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e359631-f578-4caf-b77f-e03e72d01ae4 None admin] RBAC: Adding query filter params (group.id=017ee6bbe36848adac764167d7da2f78, role.id=1a1c43cc97a0407eb7a7c7a1333a9d4a, scope.project.id=ed521bc1cbbe4ae1823626f007bced73) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:03.494048 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e359631-f578-4caf-b77f-e03e72d01ae4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:03.495551 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e359631-f578-4caf-b77f-e03e72d01ae4 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:03.501992 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 225/455] 10.222.0.36 () {56 vars in 1376 bytes} [Fri Jun 24 22:26:03 2022] GET /identity/v3/role_assignments?group.id=017ee6bbe36848adac764167d7da2f78&scope.project.id=ed521bc1cbbe4ae1823626f007bced73&role.id=1a1c43cc97a0407eb7a7c7a1333a9d4a => generated 611 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:06.167240 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53348066-6818-4779-b78e-f41939422668 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:06.167785 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53348066-6818-4779-b78e-f41939422668 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:06.167889 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53348066-6818-4779-b78e-f41939422668 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:06.169493 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 231/456] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:26:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:26:06.174502 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbb04ed-ce61-438f-9dd8-fc1c63a2afc7 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:06.174908 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbb04ed-ce61-438f-9dd8-fc1c63a2afc7 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:06.175087 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbb04ed-ce61-438f-9dd8-fc1c63a2afc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:06.196278 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-5fbb04ed-ce61-438f-9dd8-fc1c63a2afc7 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:26:06.198237 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-5fbb04ed-ce61-438f-9dd8-fc1c63a2afc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:26:06.297527 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 226/457] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:26:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 22:26:06.333980 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53348066-6818-4779-b78e-f41939422668 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:06.344601 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db11dc7-5c7a-43f6-819a-f6a332034734 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:06.344892 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db11dc7-5c7a-43f6-819a-f6a332034734 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:06.345161 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db11dc7-5c7a-43f6-819a-f6a332034734 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:06.348705 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 227/458] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:26:06 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:26:06.354032 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c6d9e2-2db9-4088-b6eb-05aa2b4070ea None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:06.354322 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c6d9e2-2db9-4088-b6eb-05aa2b4070ea None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:06.354656 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c6d9e2-2db9-4088-b6eb-05aa2b4070ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:06.387681 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-40c6d9e2-2db9-4088-b6eb-05aa2b4070ea None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:26:06.388884 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-40c6d9e2-2db9-4088-b6eb-05aa2b4070ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:26:06.458426 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:06.470389 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53348066-6818-4779-b78e-f41939422668 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:06.500548 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:06.508264 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb10218-8955-4ae1-80a6-c359a763a6b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:06.509278 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb10218-8955-4ae1-80a6-c359a763a6b4 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:06.509698 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb10218-8955-4ae1-80a6-c359a763a6b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:06.510107 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb10218-8955-4ae1-80a6-c359a763a6b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:06.520584 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb10218-8955-4ae1-80a6-c359a763a6b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:06.522224 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb10218-8955-4ae1-80a6-c359a763a6b4 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:06.527047 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 228/459] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:26:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 22:26:06.528720 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe8039-7e5e-4c2b-bccf-e9de090dd877 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:06.529199 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe8039-7e5e-4c2b-bccf-e9de090dd877 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:06.529699 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe8039-7e5e-4c2b-bccf-e9de090dd877 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:06.531477 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 229/460] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:26:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:26:06.536299 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2575ad68-728d-48fb-91fc-02c8df412e03 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:06.536788 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2575ad68-728d-48fb-91fc-02c8df412e03 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:06.537251 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2575ad68-728d-48fb-91fc-02c8df412e03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:06.550381 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-2fb10218-8955-4ae1-80a6-c359a763a6b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:06.550381 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:06.550381 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:06.550381 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:06.550381 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:06.550381 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:06.550381 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:06.550381 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:06.550381 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:06.550381 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:06.550381 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:06.550381 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:06.550381 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 22:26:06.550381 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 22:26:06.550381 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 22:26:06.551275 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 22:26:06.551275 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:06.551275 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:06.551275 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:06.551275 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:06.551275 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:06.551275 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:06.551275 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:06.551275 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:06.551275 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:06.551275 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:06.551275 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:06.551275 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:06.551275 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:06.551275 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:06.551275 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:06.551275 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:06.552130 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 22:26:06.552130 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 22:26:06.552130 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:06.552130 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:26:06.556813 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-2575ad68-728d-48fb-91fc-02c8df412e03 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:26:06.558191 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-2575ad68-728d-48fb-91fc-02c8df412e03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:26:06.560165 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 232/461] 10.222.0.36 () {56 vars in 1108 bytes} [Fri Jun 24 22:26:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:06.565853 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb10218-8955-4ae1-80a6-c359a763a6b4 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:06.634032 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 230/462] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:26:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 22:26:06.635818 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36d80b7-ab3f-4af4-85d6-03b0e491023d None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:06.636272 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36d80b7-ab3f-4af4-85d6-03b0e491023d None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:06.636709 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36d80b7-ab3f-4af4-85d6-03b0e491023d None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:06.638385 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 231/463] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:26:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:26:06.639267 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36d80b7-ab3f-4af4-85d6-03b0e491023d None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:06.671170 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb10218-8955-4ae1-80a6-c359a763a6b4 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:06.708324 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f80b7e-d28b-47d3-a41a-c5b5dfbe6d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:06.708913 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f80b7e-d28b-47d3-a41a-c5b5dfbe6d67 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:06.709191 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f80b7e-d28b-47d3-a41a-c5b5dfbe6d67 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:06.709466 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f80b7e-d28b-47d3-a41a-c5b5dfbe6d67 None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:06.710182 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f80b7e-d28b-47d3-a41a-c5b5dfbe6d67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:06.710485 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f80b7e-d28b-47d3-a41a-c5b5dfbe6d67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:06.711930 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f80b7e-d28b-47d3-a41a-c5b5dfbe6d67 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:06.729523 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 233/464] 10.222.0.36 () {56 vars in 1109 bytes} [Fri Jun 24 22:26:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 22:26:06.730718 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4718ec72-f26f-421d-9600-07022846bcb6 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:06.731004 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4718ec72-f26f-421d-9600-07022846bcb6 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:06.731261 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4718ec72-f26f-421d-9600-07022846bcb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:06.737225 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:06.750248 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-4718ec72-f26f-421d-9600-07022846bcb6 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:26:06.751460 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-4718ec72-f26f-421d-9600-07022846bcb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:26:06.764126 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36d80b7-ab3f-4af4-85d6-03b0e491023d None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:06.773893 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:06.800965 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9910132e-25f9-4078-9992-57af8d1cba6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:06.801997 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9910132e-25f9-4078-9992-57af8d1cba6d None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:06.802278 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9910132e-25f9-4078-9992-57af8d1cba6d None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:06.802546 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9910132e-25f9-4078-9992-57af8d1cba6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:06.813403 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9910132e-25f9-4078-9992-57af8d1cba6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:06.814855 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9910132e-25f9-4078-9992-57af8d1cba6d None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:06.819698 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 234/465] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:26:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 22:26:06.820368 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4718ec72-f26f-421d-9600-07022846bcb6 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:06.836728 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-9910132e-25f9-4078-9992-57af8d1cba6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:06.836728 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:06.836728 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:06.836728 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:06.836728 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:06.836728 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:06.836728 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:06.836728 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:06.836728 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:06.836728 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:06.836728 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:06.836728 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:06.836728 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 22:26:06.836728 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 22:26:06.836728 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 22:26:06.837861 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 22:26:06.837861 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:06.837861 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:06.837861 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:06.837861 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:06.837861 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:06.837861 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:06.837861 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:06.837861 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:06.837861 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:06.837861 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:06.837861 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:06.837861 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:06.837861 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:06.837861 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:06.837861 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:06.837861 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:06.838727 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 22:26:06.838727 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 22:26:06.838727 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:06.838727 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:26:06.842949 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 232/466] 10.222.0.36 () {56 vars in 1108 bytes} [Fri Jun 24 22:26:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:06.843851 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9910132e-25f9-4078-9992-57af8d1cba6d None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:06.939691 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4718ec72-f26f-421d-9600-07022846bcb6 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:06.956447 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9910132e-25f9-4078-9992-57af8d1cba6d None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:06.976319 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3750bdfa-4315-4dda-aa9c-d008420c2fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:06.977047 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3750bdfa-4315-4dda-aa9c-d008420c2fbb None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:06.977328 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3750bdfa-4315-4dda-aa9c-d008420c2fbb None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:06.977600 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3750bdfa-4315-4dda-aa9c-d008420c2fbb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:06.979991 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:06.990117 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3750bdfa-4315-4dda-aa9c-d008420c2fbb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:06.991612 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3750bdfa-4315-4dda-aa9c-d008420c2fbb None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:06.993779 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fdb5ee-7d23-4f92-b832-99efbae063e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:06.994461 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fdb5ee-7d23-4f92-b832-99efbae063e0 None admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:06.994793 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fdb5ee-7d23-4f92-b832-99efbae063e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:06.995070 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fdb5ee-7d23-4f92-b832-99efbae063e0 None admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:06.995834 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fdb5ee-7d23-4f92-b832-99efbae063e0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:06.997277 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fdb5ee-7d23-4f92-b832-99efbae063e0 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:07.009872 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-3750bdfa-4315-4dda-aa9c-d008420c2fbb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:07.009872 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:07.009872 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:07.009872 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:07.009872 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:07.009872 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:07.009872 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:07.009872 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:07.009872 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:07.009872 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:07.009872 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:07.009872 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:07.009872 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 22:26:07.009872 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 22:26:07.009872 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 22:26:07.010851 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 22:26:07.010851 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:07.010851 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:07.010851 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:07.010851 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:07.010851 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:07.010851 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:07.010851 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:07.010851 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:07.010851 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:07.010851 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:07.010851 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:07.010851 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:07.010851 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:07.010851 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:07.010851 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:07.010851 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:07.011708 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 22:26:07.011708 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 22:26:07.011708 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:07.011708 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:26:07.011708 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 235/467] 10.222.0.36 () {56 vars in 1108 bytes} [Fri Jun 24 22:26:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:07.011975 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3750bdfa-4315-4dda-aa9c-d008420c2fbb None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:07.024061 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 233/468] 10.222.0.36 () {60 vars in 1132 bytes} [Fri Jun 24 22:26:06 2022] POST /identity/v3/users => generated 246 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:26:07.036371 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fdb5ee-7d23-4f92-b832-99efbae063e0 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:07.067959 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:07.132361 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3750bdfa-4315-4dda-aa9c-d008420c2fbb None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:07.178457 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c98cd0-b0f8-4955-b229-6d4ca4845295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:07.179145 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c98cd0-b0f8-4955-b229-6d4ca4845295 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:07.179566 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c98cd0-b0f8-4955-b229-6d4ca4845295 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:07.179925 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c98cd0-b0f8-4955-b229-6d4ca4845295 None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:07.180948 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c98cd0-b0f8-4955-b229-6d4ca4845295 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:07.181439 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c98cd0-b0f8-4955-b229-6d4ca4845295 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:07.182925 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c98cd0-b0f8-4955-b229-6d4ca4845295 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:07.193133 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fdb5ee-7d23-4f92-b832-99efbae063e0 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:07.201791 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 236/469] 10.222.0.36 () {56 vars in 1109 bytes} [Fri Jun 24 22:26:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:07.202514 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c98cd0-b0f8-4955-b229-6d4ca4845295 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:07.243208 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d282dc-2950-4d5a-9f38-4320e1a409ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:07.244506 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d282dc-2950-4d5a-9f38-4320e1a409ce None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:07.244506 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d282dc-2950-4d5a-9f38-4320e1a409ce None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:07.244668 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d282dc-2950-4d5a-9f38-4320e1a409ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:07.263095 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:07.265475 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d282dc-2950-4d5a-9f38-4320e1a409ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:07.266970 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d282dc-2950-4d5a-9f38-4320e1a409ce None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:07.288437 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-20d282dc-2950-4d5a-9f38-4320e1a409ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:07.288437 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:07.288437 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:07.288437 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:07.288437 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:07.288437 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:07.288437 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:07.288437 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:07.288437 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:07.288437 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:07.288437 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:07.288437 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:07.288437 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 22:26:07.288437 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 22:26:07.288437 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 22:26:07.289494 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 22:26:07.289494 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:07.289494 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:07.289494 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:07.289494 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:07.289494 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:07.289494 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:07.289494 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:07.289494 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:07.289494 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:07.289494 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:07.289494 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:07.289494 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:07.289494 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:07.289494 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:07.289494 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:07.289494 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:07.290734 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 22:26:07.290734 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 22:26:07.290734 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:07.290734 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:26:07.290734 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 234/470] 10.222.0.36 () {56 vars in 1108 bytes} [Fri Jun 24 22:26:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:07.290734 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d282dc-2950-4d5a-9f38-4320e1a409ce None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:07.331669 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c98cd0-b0f8-4955-b229-6d4ca4845295 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:07.368198 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:07.371028 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853c1806-0d1c-4bd9-9eac-f6255406b5f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:07.371739 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853c1806-0d1c-4bd9-9eac-f6255406b5f6 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:07.372026 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853c1806-0d1c-4bd9-9eac-f6255406b5f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:07.373008 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853c1806-0d1c-4bd9-9eac-f6255406b5f6 None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:07.373008 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853c1806-0d1c-4bd9-9eac-f6255406b5f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:07.373332 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853c1806-0d1c-4bd9-9eac-f6255406b5f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:07.374760 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853c1806-0d1c-4bd9-9eac-f6255406b5f6 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:07.393816 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 237/471] 10.222.0.36 () {56 vars in 1109 bytes} [Fri Jun 24 22:26:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:07.393816 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eb0a33-6f3c-4f28-ad85-739869f6512e None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:07.393816 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eb0a33-6f3c-4f28-ad85-739869f6512e None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:07.393816 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eb0a33-6f3c-4f28-ad85-739869f6512e None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:07.393816 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 238/472] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:26:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:26:07.396009 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eb0a33-6f3c-4f28-ad85-739869f6512e None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:07.408930 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d282dc-2950-4d5a-9f38-4320e1a409ce None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:07.449389 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8f2168-ea4f-4a2a-8971-e203e90e1d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:07.450083 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8f2168-ea4f-4a2a-8971-e203e90e1d4f None admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:07.450365 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8f2168-ea4f-4a2a-8971-e203e90e1d4f None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:07.450640 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8f2168-ea4f-4a2a-8971-e203e90e1d4f None admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:07.451492 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8f2168-ea4f-4a2a-8971-e203e90e1d4f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:07.452970 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8f2168-ea4f-4a2a-8971-e203e90e1d4f None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:07.475430 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 235/473] 10.222.0.36 () {60 vars in 1132 bytes} [Fri Jun 24 22:26:07 2022] POST /identity/v3/users => generated 248 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:26:07.476542 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8f2168-ea4f-4a2a-8971-e203e90e1d4f None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:07.527061 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eb0a33-6f3c-4f28-ad85-739869f6512e None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:07.536358 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:07.569479 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dbbb90-ce34-48e3-8b4e-4d851d595c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:07.569906 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dbbb90-ce34-48e3-8b4e-4d851d595c18 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:07.570196 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dbbb90-ce34-48e3-8b4e-4d851d595c18 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:07.570547 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dbbb90-ce34-48e3-8b4e-4d851d595c18 None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:07.571517 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dbbb90-ce34-48e3-8b4e-4d851d595c18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:07.572484 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dbbb90-ce34-48e3-8b4e-4d851d595c18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:07.574001 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dbbb90-ce34-48e3-8b4e-4d851d595c18 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:07.594176 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 239/474] 10.222.0.36 () {56 vars in 1109 bytes} [Fri Jun 24 22:26:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:07.594176 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daac40f-7368-4e70-8987-3c5fa9184c1a None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:07.594176 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daac40f-7368-4e70-8987-3c5fa9184c1a None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:07.594176 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daac40f-7368-4e70-8987-3c5fa9184c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:07.611624 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-7daac40f-7368-4e70-8987-3c5fa9184c1a None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:26:07.613013 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-7daac40f-7368-4e70-8987-3c5fa9184c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:26:07.627823 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8f2168-ea4f-4a2a-8971-e203e90e1d4f None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:07.660759 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:07.678573 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170ac6d6-eb9b-448b-a486-4c0ecf1a29e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:07.679600 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170ac6d6-eb9b-448b-a486-4c0ecf1a29e6 None admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:07.680078 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170ac6d6-eb9b-448b-a486-4c0ecf1a29e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:07.680538 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170ac6d6-eb9b-448b-a486-4c0ecf1a29e6 None admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:07.681518 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170ac6d6-eb9b-448b-a486-4c0ecf1a29e6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:07.683237 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170ac6d6-eb9b-448b-a486-4c0ecf1a29e6 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:07.692016 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 240/475] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:26:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 22:26:07.692543 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daac40f-7368-4e70-8987-3c5fa9184c1a None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:07.714661 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 236/476] 10.222.0.36 () {60 vars in 1132 bytes} [Fri Jun 24 22:26:07 2022] POST /identity/v3/users => generated 248 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:26:07.717814 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170ac6d6-eb9b-448b-a486-4c0ecf1a29e6 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:07.829902 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:07.837508 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daac40f-7368-4e70-8987-3c5fa9184c1a None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:07.842510 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170ac6d6-eb9b-448b-a486-4c0ecf1a29e6 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:07.881289 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25ddeab-b440-4934-ad1c-d093b6db50d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:07.882072 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25ddeab-b440-4934-ad1c-d093b6db50d2 None admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:07.882356 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25ddeab-b440-4934-ad1c-d093b6db50d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:07.882630 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25ddeab-b440-4934-ad1c-d093b6db50d2 None admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:07.883425 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25ddeab-b440-4934-ad1c-d093b6db50d2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:07.885323 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25ddeab-b440-4934-ad1c-d093b6db50d2 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:07.910014 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 241/477] 10.222.0.36 () {60 vars in 1132 bytes} [Fri Jun 24 22:26:07 2022] POST /identity/v3/users => generated 249 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:26:07.928158 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557c5a9d-1972-41aa-b0e8-cb1c75d519ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:07.929008 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c5a9d-1972-41aa-b0e8-cb1c75d519ae None admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:07.929298 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c5a9d-1972-41aa-b0e8-cb1c75d519ae None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:07.929573 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c5a9d-1972-41aa-b0e8-cb1c75d519ae None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:07.930374 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557c5a9d-1972-41aa-b0e8-cb1c75d519ae None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:07.932052 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557c5a9d-1972-41aa-b0e8-cb1c75d519ae None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:07.939647 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.sql.core [None req-557c5a9d-1972-41aa-b0e8-cb1c75d519ae None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 24 22:26:07.939647 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 24 22:26:07.939647 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [parameters: {'id': '4c5b4584cf0844f4b4f5dbf8015c3473', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 24 22:26:07.939647 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80214) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 24 22:26:07.957854 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-557c5a9d-1972-41aa-b0e8-cb1c75d519ae None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 24 22:26:07.957854 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:07.957854 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 24 22:26:07.957854 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 24 22:26:07.957854 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 24 22:26:07.957854 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 24 22:26:07.957854 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 24 22:26:07.957854 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application result = self._query(query) Jun 24 22:26:07.957854 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 24 22:26:07.957854 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application conn.query(q) Jun 24 22:26:07.957854 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 24 22:26:07.957854 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 24 22:26:07.957854 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 24 22:26:07.957854 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application result.read() Jun 24 22:26:07.957854 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 24 22:26:07.958765 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 24 22:26:07.958765 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 24 22:26:07.958765 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 24 22:26:07.958765 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 24 22:26:07.958765 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 24 22:26:07.958765 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 24 22:26:07.958765 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 24 22:26:07.958765 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 24 22:26:07.958765 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:26:07.958765 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 24 22:26:07.958765 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:26:07.958765 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:07.958765 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 24 22:26:07.958765 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 24 22:26:07.958765 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 24 22:26:07.958765 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return ref.to_dict() Jun 24 22:26:07.958765 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 24 22:26:07.958765 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application next(self.gen) Jun 24 22:26:07.959714 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 24 22:26:07.959714 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application yield resource Jun 24 22:26:07.959714 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 24 22:26:07.959714 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application next(self.gen) Jun 24 22:26:07.959714 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 24 22:26:07.959714 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self.session.rollback() Jun 24 22:26:07.959714 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 24 22:26:07.959714 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self.force_reraise() Jun 24 22:26:07.959714 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 24 22:26:07.959714 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise self.value Jun 24 22:26:07.959714 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 24 22:26:07.959714 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 24 22:26:07.959714 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 24 22:26:07.959714 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application session.commit() Jun 24 22:26:07.959714 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 24 22:26:07.959714 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 24 22:26:07.959714 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 24 22:26:07.960570 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._prepare_impl() Jun 24 22:26:07.960570 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 24 22:26:07.960570 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self.session.flush() Jun 24 22:26:07.960570 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 24 22:26:07.960570 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._flush(objects) Jun 24 22:26:07.960570 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 24 22:26:07.960570 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 24 22:26:07.960570 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 24 22:26:07.960570 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application compat.raise_( Jun 24 22:26:07.960570 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 24 22:26:07.960570 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception Jun 24 22:26:07.960570 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 24 22:26:07.960570 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application flush_context.execute() Jun 24 22:26:07.960570 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 24 22:26:07.960570 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rec.execute(self) Jun 24 22:26:07.960570 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 24 22:26:07.960570 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 24 22:26:07.961469 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 24 22:26:07.961469 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 24 22:26:07.961469 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 24 22:26:07.961469 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 24 22:26:07.961469 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 24 22:26:07.961469 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 24 22:26:07.961469 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 24 22:26:07.961469 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 24 22:26:07.961469 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 24 22:26:07.961469 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 24 22:26:07.961469 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 24 22:26:07.961469 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 24 22:26:07.961469 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 24 22:26:07.961469 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 24 22:26:07.961469 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 24 22:26:07.961469 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception Jun 24 22:26:07.962380 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 24 22:26:07.962380 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 24 22:26:07.962380 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 24 22:26:07.962380 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 24 22:26:07.962380 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 24 22:26:07.962380 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application result = self._query(query) Jun 24 22:26:07.962380 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 24 22:26:07.962380 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application conn.query(q) Jun 24 22:26:07.962380 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 24 22:26:07.962380 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 24 22:26:07.962380 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 24 22:26:07.962380 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application result.read() Jun 24 22:26:07.962380 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 24 22:26:07.962380 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 24 22:26:07.962380 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 24 22:26:07.962380 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 24 22:26:07.963143 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 24 22:26:07.963143 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 24 22:26:07.963143 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 24 22:26:07.963143 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 24 22:26:07.963143 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 24 22:26:07.963143 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 24 22:26:07.963143 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [parameters: {'id': '4c5b4584cf0844f4b4f5dbf8015c3473', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 24 22:26:07.963143 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 24 22:26:07.963143 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:26:07.963143 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 22:26:07.963143 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:26:07.963143 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:07.963143 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:07.963143 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:07.963143 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:07.963143 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:07.966384 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:07.966384 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:07.966384 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:07.966384 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:07.966384 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:07.966384 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:07.966384 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 24 22:26:07.966384 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 24 22:26:07.966384 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:07.966384 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:07.966384 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 24 22:26:07.966384 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 24 22:26:07.966384 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 24 22:26:07.966384 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 24 22:26:07.966384 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 24 22:26:07.966384 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:26:07.968574 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 237/478] 10.222.0.36 () {60 vars in 1131 bytes} [Fri Jun 24 22:26:07 2022] POST /identity/v3/roles => generated 144 bytes in 242 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 24 22:26:07.968724 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25ddeab-b440-4934-ad1c-d093b6db50d2 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:08.088446 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25ddeab-b440-4934-ad1c-d093b6db50d2 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:08.127864 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e47b77b-1e7d-42c3-ae3f-2e082cf9b37f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:08.128692 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e47b77b-1e7d-42c3-ae3f-2e082cf9b37f None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:08.128974 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e47b77b-1e7d-42c3-ae3f-2e082cf9b37f None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:08.129244 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e47b77b-1e7d-42c3-ae3f-2e082cf9b37f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:08.142160 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e47b77b-1e7d-42c3-ae3f-2e082cf9b37f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 22:26:08.150867 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-2e47b77b-1e7d-42c3-ae3f-2e082cf9b37f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 22:26:08.150867 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:08.150867 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:08.150867 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:08.150867 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:08.150867 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:08.150867 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:08.150867 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:08.150867 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:08.150867 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:08.150867 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:08.150867 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:08.150867 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 22:26:08.150867 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 22:26:08.150867 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 22:26:08.150867 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 22:26:08.152432 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 22:26:08.152432 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 22:26:08.152432 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 22:26:08.152432 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 22:26:08.152432 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:08.152432 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:08.152432 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:08.152432 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:08.152432 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:08.152432 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:08.152432 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:08.152432 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:08.152432 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:08.152432 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:08.152432 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:08.152432 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:08.153228 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:08.153228 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:08.153228 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:08.153228 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:08.153228 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 22:26:08.153228 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 22:26:08.153228 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 22:26:08.153228 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 22:26:08.153228 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 22:26:08.153228 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 22:26:08.153228 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 22:26:08.153228 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:26:08.153228 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 242/479] 10.222.0.36 () {56 vars in 1114 bytes} [Fri Jun 24 22:26:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:08.158135 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557c5a9d-1972-41aa-b0e8-cb1c75d519ae None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:08.212389 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:08.279145 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557c5a9d-1972-41aa-b0e8-cb1c75d519ae None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:08.315481 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a833f6-c1d8-4254-9bf8-13f2d9ce9e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:08.316531 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a833f6-c1d8-4254-9bf8-13f2d9ce9e83 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:08.317009 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a833f6-c1d8-4254-9bf8-13f2d9ce9e83 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:08.317506 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a833f6-c1d8-4254-9bf8-13f2d9ce9e83 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:08.318450 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a833f6-c1d8-4254-9bf8-13f2d9ce9e83 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:08.318949 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a833f6-c1d8-4254-9bf8-13f2d9ce9e83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:08.320582 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a833f6-c1d8-4254-9bf8-13f2d9ce9e83 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:08.330724 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 238/480] 10.222.0.36 () {56 vars in 1111 bytes} [Fri Jun 24 22:26:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 22:26:09.320331 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5143fe-55ec-4d4a-9e6a-bc6d2bb12e26 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:09.320873 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5143fe-55ec-4d4a-9e6a-bc6d2bb12e26 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:09.320873 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5143fe-55ec-4d4a-9e6a-bc6d2bb12e26 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:09.323345 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 243/481] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:26:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:26:09.328598 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f3477a-bb3d-48c7-a16b-5458abd111f6 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:09.329068 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f3477a-bb3d-48c7-a16b-5458abd111f6 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:09.329145 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f3477a-bb3d-48c7-a16b-5458abd111f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:09.352272 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-49f3477a-bb3d-48c7-a16b-5458abd111f6 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:26:09.354254 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-49f3477a-bb3d-48c7-a16b-5458abd111f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:26:09.449907 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 239/482] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:26:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 22:26:09.492791 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5143fe-55ec-4d4a-9e6a-bc6d2bb12e26 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:09.512278 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:09.632912 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5143fe-55ec-4d4a-9e6a-bc6d2bb12e26 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:09.669977 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c1fde6-2a9b-49e7-9da5-230f9a57e118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:09.670781 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c1fde6-2a9b-49e7-9da5-230f9a57e118 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:09.671064 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c1fde6-2a9b-49e7-9da5-230f9a57e118 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:09.671370 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c1fde6-2a9b-49e7-9da5-230f9a57e118 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:09.681762 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c1fde6-2a9b-49e7-9da5-230f9a57e118 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 22:26:09.689398 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-c0c1fde6-2a9b-49e7-9da5-230f9a57e118 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 22:26:09.689398 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:09.689398 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:09.689398 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:09.689398 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:09.689398 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:09.689398 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:09.689398 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:09.689398 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:09.689398 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:09.689398 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:09.689398 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:09.689398 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 22:26:09.689398 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 22:26:09.689398 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 22:26:09.689398 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 22:26:09.690280 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 22:26:09.690280 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 22:26:09.690280 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 22:26:09.690280 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 22:26:09.690280 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:09.690280 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:09.690280 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:09.690280 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:09.690280 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:09.690280 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:09.690280 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:09.690280 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:09.690280 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:09.690280 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:09.690280 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:09.690280 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:09.691061 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:09.691061 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:09.691061 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:09.691061 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:09.691061 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 22:26:09.691061 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 22:26:09.691061 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 22:26:09.691061 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 22:26:09.691061 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 22:26:09.691061 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 22:26:09.691061 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 22:26:09.691061 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:26:09.691061 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 244/483] 10.222.0.36 () {56 vars in 1102 bytes} [Fri Jun 24 22:26:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:09.697484 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f3477a-bb3d-48c7-a16b-5458abd111f6 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:09.747785 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:09.845975 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f3477a-bb3d-48c7-a16b-5458abd111f6 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:09.908134 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e297c5e7-23b0-4aae-aaef-80bdb1ad82b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:09.908738 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e297c5e7-23b0-4aae-aaef-80bdb1ad82b6 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:09.909026 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e297c5e7-23b0-4aae-aaef-80bdb1ad82b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:09.909307 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e297c5e7-23b0-4aae-aaef-80bdb1ad82b6 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:09.910075 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e297c5e7-23b0-4aae-aaef-80bdb1ad82b6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:09.910445 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e297c5e7-23b0-4aae-aaef-80bdb1ad82b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:09.911932 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e297c5e7-23b0-4aae-aaef-80bdb1ad82b6 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:09.922971 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 240/484] 10.222.0.36 () {56 vars in 1103 bytes} [Fri Jun 24 22:26:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:09.928564 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c1fde6-2a9b-49e7-9da5-230f9a57e118 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:09.956858 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f37694-90fb-47cf-b88b-74fce2248357 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:09.957154 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f37694-90fb-47cf-b88b-74fce2248357 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:09.957618 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f37694-90fb-47cf-b88b-74fce2248357 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:09.959158 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 241/485] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:26:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 22:26:09.970503 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c347872-5e80-4be4-8661-ee9057bc24c3 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:09.970795 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c347872-5e80-4be4-8661-ee9057bc24c3 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:09.971197 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c347872-5e80-4be4-8661-ee9057bc24c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:09.999056 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-4c347872-5e80-4be4-8661-ee9057bc24c3 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:26:10.000275 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-4c347872-5e80-4be4-8661-ee9057bc24c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:26:10.065171 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:10.090253 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c1fde6-2a9b-49e7-9da5-230f9a57e118 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:10.128677 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fe870f-91fc-4983-abaa-aa07454c7c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:10.129490 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fe870f-91fc-4983-abaa-aa07454c7c60 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:10.129776 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fe870f-91fc-4983-abaa-aa07454c7c60 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:10.130053 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fe870f-91fc-4983-abaa-aa07454c7c60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:10.145511 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fe870f-91fc-4983-abaa-aa07454c7c60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:10.147027 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fe870f-91fc-4983-abaa-aa07454c7c60 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:10.147464 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 242/486] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:26:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 22:26:10.176421 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c347872-5e80-4be4-8661-ee9057bc24c3 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:10.184193 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-b8fe870f-91fc-4983-abaa-aa07454c7c60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:10.184193 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:10.184193 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:10.184193 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:10.184193 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:10.184193 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:10.184193 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:10.184193 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:10.184193 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:10.184193 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:10.184193 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:10.184193 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:10.184193 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 22:26:10.184193 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 22:26:10.184193 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 22:26:10.185049 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 22:26:10.185049 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:10.185049 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:10.185049 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:10.185049 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:10.185049 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:10.185049 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:10.185049 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:10.185049 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:10.185049 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:10.185049 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:10.185049 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:10.185049 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:10.185049 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:10.185049 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:10.185049 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:10.185049 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:10.190545 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 22:26:10.190545 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 22:26:10.190545 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:10.190545 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:26:10.190545 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 245/487] 10.222.0.36 () {56 vars in 1108 bytes} [Fri Jun 24 22:26:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:10.191139 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fe870f-91fc-4983-abaa-aa07454c7c60 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:10.247151 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:10.293507 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fe870f-91fc-4983-abaa-aa07454c7c60 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:10.328497 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:10.350505 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aac66c6-a1b8-47bc-a849-c2264e226ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:10.351195 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aac66c6-a1b8-47bc-a849-c2264e226ad1 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:10.351584 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aac66c6-a1b8-47bc-a849-c2264e226ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:10.351866 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aac66c6-a1b8-47bc-a849-c2264e226ad1 None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:10.352626 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aac66c6-a1b8-47bc-a849-c2264e226ad1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:10.352940 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aac66c6-a1b8-47bc-a849-c2264e226ad1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:10.354356 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aac66c6-a1b8-47bc-a849-c2264e226ad1 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:10.382088 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 246/488] 10.222.0.36 () {56 vars in 1109 bytes} [Fri Jun 24 22:26:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 22:26:10.384223 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aac66c6-a1b8-47bc-a849-c2264e226ad1 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:10.420974 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c347872-5e80-4be4-8661-ee9057bc24c3 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:10.484253 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c9f590-cc02-4a0f-b0b9-cc973c0342ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:10.485478 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c9f590-cc02-4a0f-b0b9-cc973c0342ae None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:10.485953 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c9f590-cc02-4a0f-b0b9-cc973c0342ae None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:10.486457 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c9f590-cc02-4a0f-b0b9-cc973c0342ae None admin] PATH_INFO: `/v3/roles/service` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:10.497744 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c9f590-cc02-4a0f-b0b9-cc973c0342ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 22:26:10.506633 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-81c9f590-cc02-4a0f-b0b9-cc973c0342ae None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 22:26:10.506633 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:10.506633 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:10.506633 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:10.506633 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:10.506633 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:10.506633 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:10.506633 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:10.506633 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:10.506633 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:10.506633 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:10.506633 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:10.506633 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 22:26:10.506633 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 22:26:10.506633 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 22:26:10.506633 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 22:26:10.507612 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 22:26:10.507612 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 22:26:10.507612 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 22:26:10.507612 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 22:26:10.507612 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:10.507612 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:10.507612 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:10.507612 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:10.507612 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:10.507612 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:10.507612 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:10.507612 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:10.507612 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:10.507612 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:10.507612 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:10.507612 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:10.508389 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:10.508389 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:10.508389 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:10.508389 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:10.508389 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 22:26:10.508389 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 22:26:10.508389 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 22:26:10.508389 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 22:26:10.508389 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 22:26:10.508389 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 22:26:10.508389 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 22:26:10.508389 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:26:10.511405 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 243/489] 10.222.0.36 () {56 vars in 1102 bytes} [Fri Jun 24 22:26:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:10.512934 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dab0bc-c58d-4992-9638-f67a3e1bb639 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:10.513464 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dab0bc-c58d-4992-9638-f67a3e1bb639 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:10.513929 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dab0bc-c58d-4992-9638-f67a3e1bb639 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:10.519581 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 244/490] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:26:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:26:10.520580 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dab0bc-c58d-4992-9638-f67a3e1bb639 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:10.533394 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aac66c6-a1b8-47bc-a849-c2264e226ad1 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:10.578782 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7930196e-86d9-4071-b576-10e14f3f46f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:10.579978 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7930196e-86d9-4071-b576-10e14f3f46f9 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:10.580449 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7930196e-86d9-4071-b576-10e14f3f46f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:10.581050 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7930196e-86d9-4071-b576-10e14f3f46f9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:10.591282 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7930196e-86d9-4071-b576-10e14f3f46f9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:10.593767 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7930196e-86d9-4071-b576-10e14f3f46f9 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:10.614924 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-7930196e-86d9-4071-b576-10e14f3f46f9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 24 22:26:10.614924 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:10.614924 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:10.614924 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:10.614924 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:10.614924 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:10.614924 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:10.614924 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:10.614924 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:10.614924 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:10.614924 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:10.614924 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:10.614924 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 22:26:10.614924 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 22:26:10.614924 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 22:26:10.614924 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 22:26:10.616095 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:10.616095 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:10.616095 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 22:26:10.616095 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 22:26:10.616095 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 22:26:10.616095 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 22:26:10.616095 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:10.616095 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:10.616095 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:10.616095 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:10.616095 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:10.616095 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:10.616095 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:10.616095 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:10.616095 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:10.616095 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:10.616095 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:10.616095 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:10.617201 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:10.617201 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:10.617201 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 22:26:10.617201 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 22:26:10.617201 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 22:26:10.617201 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 22:26:10.617201 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 22:26:10.617201 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 22:26:10.617201 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 24 22:26:10.617201 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:26:10.623584 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 247/491] 10.222.0.36 () {56 vars in 1093 bytes} [Fri Jun 24 22:26:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:10.625250 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083686ca-ea70-4a52-a669-396ccb563aa7 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:10.625250 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083686ca-ea70-4a52-a669-396ccb563aa7 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:10.625250 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083686ca-ea70-4a52-a669-396ccb563aa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:10.638837 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:10.650494 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-083686ca-ea70-4a52-a669-396ccb563aa7 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:26:10.652706 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-083686ca-ea70-4a52-a669-396ccb563aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:26:10.654670 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dab0bc-c58d-4992-9638-f67a3e1bb639 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:10.701536 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16584583-bb53-40d5-a07f-948ca643b14d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:10.702242 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16584583-bb53-40d5-a07f-948ca643b14d None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:10.702594 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16584583-bb53-40d5-a07f-948ca643b14d None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:10.702984 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16584583-bb53-40d5-a07f-948ca643b14d None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:10.703901 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16584583-bb53-40d5-a07f-948ca643b14d None admin] RBAC: Adding query filter params (name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:10.704130 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:10.704274 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16584583-bb53-40d5-a07f-948ca643b14d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:10.706207 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16584583-bb53-40d5-a07f-948ca643b14d None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:10.721428 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 245/492] 10.222.0.36 () {56 vars in 1103 bytes} [Fri Jun 24 22:26:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:10.721428 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16584583-bb53-40d5-a07f-948ca643b14d None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:10.742628 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 248/493] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:26:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 22:26:10.743486 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083686ca-ea70-4a52-a669-396ccb563aa7 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:10.823180 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16584583-bb53-40d5-a07f-948ca643b14d None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:10.858237 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3e85c8-14ad-46d7-91d5-5bbfb08169bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:10.858919 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e85c8-14ad-46d7-91d5-5bbfb08169bb None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:10.859201 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e85c8-14ad-46d7-91d5-5bbfb08169bb None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:10.859504 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e85c8-14ad-46d7-91d5-5bbfb08169bb None admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:10.860346 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3e85c8-14ad-46d7-91d5-5bbfb08169bb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:10.860659 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3e85c8-14ad-46d7-91d5-5bbfb08169bb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:10.862107 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3e85c8-14ad-46d7-91d5-5bbfb08169bb None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:10.866391 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083686ca-ea70-4a52-a669-396ccb563aa7 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:10.904163 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 246/494] 10.222.0.36 () {56 vars in 1133 bytes} [Fri Jun 24 22:26:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:10.904163 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467098a5-933e-4f11-85cb-fdcf574bc80f None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:10.904163 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467098a5-933e-4f11-85cb-fdcf574bc80f None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:10.904163 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467098a5-933e-4f11-85cb-fdcf574bc80f None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:10.904163 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 247/495] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:26:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:26:10.904163 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467098a5-933e-4f11-85cb-fdcf574bc80f None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:10.909099 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99173562-71fb-4cfb-915d-03d4b703cadb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:10.910114 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99173562-71fb-4cfb-915d-03d4b703cadb None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:10.910549 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99173562-71fb-4cfb-915d-03d4b703cadb None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:10.910962 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99173562-71fb-4cfb-915d-03d4b703cadb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:10.915358 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:10.924215 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99173562-71fb-4cfb-915d-03d4b703cadb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:10.925730 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99173562-71fb-4cfb-915d-03d4b703cadb None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:10.944103 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-99173562-71fb-4cfb-915d-03d4b703cadb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:10.944103 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:10.944103 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:10.944103 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:10.944103 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:10.944103 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:10.944103 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:10.944103 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:10.944103 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:10.944103 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:10.944103 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:10.944103 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:10.944103 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 22:26:10.944103 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 22:26:10.944103 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 22:26:10.944951 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 22:26:10.944951 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:10.944951 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:10.944951 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:10.944951 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:10.944951 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:10.944951 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:10.944951 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:10.944951 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:10.944951 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:10.944951 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:10.944951 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:10.944951 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:10.944951 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:10.944951 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:10.944951 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:10.944951 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:10.945769 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 22:26:10.945769 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 22:26:10.945769 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:10.945769 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:26:10.945769 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 249/496] 10.222.0.36 () {56 vars in 1108 bytes} [Fri Jun 24 22:26:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:10.946504 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e801fac8-b51b-46b3-bd2b-d53ea6ce722d None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:10.946793 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e801fac8-b51b-46b3-bd2b-d53ea6ce722d None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:10.947074 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e801fac8-b51b-46b3-bd2b-d53ea6ce722d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:10.966298 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-e801fac8-b51b-46b3-bd2b-d53ea6ce722d None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:26:10.967472 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-e801fac8-b51b-46b3-bd2b-d53ea6ce722d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:26:10.990188 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:11.019526 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467098a5-933e-4f11-85cb-fdcf574bc80f None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:11.051272 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 250/497] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:26:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 22:26:11.051272 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e801fac8-b51b-46b3-bd2b-d53ea6ce722d None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:11.071996 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3622a61-e41e-43f8-b93f-3579e99777e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:11.072893 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3622a61-e41e-43f8-b93f-3579e99777e9 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:11.073243 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3622a61-e41e-43f8-b93f-3579e99777e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:11.073571 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3622a61-e41e-43f8-b93f-3579e99777e9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:11.085072 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3622a61-e41e-43f8-b93f-3579e99777e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 22:26:11.092838 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-d3622a61-e41e-43f8-b93f-3579e99777e9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 22:26:11.092838 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:11.092838 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:11.092838 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:11.092838 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:11.092838 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:11.092838 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:11.092838 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:11.092838 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:11.092838 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:11.092838 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:11.092838 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:11.092838 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 22:26:11.092838 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 22:26:11.092838 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 22:26:11.092838 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 22:26:11.093709 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 22:26:11.093709 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 22:26:11.093709 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 22:26:11.093709 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 22:26:11.093709 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:11.093709 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:11.093709 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:11.093709 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:11.093709 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:11.093709 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:11.093709 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:11.093709 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:11.093709 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:11.093709 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:11.093709 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:11.093709 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:11.094479 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:11.094479 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:11.094479 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:11.094479 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:11.094479 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 22:26:11.094479 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 22:26:11.094479 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 22:26:11.094479 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 22:26:11.094479 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 22:26:11.094479 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 22:26:11.094479 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 22:26:11.094479 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:26:11.094479 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 248/498] 10.222.0.36 () {56 vars in 1102 bytes} [Fri Jun 24 22:26:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:11.095119 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3622a61-e41e-43f8-b93f-3579e99777e9 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:11.154429 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e801fac8-b51b-46b3-bd2b-d53ea6ce722d None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:11.163979 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:11.189294 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590536d9-86f5-4ddc-b865-5986ce454146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:11.189952 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590536d9-86f5-4ddc-b865-5986ce454146 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:11.190239 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590536d9-86f5-4ddc-b865-5986ce454146 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:11.190517 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590536d9-86f5-4ddc-b865-5986ce454146 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:11.198029 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3622a61-e41e-43f8-b93f-3579e99777e9 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:11.214421 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:11.232590 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a9fb9b-7e9d-43e3-8cd2-58b5482d4d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:11.233127 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a9fb9b-7e9d-43e3-8cd2-58b5482d4d33 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:11.233407 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a9fb9b-7e9d-43e3-8cd2-58b5482d4d33 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:11.233681 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a9fb9b-7e9d-43e3-8cd2-58b5482d4d33 None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:11.234403 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a9fb9b-7e9d-43e3-8cd2-58b5482d4d33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:11.234707 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a9fb9b-7e9d-43e3-8cd2-58b5482d4d33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:11.236177 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a9fb9b-7e9d-43e3-8cd2-58b5482d4d33 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:11.247873 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 249/499] 10.222.0.36 () {56 vars in 1109 bytes} [Fri Jun 24 22:26:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:11.248581 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a9fb9b-7e9d-43e3-8cd2-58b5482d4d33 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:11.259667 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590536d9-86f5-4ddc-b865-5986ce454146 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:11.261131 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590536d9-86f5-4ddc-b865-5986ce454146 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:11.352825 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a9fb9b-7e9d-43e3-8cd2-58b5482d4d33 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:11.364612 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 251/500] 10.222.0.36 () {58 vars in 1282 bytes} [Fri Jun 24 22:26:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 22:26:11.365454 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590536d9-86f5-4ddc-b865-5986ce454146 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:11.379200 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:11.387518 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5d246b-d1e8-4705-a5b2-b7d7fcf860b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:11.388315 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5d246b-d1e8-4705-a5b2-b7d7fcf860b8 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:11.388596 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5d246b-d1e8-4705-a5b2-b7d7fcf860b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:11.388870 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5d246b-d1e8-4705-a5b2-b7d7fcf860b8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:11.398854 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5d246b-d1e8-4705-a5b2-b7d7fcf860b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 22:26:11.406465 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-bf5d246b-d1e8-4705-a5b2-b7d7fcf860b8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 22:26:11.406465 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:11.406465 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:11.406465 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:11.406465 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:11.406465 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:11.406465 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:11.406465 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:11.406465 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:11.406465 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:11.406465 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:11.406465 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:11.406465 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 22:26:11.406465 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 22:26:11.406465 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 22:26:11.406465 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 22:26:11.407565 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 22:26:11.407565 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 22:26:11.407565 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 22:26:11.407565 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 22:26:11.407565 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:11.407565 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:11.407565 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:11.407565 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:11.407565 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:11.407565 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:11.407565 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:11.407565 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:11.407565 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:11.407565 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:11.407565 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:11.407565 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:11.408575 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:11.408575 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:11.408575 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:11.408575 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:11.408575 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 22:26:11.408575 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 22:26:11.408575 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 22:26:11.408575 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 22:26:11.408575 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 22:26:11.408575 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 22:26:11.408575 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 22:26:11.408575 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:26:11.408575 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 250/501] 10.222.0.36 () {56 vars in 1102 bytes} [Fri Jun 24 22:26:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:11.409387 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002a0161-1453-4045-8aaf-8de199ff7c2c None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:11.409387 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002a0161-1453-4045-8aaf-8de199ff7c2c None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:11.409387 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002a0161-1453-4045-8aaf-8de199ff7c2c None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:11.414827 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 251/502] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:26:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:26:11.414827 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002a0161-1453-4045-8aaf-8de199ff7c2c None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:11.428617 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:11.475808 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590536d9-86f5-4ddc-b865-5986ce454146 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:11.510305 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526a769c-941e-431b-ad62-2953cfd6c569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:11.510910 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526a769c-941e-431b-ad62-2953cfd6c569 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:11.511197 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526a769c-941e-431b-ad62-2953cfd6c569 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:11.511503 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526a769c-941e-431b-ad62-2953cfd6c569 None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:11.512259 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526a769c-941e-431b-ad62-2953cfd6c569 None admin] RBAC: Adding query filter params (name=service) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:11.512571 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526a769c-941e-431b-ad62-2953cfd6c569 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:11.514006 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526a769c-941e-431b-ad62-2953cfd6c569 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:11.517107 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002a0161-1453-4045-8aaf-8de199ff7c2c None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:11.522551 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 252/503] 10.222.0.36 () {56 vars in 1103 bytes} [Fri Jun 24 22:26:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:11.523215 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526a769c-941e-431b-ad62-2953cfd6c569 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:11.558376 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598176e2-cbb5-4b89-af42-f1391436d78c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:11.559172 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598176e2-cbb5-4b89-af42-f1391436d78c None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:11.559473 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598176e2-cbb5-4b89-af42-f1391436d78c None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:11.559743 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598176e2-cbb5-4b89-af42-f1391436d78c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:11.567333 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598176e2-cbb5-4b89-af42-f1391436d78c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:11.568796 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598176e2-cbb5-4b89-af42-f1391436d78c None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:11.584129 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-598176e2-cbb5-4b89-af42-f1391436d78c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 24 22:26:11.584129 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:11.584129 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:11.584129 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:11.584129 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:11.584129 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:11.584129 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:11.584129 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:11.584129 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:11.584129 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:11.584129 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:11.584129 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:11.584129 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 22:26:11.584129 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 22:26:11.584129 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 22:26:11.584129 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 22:26:11.585085 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:11.585085 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:11.585085 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 22:26:11.585085 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 22:26:11.585085 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 22:26:11.585085 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 22:26:11.585085 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:11.585085 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:11.585085 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:11.585085 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:11.585085 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:11.585085 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:11.585085 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:11.585085 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:11.585085 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:11.585085 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:11.585085 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:11.585085 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:11.585944 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:11.585944 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:11.585944 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 22:26:11.585944 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 22:26:11.585944 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 22:26:11.585944 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 22:26:11.585944 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 22:26:11.585944 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 22:26:11.585944 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 24 22:26:11.585944 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:26:11.585944 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 252/504] 10.222.0.36 () {56 vars in 1099 bytes} [Fri Jun 24 22:26:11 2022] GET /identity/v3/users/cinder => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:11.586497 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598176e2-cbb5-4b89-af42-f1391436d78c None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:11.626665 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526a769c-941e-431b-ad62-2953cfd6c569 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:11.635362 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:11.643512 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:11.661045 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ea8050-70b2-487a-a3cf-da7ad830407b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:11.661851 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea8050-70b2-487a-a3cf-da7ad830407b None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:11.662137 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea8050-70b2-487a-a3cf-da7ad830407b None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:11.662453 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea8050-70b2-487a-a3cf-da7ad830407b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:11.673381 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ea8050-70b2-487a-a3cf-da7ad830407b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:11.674886 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ea8050-70b2-487a-a3cf-da7ad830407b None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:11.686631 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598176e2-cbb5-4b89-af42-f1391436d78c None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:11.692588 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-02ea8050-70b2-487a-a3cf-da7ad830407b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:11.692588 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:11.692588 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:11.692588 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:11.692588 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:11.692588 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:11.692588 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:11.692588 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:11.692588 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:11.692588 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:11.692588 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:11.692588 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:11.692588 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 22:26:11.692588 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 22:26:11.692588 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 22:26:11.693388 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 22:26:11.693388 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:11.693388 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:11.693388 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:11.693388 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:11.693388 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:11.693388 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:11.693388 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:11.693388 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:11.693388 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:11.693388 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:11.693388 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:11.693388 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:11.693388 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:11.693388 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:11.693388 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:11.693388 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:11.694217 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 22:26:11.694217 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 22:26:11.694217 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:11.694217 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:26:11.694217 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 253/505] 10.222.0.36 () {56 vars in 1108 bytes} [Fri Jun 24 22:26:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:11.694973 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ec370a-5fde-484e-a88d-dd1e6f95b607 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:11.695235 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ec370a-5fde-484e-a88d-dd1e6f95b607 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:11.695536 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ec370a-5fde-484e-a88d-dd1e6f95b607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:11.712860 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-82ec370a-5fde-484e-a88d-dd1e6f95b607 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:26:11.714046 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-82ec370a-5fde-484e-a88d-dd1e6f95b607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:26:11.722557 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0572184e-ede2-4ffe-9f06-72b35099b062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:11.723620 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0572184e-ede2-4ffe-9f06-72b35099b062 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:11.723909 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0572184e-ede2-4ffe-9f06-72b35099b062 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:11.724186 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0572184e-ede2-4ffe-9f06-72b35099b062 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:11.725250 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0572184e-ede2-4ffe-9f06-72b35099b062 None admin] RBAC: Adding query filter params (name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:11.725556 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0572184e-ede2-4ffe-9f06-72b35099b062 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:11.726952 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0572184e-ede2-4ffe-9f06-72b35099b062 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:11.735275 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 253/506] 10.222.0.36 () {56 vars in 1103 bytes} [Fri Jun 24 22:26:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:11.735912 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0572184e-ede2-4ffe-9f06-72b35099b062 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:11.788412 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 254/507] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:26:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 22:26:11.789708 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ec370a-5fde-484e-a88d-dd1e6f95b607 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:11.834097 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0572184e-ede2-4ffe-9f06-72b35099b062 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:11.844355 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:11.869274 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e902327d-d410-4bcf-81e9-ffa70a803799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:11.870454 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e902327d-d410-4bcf-81e9-ffa70a803799 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:11.870732 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e902327d-d410-4bcf-81e9-ffa70a803799 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:11.871001 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e902327d-d410-4bcf-81e9-ffa70a803799 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:11.881935 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e902327d-d410-4bcf-81e9-ffa70a803799 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:11.883467 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e902327d-d410-4bcf-81e9-ffa70a803799 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:11.891194 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:11.894087 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ec370a-5fde-484e-a88d-dd1e6f95b607 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:11.900857 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-e902327d-d410-4bcf-81e9-ffa70a803799 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:11.900857 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:11.900857 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:11.900857 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:11.900857 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:11.900857 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:11.900857 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:11.900857 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:11.900857 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:11.900857 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:11.900857 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:11.900857 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:11.900857 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 22:26:11.900857 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 22:26:11.900857 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 22:26:11.901858 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 22:26:11.901858 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:11.901858 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:11.901858 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:11.901858 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:11.901858 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:11.901858 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:11.901858 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:11.901858 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:11.901858 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:11.901858 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:11.901858 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:11.901858 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:11.901858 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:11.901858 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:11.901858 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:11.901858 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:11.902767 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 22:26:11.902767 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 22:26:11.902767 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:11.902767 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:26:11.902767 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 254/508] 10.222.0.36 () {56 vars in 1108 bytes} [Fri Jun 24 22:26:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:11.903267 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e902327d-d410-4bcf-81e9-ffa70a803799 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:11.931872 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987e9982-a805-497e-a31e-24408a2cb698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:11.932683 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987e9982-a805-497e-a31e-24408a2cb698 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:11.933053 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987e9982-a805-497e-a31e-24408a2cb698 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:11.933423 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987e9982-a805-497e-a31e-24408a2cb698 None admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:11.934387 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987e9982-a805-497e-a31e-24408a2cb698 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:11.934795 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987e9982-a805-497e-a31e-24408a2cb698 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:11.936371 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987e9982-a805-497e-a31e-24408a2cb698 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:11.972348 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 255/509] 10.222.0.36 () {56 vars in 1137 bytes} [Fri Jun 24 22:26:11 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:11.973245 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987e9982-a805-497e-a31e-24408a2cb698 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:12.007102 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e902327d-d410-4bcf-81e9-ffa70a803799 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:12.041389 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7542c5-1373-4a6a-83d4-53a30ed3e2a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:12.041998 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7542c5-1373-4a6a-83d4-53a30ed3e2a0 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:12.042283 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7542c5-1373-4a6a-83d4-53a30ed3e2a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:12.042561 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7542c5-1373-4a6a-83d4-53a30ed3e2a0 None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:12.043339 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7542c5-1373-4a6a-83d4-53a30ed3e2a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:12.043697 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7542c5-1373-4a6a-83d4-53a30ed3e2a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:12.045085 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7542c5-1373-4a6a-83d4-53a30ed3e2a0 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:12.057930 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 255/510] 10.222.0.36 () {56 vars in 1109 bytes} [Fri Jun 24 22:26:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:12.058791 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7542c5-1373-4a6a-83d4-53a30ed3e2a0 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:12.074536 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987e9982-a805-497e-a31e-24408a2cb698 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:12.083905 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:12.108713 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5f2dfc-42cf-4496-bebb-9daee1d5c3d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:12.109529 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5f2dfc-42cf-4496-bebb-9daee1d5c3d0 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:12.109799 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5f2dfc-42cf-4496-bebb-9daee1d5c3d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:12.110068 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5f2dfc-42cf-4496-bebb-9daee1d5c3d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:12.120088 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5f2dfc-42cf-4496-bebb-9daee1d5c3d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:12.121573 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5f2dfc-42cf-4496-bebb-9daee1d5c3d0 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:12.138981 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-7d5f2dfc-42cf-4496-bebb-9daee1d5c3d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:12.138981 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:12.138981 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:12.138981 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:12.138981 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:12.138981 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:12.138981 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:12.138981 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:12.138981 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:12.138981 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:12.138981 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:12.138981 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:12.138981 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 22:26:12.138981 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 22:26:12.138981 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 22:26:12.139854 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 22:26:12.139854 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:12.139854 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:12.139854 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:12.139854 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:12.139854 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:12.139854 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:12.139854 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:12.139854 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:12.139854 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:12.139854 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:12.139854 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:12.139854 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:12.139854 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:12.139854 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:12.139854 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:12.139854 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:12.140692 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 22:26:12.140692 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 22:26:12.140692 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:12.140692 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:26:12.140692 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 256/511] 10.222.0.36 () {56 vars in 1108 bytes} [Fri Jun 24 22:26:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:12.141167 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5f2dfc-42cf-4496-bebb-9daee1d5c3d0 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:12.156981 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:12.166348 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7542c5-1373-4a6a-83d4-53a30ed3e2a0 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:12.199709 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3ccc2f-23cb-4ae7-a16a-2c91623feb1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:12.200512 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3ccc2f-23cb-4ae7-a16a-2c91623feb1a None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:12.200802 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3ccc2f-23cb-4ae7-a16a-2c91623feb1a None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:12.201079 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3ccc2f-23cb-4ae7-a16a-2c91623feb1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:12.211415 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3ccc2f-23cb-4ae7-a16a-2c91623feb1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:12.213098 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3ccc2f-23cb-4ae7-a16a-2c91623feb1a None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:12.230849 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-fd3ccc2f-23cb-4ae7-a16a-2c91623feb1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:12.230849 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:12.230849 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:12.230849 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:12.230849 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:12.230849 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:12.230849 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:12.230849 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:12.230849 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:12.230849 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:12.230849 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:12.230849 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:12.230849 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 22:26:12.230849 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 22:26:12.230849 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 22:26:12.231817 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 22:26:12.231817 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:12.231817 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:12.231817 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:12.231817 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:12.231817 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:12.231817 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:12.231817 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:12.231817 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:12.231817 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:12.231817 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:12.231817 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:12.231817 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:12.231817 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:12.231817 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:12.231817 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:12.231817 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:12.232650 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 22:26:12.232650 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 22:26:12.232650 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:12.232650 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:26:12.232650 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 256/512] 10.222.0.36 () {56 vars in 1108 bytes} [Fri Jun 24 22:26:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:12.232916 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3ccc2f-23cb-4ae7-a16a-2c91623feb1a None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:12.246756 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5f2dfc-42cf-4496-bebb-9daee1d5c3d0 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:12.280142 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f830630-764d-4795-bc58-60fbb9698930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:12.280835 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f830630-764d-4795-bc58-60fbb9698930 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:12.281115 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f830630-764d-4795-bc58-60fbb9698930 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:12.281390 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f830630-764d-4795-bc58-60fbb9698930 None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:12.282113 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f830630-764d-4795-bc58-60fbb9698930 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:12.282420 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f830630-764d-4795-bc58-60fbb9698930 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:12.283886 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f830630-764d-4795-bc58-60fbb9698930 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:12.295651 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 257/513] 10.222.0.36 () {56 vars in 1109 bytes} [Fri Jun 24 22:26:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:12.296423 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f830630-764d-4795-bc58-60fbb9698930 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:12.309933 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:12.336031 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3ccc2f-23cb-4ae7-a16a-2c91623feb1a None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:12.367969 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:12.373659 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de37e4d5-0fab-4f69-9384-7c5c9d602e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:12.374337 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de37e4d5-0fab-4f69-9384-7c5c9d602e2d None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:12.374620 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de37e4d5-0fab-4f69-9384-7c5c9d602e2d None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:12.374887 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de37e4d5-0fab-4f69-9384-7c5c9d602e2d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:12.400279 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f830630-764d-4795-bc58-60fbb9698930 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:12.436725 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e50c7d5-ee15-4684-95e4-616cf2ba37ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:12.437539 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e50c7d5-ee15-4684-95e4-616cf2ba37ff None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:12.437823 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e50c7d5-ee15-4684-95e4-616cf2ba37ff None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:12.438102 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e50c7d5-ee15-4684-95e4-616cf2ba37ff None admin] PATH_INFO: `/v3/projects/service` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:12.442002 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de37e4d5-0fab-4f69-9384-7c5c9d602e2d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:12.443505 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de37e4d5-0fab-4f69-9384-7c5c9d602e2d None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:12.445119 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e50c7d5-ee15-4684-95e4-616cf2ba37ff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:12.446580 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e50c7d5-ee15-4684-95e4-616cf2ba37ff None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:12.460942 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-0e50c7d5-ee15-4684-95e4-616cf2ba37ff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 22:26:12.460942 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:12.460942 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:12.460942 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:12.460942 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:12.460942 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:12.460942 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:12.460942 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:12.460942 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:12.460942 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:12.460942 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:12.460942 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:12.460942 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 22:26:12.460942 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 22:26:12.460942 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 22:26:12.461748 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 22:26:12.461748 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:12.461748 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:12.461748 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:12.461748 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:12.461748 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:12.461748 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:12.461748 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:12.461748 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:12.461748 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:12.461748 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:12.461748 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:12.461748 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:12.461748 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:12.461748 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:12.461748 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:12.461748 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:12.462665 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 22:26:12.462665 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 22:26:12.462665 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 22:26:12.462665 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 22:26:12.462665 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 22:26:12.462665 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 22:26:12.462665 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 22:26:12.462665 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:26:12.462665 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 258/514] 10.222.0.36 () {56 vars in 1111 bytes} [Fri Jun 24 22:26:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:12.463130 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e50c7d5-ee15-4684-95e4-616cf2ba37ff None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:12.519712 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:12.545983 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 257/515] 10.222.0.36 () {58 vars in 1282 bytes} [Fri Jun 24 22:26:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 22:26:12.546735 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de37e4d5-0fab-4f69-9384-7c5c9d602e2d None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:12.563044 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e50c7d5-ee15-4684-95e4-616cf2ba37ff None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:12.590040 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:12.596434 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41460ae-7d86-48be-bab0-1a4f1910d920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:12.597099 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41460ae-7d86-48be-bab0-1a4f1910d920 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:12.597380 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41460ae-7d86-48be-bab0-1a4f1910d920 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:12.597652 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41460ae-7d86-48be-bab0-1a4f1910d920 None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:12.598364 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41460ae-7d86-48be-bab0-1a4f1910d920 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:12.598668 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41460ae-7d86-48be-bab0-1a4f1910d920 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:12.600096 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41460ae-7d86-48be-bab0-1a4f1910d920 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:12.611702 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 259/516] 10.222.0.36 () {56 vars in 1109 bytes} [Fri Jun 24 22:26:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:12.612477 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41460ae-7d86-48be-bab0-1a4f1910d920 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:12.644772 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de37e4d5-0fab-4f69-9384-7c5c9d602e2d None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:12.679074 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3fd19f-40f6-4f6a-8164-3654bc22e3a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:12.679761 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3fd19f-40f6-4f6a-8164-3654bc22e3a0 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:12.680044 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3fd19f-40f6-4f6a-8164-3654bc22e3a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:12.680320 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3fd19f-40f6-4f6a-8164-3654bc22e3a0 None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:12.681285 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3fd19f-40f6-4f6a-8164-3654bc22e3a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:12.681735 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3fd19f-40f6-4f6a-8164-3654bc22e3a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:12.683148 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3fd19f-40f6-4f6a-8164-3654bc22e3a0 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:12.694714 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 258/517] 10.222.0.36 () {56 vars in 1109 bytes} [Fri Jun 24 22:26:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:12.695538 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3fd19f-40f6-4f6a-8164-3654bc22e3a0 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:12.710391 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41460ae-7d86-48be-bab0-1a4f1910d920 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:12.729152 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:12.743925 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c607a965-b74a-4a15-b1aa-293dc17980dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:12.744725 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c607a965-b74a-4a15-b1aa-293dc17980dd None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:12.744999 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c607a965-b74a-4a15-b1aa-293dc17980dd None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:12.745372 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c607a965-b74a-4a15-b1aa-293dc17980dd None admin] PATH_INFO: `/v3/users/glance` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:12.752390 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c607a965-b74a-4a15-b1aa-293dc17980dd None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:12.753850 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c607a965-b74a-4a15-b1aa-293dc17980dd None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:12.768232 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-c607a965-b74a-4a15-b1aa-293dc17980dd None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 24 22:26:12.768232 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:12.768232 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:12.768232 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:12.768232 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:12.768232 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:12.768232 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:12.768232 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:12.768232 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:12.768232 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:12.768232 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:12.768232 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:12.768232 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 22:26:12.768232 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 22:26:12.768232 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 22:26:12.768232 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 22:26:12.769113 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:12.769113 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:12.769113 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 22:26:12.769113 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 22:26:12.769113 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 22:26:12.769113 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 22:26:12.769113 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:12.769113 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:12.769113 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:12.769113 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:12.769113 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:12.769113 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:12.769113 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:12.769113 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:12.769113 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:12.769113 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:12.769113 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:12.769113 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:12.769965 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:12.769965 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:12.769965 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 22:26:12.769965 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 22:26:12.769965 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 22:26:12.769965 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 22:26:12.769965 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 22:26:12.769965 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 22:26:12.769965 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 24 22:26:12.769965 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:26:12.769965 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 260/518] 10.222.0.36 () {56 vars in 1099 bytes} [Fri Jun 24 22:26:12 2022] GET /identity/v3/users/glance => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:12.770934 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c607a965-b74a-4a15-b1aa-293dc17980dd None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:12.799353 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3fd19f-40f6-4f6a-8164-3654bc22e3a0 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:12.822482 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:12.834661 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8988c02e-f5c9-4784-8e49-fe570736a99b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:12.835350 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8988c02e-f5c9-4784-8e49-fe570736a99b None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:12.835700 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8988c02e-f5c9-4784-8e49-fe570736a99b None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:12.835977 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8988c02e-f5c9-4784-8e49-fe570736a99b None admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:12.836986 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8988c02e-f5c9-4784-8e49-fe570736a99b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:12.837465 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8988c02e-f5c9-4784-8e49-fe570736a99b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:12.839186 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8988c02e-f5c9-4784-8e49-fe570736a99b None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:12.857629 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 259/519] 10.222.0.36 () {56 vars in 1148 bytes} [Fri Jun 24 22:26:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:12.858421 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8988c02e-f5c9-4784-8e49-fe570736a99b None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:12.876052 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c607a965-b74a-4a15-b1aa-293dc17980dd None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:12.910714 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c7f7d2-58a6-46ed-b1ac-dbf3f2dc9af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:12.911559 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c7f7d2-58a6-46ed-b1ac-dbf3f2dc9af7 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:12.911834 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c7f7d2-58a6-46ed-b1ac-dbf3f2dc9af7 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:12.912106 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c7f7d2-58a6-46ed-b1ac-dbf3f2dc9af7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:12.922536 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c7f7d2-58a6-46ed-b1ac-dbf3f2dc9af7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:12.924522 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c7f7d2-58a6-46ed-b1ac-dbf3f2dc9af7 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:12.941988 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-97c7f7d2-58a6-46ed-b1ac-dbf3f2dc9af7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:12.941988 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:12.941988 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:12.941988 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:12.941988 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:12.941988 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:12.941988 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:12.941988 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:12.941988 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:12.941988 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:12.941988 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:12.941988 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:12.941988 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 22:26:12.941988 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 22:26:12.941988 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 22:26:12.942837 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 22:26:12.942837 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:12.942837 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:12.942837 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:12.942837 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:12.942837 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:12.942837 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:12.942837 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:12.942837 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:12.942837 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:12.942837 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:12.942837 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:12.942837 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:12.942837 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:12.942837 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:12.942837 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:12.942837 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:12.943679 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 22:26:12.943679 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 22:26:12.943679 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:12.943679 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:26:12.943679 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 261/520] 10.222.0.36 () {56 vars in 1108 bytes} [Fri Jun 24 22:26:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:12.943951 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c7f7d2-58a6-46ed-b1ac-dbf3f2dc9af7 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:12.954395 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:12.961663 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8988c02e-f5c9-4784-8e49-fe570736a99b None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:12.996472 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d8d145-fe52-4ce7-bba2-c9f6a152e086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:12.997271 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d8d145-fe52-4ce7-bba2-c9f6a152e086 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:12.997547 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d8d145-fe52-4ce7-bba2-c9f6a152e086 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:12.997804 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d8d145-fe52-4ce7-bba2-c9f6a152e086 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:13.005132 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d8d145-fe52-4ce7-bba2-c9f6a152e086 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:13.006894 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d8d145-fe52-4ce7-bba2-c9f6a152e086 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:13.021671 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-25d8d145-fe52-4ce7-bba2-c9f6a152e086 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 24 22:26:13.021671 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:13.021671 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:13.021671 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:13.021671 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:13.021671 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:13.021671 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:13.021671 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:13.021671 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:13.021671 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:13.021671 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:13.021671 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:13.021671 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 22:26:13.021671 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 22:26:13.021671 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 22:26:13.021671 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 22:26:13.022619 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:13.022619 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:13.022619 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 22:26:13.022619 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 22:26:13.022619 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 22:26:13.022619 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 22:26:13.022619 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:13.022619 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:13.022619 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:13.022619 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:13.022619 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:13.022619 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:13.022619 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:13.022619 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:13.022619 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:13.022619 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:13.022619 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:13.022619 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:13.023554 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:13.023554 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:13.023554 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 22:26:13.023554 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 22:26:13.023554 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 22:26:13.023554 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 22:26:13.023554 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 22:26:13.023554 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 22:26:13.023554 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 24 22:26:13.023554 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:26:13.023554 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 260/521] 10.222.0.36 () {56 vars in 1102 bytes} [Fri Jun 24 22:26:12 2022] GET /identity/v3/users/neutron => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:13.024115 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d8d145-fe52-4ce7-bba2-c9f6a152e086 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:13.049133 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c7f7d2-58a6-46ed-b1ac-dbf3f2dc9af7 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:13.050744 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:13.086590 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967780a0-aff2-4165-8d94-05cfd574a385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:13.087286 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967780a0-aff2-4165-8d94-05cfd574a385 None admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:13.087580 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967780a0-aff2-4165-8d94-05cfd574a385 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:13.087853 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967780a0-aff2-4165-8d94-05cfd574a385 None admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:13.088562 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967780a0-aff2-4165-8d94-05cfd574a385 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:13.090029 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967780a0-aff2-4165-8d94-05cfd574a385 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:13.110254 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 262/522] 10.222.0.36 () {60 vars in 1132 bytes} [Fri Jun 24 22:26:12 2022] POST /identity/v3/users => generated 247 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:26:13.111048 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967780a0-aff2-4165-8d94-05cfd574a385 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:13.126020 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d8d145-fe52-4ce7-bba2-c9f6a152e086 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:13.172211 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f4d4c9-5818-4d5d-9100-7f12408230b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:13.173011 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f4d4c9-5818-4d5d-9100-7f12408230b0 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:13.173295 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f4d4c9-5818-4d5d-9100-7f12408230b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:13.173574 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f4d4c9-5818-4d5d-9100-7f12408230b0 None admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:13.174476 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f4d4c9-5818-4d5d-9100-7f12408230b0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:13.174784 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f4d4c9-5818-4d5d-9100-7f12408230b0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:13.176292 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f4d4c9-5818-4d5d-9100-7f12408230b0 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:13.199299 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 261/523] 10.222.0.36 () {56 vars in 1137 bytes} [Fri Jun 24 22:26:13 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:13.199299 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f4d4c9-5818-4d5d-9100-7f12408230b0 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:13.212604 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:13.267117 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967780a0-aff2-4165-8d94-05cfd574a385 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:13.308409 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6c4493-9972-4379-ba1e-e76031e62331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:13.309314 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6c4493-9972-4379-ba1e-e76031e62331 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:13.309419 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6c4493-9972-4379-ba1e-e76031e62331 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:13.310262 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6c4493-9972-4379-ba1e-e76031e62331 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:13.311293 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6c4493-9972-4379-ba1e-e76031e62331 None admin] RBAC: Adding query filter params (role.id=3265c7c44fb144a0a56467ded2a39413, scope.project.id=d189b31bbec0469381292d2cde3cb420, user.id=214d9071042c4bad886bf060a079b6e2) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:13.311533 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6c4493-9972-4379-ba1e-e76031e62331 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:13.313150 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6c4493-9972-4379-ba1e-e76031e62331 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:13.316250 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f4d4c9-5818-4d5d-9100-7f12408230b0 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:13.320079 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 263/524] 10.222.0.36 () {56 vars in 1374 bytes} [Fri Jun 24 22:26:13 2022] GET /identity/v3/role_assignments?user.id=214d9071042c4bad886bf060a079b6e2&scope.project.id=d189b31bbec0469381292d2cde3cb420&role.id=3265c7c44fb144a0a56467ded2a39413 => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:13.320902 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6c4493-9972-4379-ba1e-e76031e62331 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:13.348793 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:13.356317 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88b5028-6df5-4bd3-83e9-9b965afa488c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:13.357380 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88b5028-6df5-4bd3-83e9-9b965afa488c None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:13.357676 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88b5028-6df5-4bd3-83e9-9b965afa488c None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:13.358083 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88b5028-6df5-4bd3-83e9-9b965afa488c None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:13.358853 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88b5028-6df5-4bd3-83e9-9b965afa488c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:13.359166 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88b5028-6df5-4bd3-83e9-9b965afa488c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:13.360680 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88b5028-6df5-4bd3-83e9-9b965afa488c None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:13.375293 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 262/525] 10.222.0.36 () {56 vars in 1109 bytes} [Fri Jun 24 22:26:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:13.377288 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88b5028-6df5-4bd3-83e9-9b965afa488c None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:13.455878 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:13.458571 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6c4493-9972-4379-ba1e-e76031e62331 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:13.498168 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88b5028-6df5-4bd3-83e9-9b965afa488c None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:13.501967 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00b13e3-e9df-4572-8203-9647fee4cc4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:13.502670 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b13e3-e9df-4572-8203-9647fee4cc4c None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:13.502957 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b13e3-e9df-4572-8203-9647fee4cc4c None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:13.503238 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b13e3-e9df-4572-8203-9647fee4cc4c None admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:13.504132 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00b13e3-e9df-4572-8203-9647fee4cc4c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:13.504451 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00b13e3-e9df-4572-8203-9647fee4cc4c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:13.506993 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00b13e3-e9df-4572-8203-9647fee4cc4c None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:13.533620 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 264/526] 10.222.0.36 () {56 vars in 1139 bytes} [Fri Jun 24 22:26:13 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:13.534550 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00b13e3-e9df-4572-8203-9647fee4cc4c None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:13.543285 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fd9280-5a7d-4862-9cc1-36b8bc0a3759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:13.543285 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fd9280-5a7d-4862-9cc1-36b8bc0a3759 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:13.543285 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fd9280-5a7d-4862-9cc1-36b8bc0a3759 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:13.543285 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fd9280-5a7d-4862-9cc1-36b8bc0a3759 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:13.621183 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fd9280-5a7d-4862-9cc1-36b8bc0a3759 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:13.622821 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fd9280-5a7d-4862-9cc1-36b8bc0a3759 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:13.638101 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:13.668522 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00b13e3-e9df-4572-8203-9647fee4cc4c None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:13.706621 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:13.716948 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a160dd-6d66-4057-be0b-f1d7c7b54e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:13.718046 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a160dd-6d66-4057-be0b-f1d7c7b54e91 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:13.718332 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a160dd-6d66-4057-be0b-f1d7c7b54e91 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:13.718614 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a160dd-6d66-4057-be0b-f1d7c7b54e91 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:13.727519 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a160dd-6d66-4057-be0b-f1d7c7b54e91 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:13.729676 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a160dd-6d66-4057-be0b-f1d7c7b54e91 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:13.742190 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 263/527] 10.222.0.36 () {58 vars in 1282 bytes} [Fri Jun 24 22:26:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 22:26:13.743158 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fd9280-5a7d-4862-9cc1-36b8bc0a3759 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:13.746598 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-10a160dd-6d66-4057-be0b-f1d7c7b54e91 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 22:26:13.746598 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:13.746598 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:13.746598 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:13.746598 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:13.746598 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:13.746598 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:13.746598 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:13.746598 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:13.746598 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:13.746598 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:13.746598 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:13.746598 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 22:26:13.746598 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 22:26:13.746598 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 22:26:13.747448 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 22:26:13.747448 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:13.747448 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:13.747448 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:13.747448 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:13.747448 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:13.747448 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:13.747448 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:13.747448 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:13.747448 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:13.747448 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:13.747448 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:13.747448 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:13.747448 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:13.747448 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:13.747448 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:13.747448 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:13.748270 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 22:26:13.748270 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 22:26:13.748270 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 22:26:13.748270 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 22:26:13.748270 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 22:26:13.748270 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 22:26:13.748270 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 22:26:13.748270 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:26:13.752551 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 265/528] 10.222.0.36 () {56 vars in 1111 bytes} [Fri Jun 24 22:26:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:13.753380 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a160dd-6d66-4057-be0b-f1d7c7b54e91 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:13.874708 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fd9280-5a7d-4862-9cc1-36b8bc0a3759 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:13.875922 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a160dd-6d66-4057-be0b-f1d7c7b54e91 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:13.921752 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a18144-c646-4d5e-870f-072bfb28dcb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:13.922581 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a18144-c646-4d5e-870f-072bfb28dcb8 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:13.922843 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a18144-c646-4d5e-870f-072bfb28dcb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:13.923126 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a18144-c646-4d5e-870f-072bfb28dcb8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:13.925675 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca51765-478e-4218-9ee1-70cb25f9d588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:13.926874 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca51765-478e-4218-9ee1-70cb25f9d588 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:13.927413 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca51765-478e-4218-9ee1-70cb25f9d588 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:13.927911 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca51765-478e-4218-9ee1-70cb25f9d588 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:13.933033 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:13.937011 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a18144-c646-4d5e-870f-072bfb28dcb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:13.940426 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a18144-c646-4d5e-870f-072bfb28dcb8 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:13.965178 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-90a18144-c646-4d5e-870f-072bfb28dcb8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:13.965178 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:13.965178 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:13.965178 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:13.965178 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:13.965178 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:13.965178 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:13.965178 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:13.965178 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:13.965178 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:13.965178 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:13.965178 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:13.965178 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 22:26:13.965178 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 22:26:13.965178 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 22:26:13.966112 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 22:26:13.966112 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:13.966112 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:13.966112 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:13.966112 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:13.966112 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:13.966112 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:13.966112 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:13.966112 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:13.966112 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:13.966112 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:13.966112 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:13.966112 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:13.966112 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:13.966112 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:13.966112 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:13.966112 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:13.966923 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 22:26:13.966923 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 22:26:13.966923 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:13.966923 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:26:13.966923 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 266/529] 10.222.0.36 () {56 vars in 1108 bytes} [Fri Jun 24 22:26:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:13.967761 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a18144-c646-4d5e-870f-072bfb28dcb8 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:13.982417 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:14.017297 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca51765-478e-4218-9ee1-70cb25f9d588 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:14.019599 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca51765-478e-4218-9ee1-70cb25f9d588 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:14.081038 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a18144-c646-4d5e-870f-072bfb28dcb8 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:14.118892 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2624d614-b713-467e-8450-15d7a73305e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:14.119560 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2624d614-b713-467e-8450-15d7a73305e1 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:14.119844 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2624d614-b713-467e-8450-15d7a73305e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:14.120116 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2624d614-b713-467e-8450-15d7a73305e1 None admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:14.120984 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2624d614-b713-467e-8450-15d7a73305e1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:14.121290 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2624d614-b713-467e-8450-15d7a73305e1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:14.122963 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2624d614-b713-467e-8450-15d7a73305e1 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:14.141929 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 267/530] 10.222.0.36 () {56 vars in 1148 bytes} [Fri Jun 24 22:26:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:14.144138 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 264/531] 10.222.0.36 () {58 vars in 1282 bytes} [Fri Jun 24 22:26:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 22:26:14.152033 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2624d614-b713-467e-8450-15d7a73305e1 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:14.152187 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca51765-478e-4218-9ee1-70cb25f9d588 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:14.206394 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:14.247430 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:14.260312 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2624d614-b713-467e-8450-15d7a73305e1 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:14.289689 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca51765-478e-4218-9ee1-70cb25f9d588 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:14.306962 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8eacfa-a31c-4916-9989-9358aec6158a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:14.308000 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8eacfa-a31c-4916-9989-9358aec6158a None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:14.308459 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8eacfa-a31c-4916-9989-9358aec6158a None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:14.308986 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8eacfa-a31c-4916-9989-9358aec6158a None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:14.309985 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8eacfa-a31c-4916-9989-9358aec6158a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:14.310461 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8eacfa-a31c-4916-9989-9358aec6158a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:14.312055 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8eacfa-a31c-4916-9989-9358aec6158a None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:14.325293 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 268/532] 10.222.0.36 () {56 vars in 1109 bytes} [Fri Jun 24 22:26:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:14.326640 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8eacfa-a31c-4916-9989-9358aec6158a None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:14.327166 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6803db51-a2c9-44bd-b948-1b80e8639248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:14.327899 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6803db51-a2c9-44bd-b948-1b80e8639248 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:14.328248 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6803db51-a2c9-44bd-b948-1b80e8639248 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:14.328583 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6803db51-a2c9-44bd-b948-1b80e8639248 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:14.329745 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6803db51-a2c9-44bd-b948-1b80e8639248 None admin] RBAC: Adding query filter params (role.id=3265c7c44fb144a0a56467ded2a39413, scope.project.id=d189b31bbec0469381292d2cde3cb420, user.id=e4a747e2a5684843a6ee9e3480badac7) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:14.329993 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6803db51-a2c9-44bd-b948-1b80e8639248 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:14.331575 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6803db51-a2c9-44bd-b948-1b80e8639248 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:14.343408 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 265/533] 10.222.0.36 () {56 vars in 1374 bytes} [Fri Jun 24 22:26:14 2022] GET /identity/v3/role_assignments?user.id=e4a747e2a5684843a6ee9e3480badac7&scope.project.id=d189b31bbec0469381292d2cde3cb420&role.id=3265c7c44fb144a0a56467ded2a39413 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:14.344589 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6803db51-a2c9-44bd-b948-1b80e8639248 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:14.451202 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8eacfa-a31c-4916-9989-9358aec6158a None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:14.459551 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:14.486404 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeb16c1-c4d8-4243-9eec-6b68bf5247fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:14.487282 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb16c1-c4d8-4243-9eec-6b68bf5247fa None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:14.487618 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb16c1-c4d8-4243-9eec-6b68bf5247fa None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:14.487896 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb16c1-c4d8-4243-9eec-6b68bf5247fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:14.501396 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeb16c1-c4d8-4243-9eec-6b68bf5247fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:14.502950 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeb16c1-c4d8-4243-9eec-6b68bf5247fa None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:14.522220 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-dbeb16c1-c4d8-4243-9eec-6b68bf5247fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:14.522220 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:14.522220 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:14.522220 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:14.522220 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:14.522220 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:14.522220 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:14.522220 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:14.522220 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:14.522220 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:14.522220 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:14.522220 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:14.522220 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 22:26:14.522220 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 22:26:14.522220 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 22:26:14.523104 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 22:26:14.523104 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:14.523104 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:14.523104 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:14.523104 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:14.523104 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:14.523104 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:14.523104 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:14.523104 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:14.523104 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:14.523104 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:14.523104 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:14.523104 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:14.523104 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:14.523104 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:14.523104 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:14.523104 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:14.524465 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 22:26:14.524465 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 22:26:14.524465 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:14.524465 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:26:14.524465 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 269/534] 10.222.0.36 () {56 vars in 1108 bytes} [Fri Jun 24 22:26:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:14.529452 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeb16c1-c4d8-4243-9eec-6b68bf5247fa None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:14.610064 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6803db51-a2c9-44bd-b948-1b80e8639248 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:14.638282 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeb16c1-c4d8-4243-9eec-6b68bf5247fa None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:14.676790 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49379c09-393f-4dac-9085-8cc770b6c570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:14.677020 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4e13c7-2e59-4675-97de-f9f6b628a24e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:14.677480 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4e13c7-2e59-4675-97de-f9f6b628a24e None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:14.677768 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4e13c7-2e59-4675-97de-f9f6b628a24e None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:14.678050 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4e13c7-2e59-4675-97de-f9f6b628a24e None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:14.678689 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49379c09-393f-4dac-9085-8cc770b6c570 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:14.678799 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4e13c7-2e59-4675-97de-f9f6b628a24e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:14.679074 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4e13c7-2e59-4675-97de-f9f6b628a24e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:14.679454 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49379c09-393f-4dac-9085-8cc770b6c570 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:14.679924 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49379c09-393f-4dac-9085-8cc770b6c570 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:14.680535 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4e13c7-2e59-4675-97de-f9f6b628a24e None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:14.685742 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:14.694377 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49379c09-393f-4dac-9085-8cc770b6c570 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:14.695954 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 270/535] 10.222.0.36 () {56 vars in 1109 bytes} [Fri Jun 24 22:26:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 22:26:14.696441 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49379c09-393f-4dac-9085-8cc770b6c570 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:14.701893 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4e13c7-2e59-4675-97de-f9f6b628a24e None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:14.724144 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-49379c09-393f-4dac-9085-8cc770b6c570 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 22:26:14.724144 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:14.724144 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:14.724144 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:14.724144 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:14.724144 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:14.724144 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:14.724144 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:14.724144 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:14.724144 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:14.724144 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:14.724144 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:14.724144 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 22:26:14.724144 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 22:26:14.724144 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 22:26:14.725037 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 22:26:14.725037 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:14.725037 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:14.725037 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:14.725037 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:14.725037 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:14.725037 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:14.725037 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:14.725037 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:14.725037 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:14.725037 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:14.725037 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:14.725037 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:14.725037 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:14.725037 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:14.725037 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:14.725037 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:14.725862 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 22:26:14.725862 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 22:26:14.725862 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 22:26:14.725862 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 22:26:14.725862 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 22:26:14.725862 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 22:26:14.725862 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 22:26:14.725862 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:26:14.731241 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:14.731617 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 266/536] 10.222.0.36 () {56 vars in 1111 bytes} [Fri Jun 24 22:26:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 384 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:14.736169 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49379c09-393f-4dac-9085-8cc770b6c570 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:14.810655 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4e13c7-2e59-4675-97de-f9f6b628a24e None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:14.846199 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf640f5d-d742-4f54-a26f-1aba8dd02f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:14.847009 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf640f5d-d742-4f54-a26f-1aba8dd02f02 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:14.847311 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf640f5d-d742-4f54-a26f-1aba8dd02f02 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:14.847593 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf640f5d-d742-4f54-a26f-1aba8dd02f02 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:14.855172 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf640f5d-d742-4f54-a26f-1aba8dd02f02 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:14.856804 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf640f5d-d742-4f54-a26f-1aba8dd02f02 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:14.872070 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-cf640f5d-d742-4f54-a26f-1aba8dd02f02 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 22:26:14.872070 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:14.872070 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:14.872070 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:14.872070 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:14.872070 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:14.872070 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:14.872070 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:14.872070 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:14.872070 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:14.872070 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:14.872070 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:14.872070 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 22:26:14.872070 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 22:26:14.872070 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 22:26:14.873037 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 22:26:14.873037 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:14.873037 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:14.873037 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:14.873037 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:14.873037 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:14.873037 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:14.873037 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:14.873037 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:14.873037 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:14.873037 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:14.873037 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:14.873037 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:14.873037 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:14.873037 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:14.873037 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:14.873037 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:14.874313 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 22:26:14.874313 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 22:26:14.874313 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 22:26:14.874313 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 22:26:14.874313 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 22:26:14.874313 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 22:26:14.874313 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 22:26:14.874313 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:26:14.874313 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 271/537] 10.222.0.36 () {56 vars in 1111 bytes} [Fri Jun 24 22:26:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:14.879385 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf640f5d-d742-4f54-a26f-1aba8dd02f02 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:14.965552 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49379c09-393f-4dac-9085-8cc770b6c570 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:14.977145 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:14.995897 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf640f5d-d742-4f54-a26f-1aba8dd02f02 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:15.034528 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d317d6e3-4e7b-4bc4-80c2-64ba893b2d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:15.035205 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d317d6e3-4e7b-4bc4-80c2-64ba893b2d97 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:15.035512 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d317d6e3-4e7b-4bc4-80c2-64ba893b2d97 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:15.035786 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d317d6e3-4e7b-4bc4-80c2-64ba893b2d97 None admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:15.036589 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d317d6e3-4e7b-4bc4-80c2-64ba893b2d97 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:15.036897 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d317d6e3-4e7b-4bc4-80c2-64ba893b2d97 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:15.038371 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d317d6e3-4e7b-4bc4-80c2-64ba893b2d97 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:15.051376 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 272/538] 10.222.0.36 () {56 vars in 1148 bytes} [Fri Jun 24 22:26:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:15.052670 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fac5da-a2c4-4683-b6c5-26874e5c8998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:15.053609 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fac5da-a2c4-4683-b6c5-26874e5c8998 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:15.054087 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fac5da-a2c4-4683-b6c5-26874e5c8998 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:15.054633 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fac5da-a2c4-4683-b6c5-26874e5c8998 None admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:15.055790 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fac5da-a2c4-4683-b6c5-26874e5c8998 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:15.056644 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fac5da-a2c4-4683-b6c5-26874e5c8998 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:15.057444 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d317d6e3-4e7b-4bc4-80c2-64ba893b2d97 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:15.058658 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fac5da-a2c4-4683-b6c5-26874e5c8998 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:15.081083 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 267/539] 10.222.0.36 () {56 vars in 1148 bytes} [Fri Jun 24 22:26:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:15.082447 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fac5da-a2c4-4683-b6c5-26874e5c8998 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:15.161983 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d317d6e3-4e7b-4bc4-80c2-64ba893b2d97 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:15.188733 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:15.209701 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e618e6fe-ce5f-4705-a6fd-fe1710f0bbf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:15.210367 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e618e6fe-ce5f-4705-a6fd-fe1710f0bbf0 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:15.210650 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e618e6fe-ce5f-4705-a6fd-fe1710f0bbf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:15.210926 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e618e6fe-ce5f-4705-a6fd-fe1710f0bbf0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:15.212143 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e618e6fe-ce5f-4705-a6fd-fe1710f0bbf0 None admin] RBAC: Adding query filter params (role.id=3265c7c44fb144a0a56467ded2a39413, scope.project.id=d189b31bbec0469381292d2cde3cb420, user.id=b78f1fcce4174d1a931453d930d306f9) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:15.212143 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e618e6fe-ce5f-4705-a6fd-fe1710f0bbf0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:15.213696 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e618e6fe-ce5f-4705-a6fd-fe1710f0bbf0 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:15.220142 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 273/540] 10.222.0.36 () {56 vars in 1374 bytes} [Fri Jun 24 22:26:15 2022] GET /identity/v3/role_assignments?user.id=b78f1fcce4174d1a931453d930d306f9&scope.project.id=d189b31bbec0469381292d2cde3cb420&role.id=3265c7c44fb144a0a56467ded2a39413 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 22:26:15.231079 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fac5da-a2c4-4683-b6c5-26874e5c8998 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:15.272104 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e05b3e-f5cb-43ce-be14-781ddca19956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:15.273163 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e05b3e-f5cb-43ce-be14-781ddca19956 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:15.273640 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e05b3e-f5cb-43ce-be14-781ddca19956 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:15.274130 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e05b3e-f5cb-43ce-be14-781ddca19956 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:15.275278 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e05b3e-f5cb-43ce-be14-781ddca19956 None admin] RBAC: Adding query filter params (role.id=3265c7c44fb144a0a56467ded2a39413, scope.project.id=d189b31bbec0469381292d2cde3cb420, user.id=d156158fa06647569a8bb2d8d0019f28) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:15.275819 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e05b3e-f5cb-43ce-be14-781ddca19956 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:15.277536 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e05b3e-f5cb-43ce-be14-781ddca19956 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:15.284893 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 268/541] 10.222.0.36 () {56 vars in 1374 bytes} [Fri Jun 24 22:26:15 2022] GET /identity/v3/role_assignments?user.id=d156158fa06647569a8bb2d8d0019f28&scope.project.id=d189b31bbec0469381292d2cde3cb420&role.id=3265c7c44fb144a0a56467ded2a39413 => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:15.384534 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e240fefc-e849-425d-8fe3-96507bea2f60 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:15.384871 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e240fefc-e849-425d-8fe3-96507bea2f60 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:15.385100 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e240fefc-e849-425d-8fe3-96507bea2f60 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:15.386888 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 274/542] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:26:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:26:15.392584 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8782af7b-85bd-4d45-a3f7-2b085d0d5ea1 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:15.392934 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8782af7b-85bd-4d45-a3f7-2b085d0d5ea1 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:15.393145 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8782af7b-85bd-4d45-a3f7-2b085d0d5ea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:15.415087 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-8782af7b-85bd-4d45-a3f7-2b085d0d5ea1 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:26:15.416364 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-8782af7b-85bd-4d45-a3f7-2b085d0d5ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:26:15.521072 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 269/543] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:26:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 22:26:15.544368 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e240fefc-e849-425d-8fe3-96507bea2f60 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:15.563880 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:15.667090 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e240fefc-e849-425d-8fe3-96507bea2f60 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:15.706931 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c553fd9-56df-46fa-83e8-f1c826c7e224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:15.712211 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c553fd9-56df-46fa-83e8-f1c826c7e224 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:15.712792 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c553fd9-56df-46fa-83e8-f1c826c7e224 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:15.713212 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c553fd9-56df-46fa-83e8-f1c826c7e224 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:15.721802 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6a6170-ffd7-436d-95c3-5494a8a986e7 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:15.722311 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6a6170-ffd7-436d-95c3-5494a8a986e7 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:15.722467 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6a6170-ffd7-436d-95c3-5494a8a986e7 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:15.725298 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c553fd9-56df-46fa-83e8-f1c826c7e224 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 22:26:15.727780 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 270/544] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:26:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:26:15.729081 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724a523b-973e-45e4-9449-1572f795c5ff None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:15.729461 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724a523b-973e-45e4-9449-1572f795c5ff None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:15.729827 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724a523b-973e-45e4-9449-1572f795c5ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:15.734395 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-7c553fd9-56df-46fa-83e8-f1c826c7e224 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 22:26:15.734395 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:15.734395 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:15.734395 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:15.734395 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:15.734395 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:15.734395 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:15.734395 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:15.734395 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:15.734395 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:15.734395 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:15.734395 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:15.734395 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 22:26:15.734395 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 22:26:15.734395 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 22:26:15.734395 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 22:26:15.735456 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 22:26:15.735456 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 22:26:15.735456 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 22:26:15.735456 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 22:26:15.735456 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:15.735456 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:15.735456 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:15.735456 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:15.735456 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:15.735456 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:15.735456 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:15.735456 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:15.735456 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:15.735456 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:15.735456 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:15.735456 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:15.736467 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:15.736467 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:15.736467 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:15.736467 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:15.736467 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 22:26:15.736467 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 22:26:15.736467 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 22:26:15.736467 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 22:26:15.736467 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 22:26:15.736467 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 22:26:15.736467 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 22:26:15.736467 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:26:15.738820 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 275/545] 10.222.0.36 () {56 vars in 1102 bytes} [Fri Jun 24 22:26:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:15.744214 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c553fd9-56df-46fa-83e8-f1c826c7e224 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:15.755001 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-724a523b-973e-45e4-9449-1572f795c5ff None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:26:15.756608 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-724a523b-973e-45e4-9449-1572f795c5ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:26:15.840563 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:15.875673 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:15.884333 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 271/546] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:26:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 22:26:15.914745 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c553fd9-56df-46fa-83e8-f1c826c7e224 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:15.943578 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724a523b-973e-45e4-9449-1572f795c5ff None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:15.981694 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade9699d-854e-4e8b-bd02-0c9a95160699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:15.982385 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade9699d-854e-4e8b-bd02-0c9a95160699 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:15.982667 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade9699d-854e-4e8b-bd02-0c9a95160699 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:15.982939 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade9699d-854e-4e8b-bd02-0c9a95160699 None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:15.985750 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade9699d-854e-4e8b-bd02-0c9a95160699 None admin] RBAC: Adding query filter params (name=service) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:15.986071 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade9699d-854e-4e8b-bd02-0c9a95160699 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:15.987512 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade9699d-854e-4e8b-bd02-0c9a95160699 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:16.006943 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 276/547] 10.222.0.36 () {56 vars in 1103 bytes} [Fri Jun 24 22:26:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:16.012190 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade9699d-854e-4e8b-bd02-0c9a95160699 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:16.077556 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724a523b-973e-45e4-9449-1572f795c5ff None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:16.135673 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba21adf3-ad3c-4853-aa41-91f924cae558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:16.136487 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba21adf3-ad3c-4853-aa41-91f924cae558 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:16.136769 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba21adf3-ad3c-4853-aa41-91f924cae558 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:16.137043 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba21adf3-ad3c-4853-aa41-91f924cae558 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:16.149073 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba21adf3-ad3c-4853-aa41-91f924cae558 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 22:26:16.158285 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-ba21adf3-ad3c-4853-aa41-91f924cae558 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 22:26:16.158285 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:16.158285 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:16.158285 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:16.158285 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:16.158285 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:16.158285 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:16.158285 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:16.158285 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:16.158285 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:16.158285 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:16.158285 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:16.158285 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 22:26:16.158285 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 22:26:16.158285 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 22:26:16.158285 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 22:26:16.159169 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 22:26:16.159169 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 22:26:16.159169 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 22:26:16.159169 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 22:26:16.159169 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:16.159169 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:16.159169 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:16.159169 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:16.159169 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:16.159169 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:16.159169 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:16.159169 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:16.159169 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:16.159169 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:16.159169 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:16.159169 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:16.159971 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:16.159971 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:16.159971 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:16.159971 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:16.159971 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 22:26:16.159971 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 22:26:16.159971 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 22:26:16.159971 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 22:26:16.159971 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 22:26:16.159971 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 22:26:16.159971 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 22:26:16.159971 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:26:16.159971 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 272/548] 10.222.0.36 () {56 vars in 1102 bytes} [Fri Jun 24 22:26:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 22:26:16.165717 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba21adf3-ad3c-4853-aa41-91f924cae558 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:16.208461 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade9699d-854e-4e8b-bd02-0c9a95160699 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:16.235618 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:16.259043 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:16.270865 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3060af7a-009a-444a-aefd-9a0f7ac4b8d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:16.271702 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3060af7a-009a-444a-aefd-9a0f7ac4b8d6 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:16.271984 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3060af7a-009a-444a-aefd-9a0f7ac4b8d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:16.272257 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3060af7a-009a-444a-aefd-9a0f7ac4b8d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:16.293320 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3060af7a-009a-444a-aefd-9a0f7ac4b8d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:16.295091 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3060af7a-009a-444a-aefd-9a0f7ac4b8d6 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:16.318179 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba21adf3-ad3c-4853-aa41-91f924cae558 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:16.331282 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-3060af7a-009a-444a-aefd-9a0f7ac4b8d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:16.331282 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:16.331282 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:16.331282 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:16.331282 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:16.331282 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:16.331282 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:16.331282 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:16.331282 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:16.331282 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:16.331282 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:16.331282 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:16.331282 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 22:26:16.331282 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 22:26:16.331282 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 22:26:16.332644 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 22:26:16.332644 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:16.332644 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:16.332644 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:16.332644 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:16.332644 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:16.332644 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:16.332644 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:16.332644 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:16.332644 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:16.332644 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:16.332644 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:16.332644 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:16.332644 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:16.332644 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:16.332644 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:16.332644 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:16.333655 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 22:26:16.333655 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 22:26:16.333655 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:16.333655 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:26:16.335690 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 277/549] 10.222.0.36 () {56 vars in 1108 bytes} [Fri Jun 24 22:26:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:16.341137 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3060af7a-009a-444a-aefd-9a0f7ac4b8d6 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:16.353158 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eb3bba-9339-4a27-b9e9-ce6164ad0ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:16.353764 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eb3bba-9339-4a27-b9e9-ce6164ad0ef7 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:16.354045 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eb3bba-9339-4a27-b9e9-ce6164ad0ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:16.354318 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eb3bba-9339-4a27-b9e9-ce6164ad0ef7 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:16.355070 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5eb3bba-9339-4a27-b9e9-ce6164ad0ef7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:16.355417 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5eb3bba-9339-4a27-b9e9-ce6164ad0ef7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:16.356932 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5eb3bba-9339-4a27-b9e9-ce6164ad0ef7 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:16.366318 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 273/550] 10.222.0.36 () {56 vars in 1103 bytes} [Fri Jun 24 22:26:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:16.372004 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eb3bba-9339-4a27-b9e9-ce6164ad0ef7 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:16.543646 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3060af7a-009a-444a-aefd-9a0f7ac4b8d6 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:16.563269 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eb3bba-9339-4a27-b9e9-ce6164ad0ef7 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:16.564564 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:16.601912 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8872000d-f373-4d45-ba88-ce411b909309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:16.603515 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8872000d-f373-4d45-ba88-ce411b909309 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:16.604009 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8872000d-f373-4d45-ba88-ce411b909309 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:16.604451 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8872000d-f373-4d45-ba88-ce411b909309 None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:16.605334 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8872000d-f373-4d45-ba88-ce411b909309 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:16.605783 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8872000d-f373-4d45-ba88-ce411b909309 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:16.607358 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8872000d-f373-4d45-ba88-ce411b909309 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:16.627059 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 278/551] 10.222.0.36 () {56 vars in 1109 bytes} [Fri Jun 24 22:26:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 22:26:16.633829 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8872000d-f373-4d45-ba88-ce411b909309 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:16.646721 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8deffb4-ae70-43af-985a-b37ea615bd01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:16.647562 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8deffb4-ae70-43af-985a-b37ea615bd01 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:16.647845 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8deffb4-ae70-43af-985a-b37ea615bd01 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:16.648119 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8deffb4-ae70-43af-985a-b37ea615bd01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:16.664551 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8deffb4-ae70-43af-985a-b37ea615bd01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:16.666145 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8deffb4-ae70-43af-985a-b37ea615bd01 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:16.707360 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:16.707531 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-e8deffb4-ae70-43af-985a-b37ea615bd01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:16.707531 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:16.707531 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:16.707531 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:16.707531 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:16.707531 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:16.707531 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:16.707531 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:16.707531 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:16.707531 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:16.707531 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:16.707531 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:16.707531 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 22:26:16.707531 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 22:26:16.707531 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 22:26:16.708419 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 22:26:16.708419 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:16.708419 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:16.708419 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:16.708419 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:16.708419 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:16.708419 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:16.708419 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:16.708419 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:16.708419 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:16.708419 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:16.708419 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:16.708419 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:16.708419 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:16.708419 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:16.708419 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:16.708419 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:16.709328 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 22:26:16.709328 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 22:26:16.709328 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:16.709328 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:26:16.709328 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 274/552] 10.222.0.36 () {56 vars in 1108 bytes} [Fri Jun 24 22:26:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:16.720396 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8deffb4-ae70-43af-985a-b37ea615bd01 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:16.765610 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8872000d-f373-4d45-ba88-ce411b909309 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:16.799995 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8743110-f64a-40f5-9ae2-2d2ca336c7f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:16.800797 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8743110-f64a-40f5-9ae2-2d2ca336c7f7 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:16.801082 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8743110-f64a-40f5-9ae2-2d2ca336c7f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:16.801356 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8743110-f64a-40f5-9ae2-2d2ca336c7f7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:16.808653 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8743110-f64a-40f5-9ae2-2d2ca336c7f7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:16.810117 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8743110-f64a-40f5-9ae2-2d2ca336c7f7 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:16.829897 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-b8743110-f64a-40f5-9ae2-2d2ca336c7f7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 24 22:26:16.829897 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:16.829897 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:16.829897 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:16.829897 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:16.829897 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:16.829897 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:16.829897 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:16.829897 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:16.829897 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:16.829897 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:16.829897 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:16.829897 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 22:26:16.829897 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 22:26:16.829897 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 22:26:16.829897 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 22:26:16.830810 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:16.830810 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:16.830810 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 22:26:16.830810 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 22:26:16.830810 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 22:26:16.830810 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 22:26:16.830810 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:16.830810 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:16.830810 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:16.830810 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:16.830810 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:16.830810 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:16.830810 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:16.830810 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:16.830810 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:16.830810 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:16.830810 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:16.830810 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:16.831773 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:16.831773 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:16.831773 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 22:26:16.831773 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 22:26:16.831773 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 22:26:16.831773 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 22:26:16.831773 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 22:26:16.831773 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 22:26:16.831773 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 24 22:26:16.831773 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:26:16.835831 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 279/553] 10.222.0.36 () {56 vars in 1096 bytes} [Fri Jun 24 22:26:16 2022] GET /identity/v3/users/swift => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:16.844500 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8743110-f64a-40f5-9ae2-2d2ca336c7f7 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:16.892060 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8deffb4-ae70-43af-985a-b37ea615bd01 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:16.934924 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b4a135-029a-4c32-abc8-704675e7b894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:16.935993 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b4a135-029a-4c32-abc8-704675e7b894 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:16.936475 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b4a135-029a-4c32-abc8-704675e7b894 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:16.936966 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b4a135-029a-4c32-abc8-704675e7b894 None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:16.937891 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b4a135-029a-4c32-abc8-704675e7b894 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:16.938418 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b4a135-029a-4c32-abc8-704675e7b894 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:16.940070 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b4a135-029a-4c32-abc8-704675e7b894 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:16.966713 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 275/554] 10.222.0.36 () {56 vars in 1109 bytes} [Fri Jun 24 22:26:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:16.972437 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b4a135-029a-4c32-abc8-704675e7b894 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:17.027387 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:17.056211 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8743110-f64a-40f5-9ae2-2d2ca336c7f7 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:17.058598 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:17.097949 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917ecb94-5f1a-4030-9ad2-63ce7bc96d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:17.099135 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917ecb94-5f1a-4030-9ad2-63ce7bc96d76 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:17.099715 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917ecb94-5f1a-4030-9ad2-63ce7bc96d76 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:17.100238 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917ecb94-5f1a-4030-9ad2-63ce7bc96d76 None admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:17.101310 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917ecb94-5f1a-4030-9ad2-63ce7bc96d76 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:17.101819 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917ecb94-5f1a-4030-9ad2-63ce7bc96d76 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:17.104269 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917ecb94-5f1a-4030-9ad2-63ce7bc96d76 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:17.105687 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b4a135-029a-4c32-abc8-704675e7b894 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:17.129533 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 280/555] 10.222.0.36 () {56 vars in 1135 bytes} [Fri Jun 24 22:26:16 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:17.131801 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3527707-a3b8-4313-9f66-b77acfe2b01d None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:17.132310 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3527707-a3b8-4313-9f66-b77acfe2b01d None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:17.132876 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3527707-a3b8-4313-9f66-b77acfe2b01d None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:17.136042 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 281/556] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:26:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:26:17.137091 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3527707-a3b8-4313-9f66-b77acfe2b01d None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:17.141412 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08e5e50-cd5b-4948-8683-2d5c254a1bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:17.142508 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08e5e50-cd5b-4948-8683-2d5c254a1bca None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:17.142619 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08e5e50-cd5b-4948-8683-2d5c254a1bca None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:17.142835 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08e5e50-cd5b-4948-8683-2d5c254a1bca None admin] PATH_INFO: `/v3/users/nova` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:17.150983 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08e5e50-cd5b-4948-8683-2d5c254a1bca None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:17.152739 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08e5e50-cd5b-4948-8683-2d5c254a1bca None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:17.168992 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-a08e5e50-cd5b-4948-8683-2d5c254a1bca None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 24 22:26:17.168992 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:17.168992 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:17.168992 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:17.168992 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:17.168992 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:17.168992 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:17.168992 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:17.168992 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:17.168992 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:17.168992 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:17.168992 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:17.168992 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 22:26:17.168992 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 22:26:17.168992 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 22:26:17.168992 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 22:26:17.170083 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:17.170083 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:17.170083 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 22:26:17.170083 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 22:26:17.170083 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 22:26:17.170083 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 22:26:17.170083 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:17.170083 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:17.170083 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:17.170083 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:17.170083 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:17.170083 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:17.170083 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:17.170083 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:17.170083 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:17.170083 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:17.170083 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:17.170083 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:17.172014 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:17.172014 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:17.172014 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 22:26:17.172014 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 22:26:17.172014 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 22:26:17.172014 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 22:26:17.172014 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 22:26:17.172014 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 22:26:17.172014 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 24 22:26:17.172014 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:26:17.172014 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 276/557] 10.222.0.36 () {56 vars in 1093 bytes} [Fri Jun 24 22:26:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:17.172014 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cbbb06-31ef-4b79-bfe1-f8e66db4f9d9 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:17.172653 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cbbb06-31ef-4b79-bfe1-f8e66db4f9d9 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:17.172653 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cbbb06-31ef-4b79-bfe1-f8e66db4f9d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:17.190290 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-05cbbb06-31ef-4b79-bfe1-f8e66db4f9d9 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:26:17.191533 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-05cbbb06-31ef-4b79-bfe1-f8e66db4f9d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:26:17.263066 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 277/558] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:26:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 22:26:17.263505 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3527707-a3b8-4313-9f66-b77acfe2b01d None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:17.263975 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cbbb06-31ef-4b79-bfe1-f8e66db4f9d9 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:17.267704 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:17.304140 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f685f9-c252-47ce-b463-617fd524b0f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:17.305218 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f685f9-c252-47ce-b463-617fd524b0f7 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:17.305944 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f685f9-c252-47ce-b463-617fd524b0f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:17.306779 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f685f9-c252-47ce-b463-617fd524b0f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:17.336617 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:17.383049 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f685f9-c252-47ce-b463-617fd524b0f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:17.384692 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cbbb06-31ef-4b79-bfe1-f8e66db4f9d9 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:17.385858 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f685f9-c252-47ce-b463-617fd524b0f7 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:17.421711 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cefe7fc-0204-4801-a9cc-2762c7be0d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:17.422389 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cefe7fc-0204-4801-a9cc-2762c7be0d8d None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:17.422669 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cefe7fc-0204-4801-a9cc-2762c7be0d8d None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:17.422942 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cefe7fc-0204-4801-a9cc-2762c7be0d8d None admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:17.424317 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cefe7fc-0204-4801-a9cc-2762c7be0d8d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:17.424317 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cefe7fc-0204-4801-a9cc-2762c7be0d8d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:17.425647 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cefe7fc-0204-4801-a9cc-2762c7be0d8d None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:17.444805 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 278/559] 10.222.0.36 () {56 vars in 1133 bytes} [Fri Jun 24 22:26:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:17.445761 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cefe7fc-0204-4801-a9cc-2762c7be0d8d None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:17.510149 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:17.514536 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 282/560] 10.222.0.36 () {58 vars in 1282 bytes} [Fri Jun 24 22:26:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 22:26:17.515653 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f685f9-c252-47ce-b463-617fd524b0f7 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:17.552808 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cefe7fc-0204-4801-a9cc-2762c7be0d8d None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:17.579005 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:17.590523 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b654a012-cbf3-4582-b7f9-bac8e94d36c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:17.591360 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b654a012-cbf3-4582-b7f9-bac8e94d36c9 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:17.591644 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b654a012-cbf3-4582-b7f9-bac8e94d36c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:17.591918 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b654a012-cbf3-4582-b7f9-bac8e94d36c9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:17.601823 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b654a012-cbf3-4582-b7f9-bac8e94d36c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 22:26:17.609561 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-b654a012-cbf3-4582-b7f9-bac8e94d36c9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 22:26:17.609561 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:17.609561 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:17.609561 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:17.609561 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:17.609561 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:17.609561 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:17.609561 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:17.609561 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:17.609561 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:17.609561 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:17.609561 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:17.609561 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 22:26:17.609561 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 22:26:17.609561 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 22:26:17.609561 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 22:26:17.610636 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 22:26:17.610636 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 22:26:17.610636 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 22:26:17.610636 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 22:26:17.610636 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:17.610636 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:17.610636 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:17.610636 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:17.610636 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:17.610636 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:17.610636 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:17.610636 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:17.610636 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:17.610636 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:17.610636 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:17.610636 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:17.611642 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:17.611642 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:17.611642 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:17.611642 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:17.611642 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 22:26:17.611642 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 22:26:17.611642 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 22:26:17.611642 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 22:26:17.611642 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 22:26:17.611642 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 22:26:17.611642 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 22:26:17.611642 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:26:17.611642 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 279/561] 10.222.0.36 () {56 vars in 1102 bytes} [Fri Jun 24 22:26:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:17.612456 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b654a012-cbf3-4582-b7f9-bac8e94d36c9 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:17.623892 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f685f9-c252-47ce-b463-617fd524b0f7 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:17.657972 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00c35a3-db8c-4cac-b1d8-885c85f765a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:17.658761 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00c35a3-db8c-4cac-b1d8-885c85f765a8 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:17.659038 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00c35a3-db8c-4cac-b1d8-885c85f765a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:17.659334 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00c35a3-db8c-4cac-b1d8-885c85f765a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:17.669174 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00c35a3-db8c-4cac-b1d8-885c85f765a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:17.670624 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00c35a3-db8c-4cac-b1d8-885c85f765a8 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:17.687916 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-e00c35a3-db8c-4cac-b1d8-885c85f765a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:17.687916 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:17.687916 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:17.687916 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:17.687916 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:17.687916 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:17.687916 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:17.687916 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:17.687916 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:17.687916 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:17.687916 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:17.687916 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:17.687916 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 22:26:17.687916 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 22:26:17.687916 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 22:26:17.688841 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 22:26:17.688841 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:17.688841 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:17.688841 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:17.688841 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:17.688841 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:17.688841 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:17.688841 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:17.688841 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:17.688841 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:17.688841 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:17.688841 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:17.688841 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:17.688841 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:17.688841 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:17.688841 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:17.688841 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:17.689728 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 22:26:17.689728 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 22:26:17.689728 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:17.689728 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:26:17.689728 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 283/562] 10.222.0.36 () {56 vars in 1108 bytes} [Fri Jun 24 22:26:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:17.690617 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec94707-02ad-49dc-8628-981273bd8fc1 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:17.690904 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec94707-02ad-49dc-8628-981273bd8fc1 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:17.691181 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec94707-02ad-49dc-8628-981273bd8fc1 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:17.692689 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 284/563] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:26:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:26:17.693582 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09496d86-ef94-49f9-a3e8-7230a7c70b90 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:17.693992 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09496d86-ef94-49f9-a3e8-7230a7c70b90 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:17.694399 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09496d86-ef94-49f9-a3e8-7230a7c70b90 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:17.695720 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 285/564] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:26:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:26:17.696457 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09496d86-ef94-49f9-a3e8-7230a7c70b90 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:17.719132 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b654a012-cbf3-4582-b7f9-bac8e94d36c9 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:17.742976 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:17.756431 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e1a80e-24bd-49a1-a5f1-51ef36edd9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:17.757235 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e1a80e-24bd-49a1-a5f1-51ef36edd9c0 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:17.757946 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e1a80e-24bd-49a1-a5f1-51ef36edd9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:17.758245 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e1a80e-24bd-49a1-a5f1-51ef36edd9c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:17.769747 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e1a80e-24bd-49a1-a5f1-51ef36edd9c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:17.771148 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e1a80e-24bd-49a1-a5f1-51ef36edd9c0 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:17.788572 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-b4e1a80e-24bd-49a1-a5f1-51ef36edd9c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:17.788572 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:17.788572 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:17.788572 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:17.788572 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:17.788572 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:17.788572 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:17.788572 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:17.788572 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:17.788572 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:17.788572 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:17.788572 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:17.788572 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 22:26:17.788572 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 22:26:17.788572 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 22:26:17.789533 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 22:26:17.789533 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:17.789533 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:17.789533 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:17.789533 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:17.789533 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:17.789533 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:17.789533 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:17.789533 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:17.789533 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:17.789533 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:17.789533 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:17.789533 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:17.789533 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:17.789533 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:17.789533 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:17.789533 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:17.790633 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 22:26:17.790633 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 22:26:17.790633 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:17.790633 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:26:17.790633 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 280/565] 10.222.0.36 () {56 vars in 1108 bytes} [Fri Jun 24 22:26:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:17.791238 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e1a80e-24bd-49a1-a5f1-51ef36edd9c0 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:17.809614 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09496d86-ef94-49f9-a3e8-7230a7c70b90 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:17.823083 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:17.846052 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c17511-5ce5-4859-b756-e2da97a4b7d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:17.846717 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c17511-5ce5-4859-b756-e2da97a4b7d1 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:17.846998 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c17511-5ce5-4859-b756-e2da97a4b7d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:17.847316 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c17511-5ce5-4859-b756-e2da97a4b7d1 None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:17.848068 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c17511-5ce5-4859-b756-e2da97a4b7d1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:17.848377 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c17511-5ce5-4859-b756-e2da97a4b7d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:17.849780 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c17511-5ce5-4859-b756-e2da97a4b7d1 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:17.858372 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 286/566] 10.222.0.36 () {56 vars in 1103 bytes} [Fri Jun 24 22:26:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:17.859770 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a540c73-c5b3-46c4-9100-8de038d675cb None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:17.860065 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a540c73-c5b3-46c4-9100-8de038d675cb None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:17.860345 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a540c73-c5b3-46c4-9100-8de038d675cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:17.877148 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-3a540c73-c5b3-46c4-9100-8de038d675cb None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:26:17.878349 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-3a540c73-c5b3-46c4-9100-8de038d675cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:26:17.894745 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e1a80e-24bd-49a1-a5f1-51ef36edd9c0 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:17.927752 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967a28fe-fe51-4d2a-8ded-016bb24aa0d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:17.928425 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a28fe-fe51-4d2a-8ded-016bb24aa0d6 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:17.928712 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a28fe-fe51-4d2a-8ded-016bb24aa0d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:17.928989 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a28fe-fe51-4d2a-8ded-016bb24aa0d6 None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:17.929723 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967a28fe-fe51-4d2a-8ded-016bb24aa0d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:17.930030 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967a28fe-fe51-4d2a-8ded-016bb24aa0d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:17.931543 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967a28fe-fe51-4d2a-8ded-016bb24aa0d6 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:17.943185 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 281/567] 10.222.0.36 () {56 vars in 1109 bytes} [Fri Jun 24 22:26:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:17.944366 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e3ebb-1086-4cd4-91af-a096e1404e38 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:17.944649 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e3ebb-1086-4cd4-91af-a096e1404e38 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:17.944930 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e3ebb-1086-4cd4-91af-a096e1404e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:17.948752 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 287/568] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:26:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 22:26:17.949578 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a540c73-c5b3-46c4-9100-8de038d675cb None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:17.964682 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-ba9e3ebb-1086-4cd4-91af-a096e1404e38 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:26:17.966340 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-ba9e3ebb-1086-4cd4-91af-a096e1404e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:26:17.994704 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:18.037433 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 282/569] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:26:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 22:26:18.037433 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9e3ebb-1086-4cd4-91af-a096e1404e38 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:18.057095 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a540c73-c5b3-46c4-9100-8de038d675cb None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:18.060047 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:18.091181 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cdf710-404f-4a48-b911-3ae2813a08d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:18.091876 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cdf710-404f-4a48-b911-3ae2813a08d4 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:18.092155 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cdf710-404f-4a48-b911-3ae2813a08d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:18.092429 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cdf710-404f-4a48-b911-3ae2813a08d4 None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:18.093152 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cdf710-404f-4a48-b911-3ae2813a08d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:18.093459 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cdf710-404f-4a48-b911-3ae2813a08d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:18.094872 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cdf710-404f-4a48-b911-3ae2813a08d4 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:18.106120 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 288/570] 10.222.0.36 () {56 vars in 1109 bytes} [Fri Jun 24 22:26:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:18.106884 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cdf710-404f-4a48-b911-3ae2813a08d4 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:18.142237 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9e3ebb-1086-4cd4-91af-a096e1404e38 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:18.176411 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fb232d-747a-49c6-b1bc-096fd55e3763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:18.177211 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fb232d-747a-49c6-b1bc-096fd55e3763 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:18.177490 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fb232d-747a-49c6-b1bc-096fd55e3763 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:18.177764 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fb232d-747a-49c6-b1bc-096fd55e3763 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:18.188434 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fb232d-747a-49c6-b1bc-096fd55e3763 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:18.189902 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fb232d-747a-49c6-b1bc-096fd55e3763 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:18.206266 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cdf710-404f-4a48-b911-3ae2813a08d4 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:18.207628 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-87fb232d-747a-49c6-b1bc-096fd55e3763 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:18.207628 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:18.207628 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:18.207628 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:18.207628 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:18.207628 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:18.207628 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:18.207628 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:18.207628 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:18.207628 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:18.207628 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:18.207628 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:18.207628 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 22:26:18.207628 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 22:26:18.207628 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 22:26:18.208469 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 22:26:18.208469 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:18.208469 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:18.208469 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:18.208469 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:18.208469 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:18.208469 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:18.208469 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:18.208469 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:18.208469 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:18.208469 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:18.208469 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:18.208469 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:18.208469 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:18.208469 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:18.208469 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:18.208469 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:18.209809 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 22:26:18.209809 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 22:26:18.209809 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:18.209809 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:26:18.209809 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 283/571] 10.222.0.36 () {56 vars in 1108 bytes} [Fri Jun 24 22:26:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:18.212187 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fb232d-747a-49c6-b1bc-096fd55e3763 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:18.229471 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:18.242645 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7bc87d-df3e-4ac7-b37f-15e81be72f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:18.243644 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7bc87d-df3e-4ac7-b37f-15e81be72f48 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:18.243931 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7bc87d-df3e-4ac7-b37f-15e81be72f48 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:18.244205 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7bc87d-df3e-4ac7-b37f-15e81be72f48 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:18.250960 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7bc87d-df3e-4ac7-b37f-15e81be72f48 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:18.252460 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7bc87d-df3e-4ac7-b37f-15e81be72f48 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:18.266963 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-6f7bc87d-df3e-4ac7-b37f-15e81be72f48 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 22:26:18.266963 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:18.266963 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:18.266963 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:18.266963 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:18.266963 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:18.266963 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:18.266963 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:18.266963 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:18.266963 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:18.266963 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:18.266963 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:18.266963 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 22:26:18.266963 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 22:26:18.266963 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 22:26:18.267910 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 22:26:18.267910 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:18.267910 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:18.267910 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:18.267910 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:18.267910 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:18.267910 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:18.267910 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:18.267910 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:18.267910 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:18.267910 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:18.267910 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:18.267910 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:18.267910 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:18.267910 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:18.267910 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:18.267910 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:18.268763 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 22:26:18.268763 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 22:26:18.268763 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 22:26:18.268763 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 22:26:18.268763 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 22:26:18.268763 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 22:26:18.268763 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 22:26:18.268763 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:26:18.268763 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 289/572] 10.222.0.36 () {56 vars in 1111 bytes} [Fri Jun 24 22:26:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:18.269229 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7bc87d-df3e-4ac7-b37f-15e81be72f48 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:18.296407 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:18.319006 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fb232d-747a-49c6-b1bc-096fd55e3763 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:18.352467 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f55bf1-e49a-4379-a608-831baa99e24f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:18.353294 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f55bf1-e49a-4379-a608-831baa99e24f None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:18.353579 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f55bf1-e49a-4379-a608-831baa99e24f None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:18.353862 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f55bf1-e49a-4379-a608-831baa99e24f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:18.364035 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f55bf1-e49a-4379-a608-831baa99e24f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 22:26:18.371516 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7bc87d-df3e-4ac7-b37f-15e81be72f48 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:18.371910 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-c7f55bf1-e49a-4379-a608-831baa99e24f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 22:26:18.371910 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:18.371910 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:18.371910 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:18.371910 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:18.371910 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:18.371910 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:18.371910 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:18.371910 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:18.371910 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:18.371910 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:18.371910 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:18.371910 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 22:26:18.371910 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 22:26:18.371910 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 22:26:18.371910 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 22:26:18.372856 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 22:26:18.372856 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 22:26:18.372856 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 22:26:18.372856 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 22:26:18.372856 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:18.372856 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:18.372856 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:18.372856 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:18.372856 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:18.372856 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:18.372856 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:18.372856 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:18.372856 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:18.372856 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:18.372856 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:18.372856 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:18.373716 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:18.373716 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:18.373716 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:18.373716 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:18.373716 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 22:26:18.373716 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 22:26:18.373716 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 22:26:18.373716 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 22:26:18.373716 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 22:26:18.373716 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 22:26:18.373716 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 22:26:18.373716 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:26:18.373716 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 284/573] 10.222.0.36 () {56 vars in 1102 bytes} [Fri Jun 24 22:26:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:18.374679 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f55bf1-e49a-4379-a608-831baa99e24f None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:18.411914 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392b6583-ff4b-49da-afaa-737827bda68c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:18.412721 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392b6583-ff4b-49da-afaa-737827bda68c None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:18.413005 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392b6583-ff4b-49da-afaa-737827bda68c None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:18.413281 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392b6583-ff4b-49da-afaa-737827bda68c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:18.424554 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392b6583-ff4b-49da-afaa-737827bda68c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 22:26:18.432354 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-392b6583-ff4b-49da-afaa-737827bda68c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 22:26:18.432354 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:18.432354 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:18.432354 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:18.432354 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:18.432354 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:18.432354 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:18.432354 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:18.432354 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:18.432354 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:18.432354 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:18.432354 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:18.432354 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 22:26:18.432354 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 22:26:18.432354 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 22:26:18.432354 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 22:26:18.433305 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 22:26:18.433305 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 22:26:18.433305 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 22:26:18.433305 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 22:26:18.433305 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:18.433305 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:18.433305 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:18.433305 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:18.433305 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:18.433305 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:18.433305 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:18.433305 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:18.433305 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:18.433305 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:18.433305 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:18.433305 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:18.434647 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:18.434647 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:18.434647 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:18.434647 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:18.434647 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 22:26:18.434647 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 22:26:18.434647 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 22:26:18.434647 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 22:26:18.434647 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 22:26:18.434647 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 22:26:18.434647 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 22:26:18.434647 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:26:18.434647 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 290/574] 10.222.0.36 () {56 vars in 1102 bytes} [Fri Jun 24 22:26:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:18.434647 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392b6583-ff4b-49da-afaa-737827bda68c None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:18.458536 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:18.481877 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f55bf1-e49a-4379-a608-831baa99e24f None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:18.515695 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd442a3e-2902-4abd-9d7a-9c7ee0b8c80d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:18.516490 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd442a3e-2902-4abd-9d7a-9c7ee0b8c80d None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:18.516767 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd442a3e-2902-4abd-9d7a-9c7ee0b8c80d None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:18.517044 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd442a3e-2902-4abd-9d7a-9c7ee0b8c80d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:18.521633 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:18.523759 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd442a3e-2902-4abd-9d7a-9c7ee0b8c80d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:18.525638 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd442a3e-2902-4abd-9d7a-9c7ee0b8c80d None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:18.538154 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392b6583-ff4b-49da-afaa-737827bda68c None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:18.539505 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-bd442a3e-2902-4abd-9d7a-9c7ee0b8c80d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 22:26:18.539505 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:18.539505 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:18.539505 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:18.539505 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:18.539505 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:18.539505 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:18.539505 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:18.539505 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:18.539505 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:18.539505 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:18.539505 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:18.539505 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 22:26:18.539505 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 22:26:18.539505 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 22:26:18.540488 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 22:26:18.540488 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:18.540488 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:18.540488 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:18.540488 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:18.540488 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:18.540488 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:18.540488 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:18.540488 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:18.540488 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:18.540488 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:18.540488 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:18.540488 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:18.540488 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:18.540488 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:18.540488 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:18.540488 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:18.541597 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 22:26:18.541597 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 22:26:18.541597 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 22:26:18.541597 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 22:26:18.541597 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 22:26:18.541597 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 22:26:18.541597 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 22:26:18.541597 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:26:18.541597 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 285/575] 10.222.0.36 () {56 vars in 1111 bytes} [Fri Jun 24 22:26:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:18.541597 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd442a3e-2902-4abd-9d7a-9c7ee0b8c80d None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:18.575053 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7611601-a63d-4000-b515-79775d1d8f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:18.575684 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7611601-a63d-4000-b515-79775d1d8f0b None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:18.575972 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7611601-a63d-4000-b515-79775d1d8f0b None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:18.576253 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7611601-a63d-4000-b515-79775d1d8f0b None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:18.576975 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7611601-a63d-4000-b515-79775d1d8f0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:18.577285 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7611601-a63d-4000-b515-79775d1d8f0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:18.578685 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7611601-a63d-4000-b515-79775d1d8f0b None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:18.590313 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 291/576] 10.222.0.36 () {56 vars in 1109 bytes} [Fri Jun 24 22:26:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:18.591130 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7611601-a63d-4000-b515-79775d1d8f0b None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:18.641402 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd442a3e-2902-4abd-9d7a-9c7ee0b8c80d None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:18.676646 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aff926c-fac6-458c-ab75-86a9a6ee7661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:18.677324 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aff926c-fac6-458c-ab75-86a9a6ee7661 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:18.677609 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aff926c-fac6-458c-ab75-86a9a6ee7661 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:18.677887 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aff926c-fac6-458c-ab75-86a9a6ee7661 None admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:18.678675 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aff926c-fac6-458c-ab75-86a9a6ee7661 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:18.678984 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aff926c-fac6-458c-ab75-86a9a6ee7661 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:18.680625 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aff926c-fac6-458c-ab75-86a9a6ee7661 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:18.683650 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:18.691524 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7611601-a63d-4000-b515-79775d1d8f0b None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:18.699069 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 286/577] 10.222.0.36 () {56 vars in 1148 bytes} [Fri Jun 24 22:26:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:18.699069 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aff926c-fac6-458c-ab75-86a9a6ee7661 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:18.726704 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf253fc2-d1e2-4023-affa-0df6681a9804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:18.727448 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf253fc2-d1e2-4023-affa-0df6681a9804 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:18.727729 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf253fc2-d1e2-4023-affa-0df6681a9804 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:18.728004 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf253fc2-d1e2-4023-affa-0df6681a9804 None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:18.728777 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf253fc2-d1e2-4023-affa-0df6681a9804 None admin] RBAC: Adding query filter params (name=service) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:18.729061 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf253fc2-d1e2-4023-affa-0df6681a9804 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:18.730449 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf253fc2-d1e2-4023-affa-0df6681a9804 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:18.738130 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 292/578] 10.222.0.36 () {56 vars in 1103 bytes} [Fri Jun 24 22:26:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:18.738897 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf253fc2-d1e2-4023-affa-0df6681a9804 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:18.747552 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:18.796101 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aff926c-fac6-458c-ab75-86a9a6ee7661 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:18.832384 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf57e560-6dc4-4a8a-9285-9794106fb6b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:18.832985 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf57e560-6dc4-4a8a-9285-9794106fb6b7 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:18.833268 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf57e560-6dc4-4a8a-9285-9794106fb6b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:18.833569 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf57e560-6dc4-4a8a-9285-9794106fb6b7 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:18.834302 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf57e560-6dc4-4a8a-9285-9794106fb6b7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:18.834611 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf57e560-6dc4-4a8a-9285-9794106fb6b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:18.836036 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf57e560-6dc4-4a8a-9285-9794106fb6b7 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:18.836145 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf253fc2-d1e2-4023-affa-0df6681a9804 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:18.844331 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 287/579] 10.222.0.36 () {56 vars in 1103 bytes} [Fri Jun 24 22:26:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:18.845130 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf57e560-6dc4-4a8a-9285-9794106fb6b7 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:18.870410 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecb7959-05ce-45c3-9de9-296134325734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:18.871111 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb7959-05ce-45c3-9de9-296134325734 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:18.871430 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb7959-05ce-45c3-9de9-296134325734 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:18.871711 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb7959-05ce-45c3-9de9-296134325734 None admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:18.872496 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecb7959-05ce-45c3-9de9-296134325734 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:18.872808 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecb7959-05ce-45c3-9de9-296134325734 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:18.874256 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecb7959-05ce-45c3-9de9-296134325734 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:18.890599 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 293/580] 10.222.0.36 () {56 vars in 1148 bytes} [Fri Jun 24 22:26:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:18.891466 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecb7959-05ce-45c3-9de9-296134325734 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:18.907974 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:18.950586 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf57e560-6dc4-4a8a-9285-9794106fb6b7 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:18.960171 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:18.985843 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fedc63-ff83-4dad-90f8-6550ca0747bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:18.986643 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fedc63-ff83-4dad-90f8-6550ca0747bd None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:18.986924 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fedc63-ff83-4dad-90f8-6550ca0747bd None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:18.987196 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fedc63-ff83-4dad-90f8-6550ca0747bd None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:18.995038 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fedc63-ff83-4dad-90f8-6550ca0747bd None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:18.995243 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecb7959-05ce-45c3-9de9-296134325734 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:18.996542 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fedc63-ff83-4dad-90f8-6550ca0747bd None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:19.013037 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-b6fedc63-ff83-4dad-90f8-6550ca0747bd None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 24 22:26:19.013037 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:19.013037 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:19.013037 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:19.013037 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:19.013037 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:19.013037 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:19.013037 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:19.013037 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:19.013037 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:19.013037 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:19.013037 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:19.013037 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 22:26:19.013037 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 22:26:19.013037 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 22:26:19.013037 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 22:26:19.013987 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:19.013987 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:19.013987 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 22:26:19.013987 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 22:26:19.013987 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 22:26:19.013987 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 22:26:19.013987 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:19.013987 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:19.013987 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:19.013987 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:19.013987 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:19.013987 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:19.013987 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:19.013987 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:19.013987 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:19.013987 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:19.013987 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:19.013987 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:19.015163 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:19.015163 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:19.015163 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 22:26:19.015163 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 22:26:19.015163 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 22:26:19.015163 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 22:26:19.015163 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 22:26:19.015163 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 22:26:19.015163 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 24 22:26:19.015163 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:26:19.015163 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 288/581] 10.222.0.36 () {56 vars in 1099 bytes} [Fri Jun 24 22:26:18 2022] GET /identity/v3/users/cinder => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:19.015163 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fedc63-ff83-4dad-90f8-6550ca0747bd None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:19.032551 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f60b749-0732-4aa3-82c9-30531328704a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:19.033470 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f60b749-0732-4aa3-82c9-30531328704a None admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:19.034144 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f60b749-0732-4aa3-82c9-30531328704a None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:19.034431 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f60b749-0732-4aa3-82c9-30531328704a None admin] PATH_INFO: `/v3/projects/d189b31bbec0469381292d2cde3cb420/users/214d9071042c4bad886bf060a079b6e2/roles/3265c7c44fb144a0a56467ded2a39413` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:19.049413 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f60b749-0732-4aa3-82c9-30531328704a None admin] RBAC: Authorizing `identity:create_grant(project_id=d189b31bbec0469381292d2cde3cb420, user_id=214d9071042c4bad886bf060a079b6e2, role_id=3265c7c44fb144a0a56467ded2a39413)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:19.050872 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f60b749-0732-4aa3-82c9-30531328704a None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:19.066546 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 294/582] 10.222.0.36 () {58 vars in 1439 bytes} [Fri Jun 24 22:26:18 2022] PUT /identity/v3/projects/d189b31bbec0469381292d2cde3cb420/users/214d9071042c4bad886bf060a079b6e2/roles/3265c7c44fb144a0a56467ded2a39413 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:26:19.066546 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f60b749-0732-4aa3-82c9-30531328704a None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:19.133098 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fedc63-ff83-4dad-90f8-6550ca0747bd None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:19.157394 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:19.173705 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d55b542-e3df-4895-881e-2efaa57e1c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:19.174637 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d55b542-e3df-4895-881e-2efaa57e1c3d None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:19.174972 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d55b542-e3df-4895-881e-2efaa57e1c3d None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:19.175397 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d55b542-e3df-4895-881e-2efaa57e1c3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:19.181570 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f60b749-0732-4aa3-82c9-30531328704a None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:19.187621 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d55b542-e3df-4895-881e-2efaa57e1c3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:19.189126 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d55b542-e3df-4895-881e-2efaa57e1c3d None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:19.200771 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:19.209274 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-0d55b542-e3df-4895-881e-2efaa57e1c3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:19.209274 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:19.209274 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:19.209274 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:19.209274 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:19.209274 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:19.209274 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:19.209274 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:19.209274 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:19.209274 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:19.209274 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:19.209274 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:19.209274 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 22:26:19.209274 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 22:26:19.209274 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 22:26:19.210241 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 22:26:19.210241 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:19.210241 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:19.210241 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:19.210241 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:19.210241 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:19.210241 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:19.210241 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:19.210241 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:19.210241 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:19.210241 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:19.210241 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:19.210241 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:19.210241 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:19.210241 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:19.210241 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:19.210241 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:19.211668 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 22:26:19.211668 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 22:26:19.211668 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:19.211668 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:26:19.211668 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 289/583] 10.222.0.36 () {56 vars in 1108 bytes} [Fri Jun 24 22:26:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:19.212028 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d55b542-e3df-4895-881e-2efaa57e1c3d None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:19.232094 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b39434-2f32-402c-afc0-e51cc7dbca84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:19.232911 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b39434-2f32-402c-afc0-e51cc7dbca84 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:19.233194 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b39434-2f32-402c-afc0-e51cc7dbca84 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:19.233461 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b39434-2f32-402c-afc0-e51cc7dbca84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:19.244352 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b39434-2f32-402c-afc0-e51cc7dbca84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:19.246095 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b39434-2f32-402c-afc0-e51cc7dbca84 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:19.264617 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-88b39434-2f32-402c-afc0-e51cc7dbca84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:19.264617 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:19.264617 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:19.264617 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:19.264617 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:19.264617 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:19.264617 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:19.264617 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:19.264617 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:19.264617 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:19.264617 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:19.264617 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:19.264617 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 22:26:19.264617 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 22:26:19.264617 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 22:26:19.265554 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 22:26:19.265554 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:19.265554 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:19.265554 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:19.265554 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:19.265554 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:19.265554 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:19.265554 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:19.265554 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:19.265554 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:19.265554 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:19.265554 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:19.265554 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:19.265554 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:19.265554 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:19.265554 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:19.265554 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:19.266408 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 22:26:19.266408 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 22:26:19.266408 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:19.266408 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:26:19.266408 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 295/584] 10.222.0.36 () {56 vars in 1108 bytes} [Fri Jun 24 22:26:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:19.267331 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b39434-2f32-402c-afc0-e51cc7dbca84 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:19.330006 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d55b542-e3df-4895-881e-2efaa57e1c3d None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:19.366495 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48281e27-29ab-4405-87f4-a7cd7b775721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:19.367148 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48281e27-29ab-4405-87f4-a7cd7b775721 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:19.367483 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48281e27-29ab-4405-87f4-a7cd7b775721 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:19.367758 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48281e27-29ab-4405-87f4-a7cd7b775721 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:19.368799 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48281e27-29ab-4405-87f4-a7cd7b775721 None admin] RBAC: Adding query filter params (role.id=3265c7c44fb144a0a56467ded2a39413, scope.project.id=d189b31bbec0469381292d2cde3cb420, user.id=6b95846f7f2a453f85ddb41a5d3327f3) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:19.369120 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48281e27-29ab-4405-87f4-a7cd7b775721 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:19.370686 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48281e27-29ab-4405-87f4-a7cd7b775721 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:19.372070 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b39434-2f32-402c-afc0-e51cc7dbca84 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:19.387377 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 290/585] 10.222.0.36 () {56 vars in 1374 bytes} [Fri Jun 24 22:26:19 2022] GET /identity/v3/role_assignments?user.id=6b95846f7f2a453f85ddb41a5d3327f3&scope.project.id=d189b31bbec0469381292d2cde3cb420&role.id=3265c7c44fb144a0a56467ded2a39413 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:19.387377 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48281e27-29ab-4405-87f4-a7cd7b775721 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:19.422468 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8069177-0f1b-4481-b66d-78f24d9ffe04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:19.423647 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8069177-0f1b-4481-b66d-78f24d9ffe04 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:19.424000 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8069177-0f1b-4481-b66d-78f24d9ffe04 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:19.424784 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8069177-0f1b-4481-b66d-78f24d9ffe04 None admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:19.426065 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8069177-0f1b-4481-b66d-78f24d9ffe04 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:19.426441 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8069177-0f1b-4481-b66d-78f24d9ffe04 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:19.428164 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:19.430363 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8069177-0f1b-4481-b66d-78f24d9ffe04 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:19.462191 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 296/586] 10.222.0.36 () {56 vars in 1137 bytes} [Fri Jun 24 22:26:19 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:19.463317 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8069177-0f1b-4481-b66d-78f24d9ffe04 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:19.495142 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:19.521725 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48281e27-29ab-4405-87f4-a7cd7b775721 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:19.567669 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9211d2-7ed6-420c-b2e1-f8ccc75ef4f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:19.569543 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9211d2-7ed6-420c-b2e1-f8ccc75ef4f3 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:19.569543 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9211d2-7ed6-420c-b2e1-f8ccc75ef4f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:19.569543 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9211d2-7ed6-420c-b2e1-f8ccc75ef4f3 None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:19.569870 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9211d2-7ed6-420c-b2e1-f8ccc75ef4f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:19.570331 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9211d2-7ed6-420c-b2e1-f8ccc75ef4f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:19.572154 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9211d2-7ed6-420c-b2e1-f8ccc75ef4f3 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:19.585743 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 291/587] 10.222.0.36 () {56 vars in 1109 bytes} [Fri Jun 24 22:26:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:19.586513 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9211d2-7ed6-420c-b2e1-f8ccc75ef4f3 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:19.596410 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8069177-0f1b-4481-b66d-78f24d9ffe04 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:19.635698 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdba8146-16ae-46c4-b490-14d21bcd8c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:19.636487 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdba8146-16ae-46c4-b490-14d21bcd8c8b None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:19.636845 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdba8146-16ae-46c4-b490-14d21bcd8c8b None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:19.637213 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdba8146-16ae-46c4-b490-14d21bcd8c8b None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:19.638068 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdba8146-16ae-46c4-b490-14d21bcd8c8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:19.638381 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdba8146-16ae-46c4-b490-14d21bcd8c8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:19.639927 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdba8146-16ae-46c4-b490-14d21bcd8c8b None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:19.652642 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 297/588] 10.222.0.36 () {56 vars in 1109 bytes} [Fri Jun 24 22:26:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:19.653680 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdba8146-16ae-46c4-b490-14d21bcd8c8b None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:19.715971 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:19.727759 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9211d2-7ed6-420c-b2e1-f8ccc75ef4f3 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:19.745944 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:19.763614 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdba8146-16ae-46c4-b490-14d21bcd8c8b None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:19.779521 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55953790-9f3b-41ad-97ed-70f39764634b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:19.780918 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55953790-9f3b-41ad-97ed-70f39764634b None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:19.781609 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55953790-9f3b-41ad-97ed-70f39764634b None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:19.782042 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55953790-9f3b-41ad-97ed-70f39764634b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:19.797213 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55953790-9f3b-41ad-97ed-70f39764634b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:19.798679 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55953790-9f3b-41ad-97ed-70f39764634b None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:19.811483 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2c6bdc-39f0-48c5-948d-a54541e85935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:19.812854 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2c6bdc-39f0-48c5-948d-a54541e85935 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:19.813358 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2c6bdc-39f0-48c5-948d-a54541e85935 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:19.813832 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2c6bdc-39f0-48c5-948d-a54541e85935 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:19.819784 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-55953790-9f3b-41ad-97ed-70f39764634b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:19.819784 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:19.819784 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:19.819784 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:19.819784 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:19.819784 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:19.819784 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:19.819784 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:19.819784 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:19.819784 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:19.819784 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:19.819784 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:19.819784 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 22:26:19.819784 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 22:26:19.819784 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 22:26:19.820681 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 22:26:19.820681 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:19.820681 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:19.820681 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:19.820681 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:19.820681 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:19.820681 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:19.820681 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:19.820681 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:19.820681 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:19.820681 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:19.820681 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:19.820681 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:19.820681 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:19.820681 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:19.820681 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:19.820681 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:19.821626 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 22:26:19.821626 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 22:26:19.821626 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:19.821626 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:26:19.825968 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 292/589] 10.222.0.36 () {56 vars in 1108 bytes} [Fri Jun 24 22:26:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:19.826781 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55953790-9f3b-41ad-97ed-70f39764634b None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:19.827330 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2c6bdc-39f0-48c5-948d-a54541e85935 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:19.829089 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2c6bdc-39f0-48c5-948d-a54541e85935 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:19.845513 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-ac2c6bdc-39f0-48c5-948d-a54541e85935 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 24 22:26:19.845513 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:19.845513 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:19.845513 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:19.845513 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:19.845513 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:19.845513 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:19.845513 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:19.845513 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:19.845513 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:19.845513 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:19.845513 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:19.845513 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 22:26:19.845513 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 22:26:19.845513 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 22:26:19.845513 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 22:26:19.846575 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:19.846575 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:19.846575 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 22:26:19.846575 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 22:26:19.846575 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 22:26:19.846575 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 22:26:19.846575 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:19.846575 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:19.846575 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:19.846575 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:19.846575 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:19.846575 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:19.846575 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:19.846575 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:19.846575 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:19.846575 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:19.846575 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:19.846575 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:19.848118 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:19.848118 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:19.848118 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 22:26:19.848118 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 22:26:19.848118 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 22:26:19.848118 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 22:26:19.848118 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 22:26:19.848118 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 22:26:19.848118 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 24 22:26:19.848118 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:26:19.848118 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 298/590] 10.222.0.36 () {56 vars in 1099 bytes} [Fri Jun 24 22:26:19 2022] GET /identity/v3/users/glance => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:19.848118 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2c6bdc-39f0-48c5-948d-a54541e85935 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:19.951641 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2c6bdc-39f0-48c5-948d-a54541e85935 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:19.957420 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55953790-9f3b-41ad-97ed-70f39764634b None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:19.986714 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8485a873-ead1-4a4a-9ca3-c185d8e49a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:19.987498 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485a873-ead1-4a4a-9ca3-c185d8e49a9d None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:19.987782 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485a873-ead1-4a4a-9ca3-c185d8e49a9d None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:19.988056 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485a873-ead1-4a4a-9ca3-c185d8e49a9d None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:19.988805 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8485a873-ead1-4a4a-9ca3-c185d8e49a9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:19.989091 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8485a873-ead1-4a4a-9ca3-c185d8e49a9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:19.990469 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8485a873-ead1-4a4a-9ca3-c185d8e49a9d None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:20.002884 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ecb054-088b-4192-986a-6dabc71aa088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:20.004118 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ecb054-088b-4192-986a-6dabc71aa088 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:20.004621 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ecb054-088b-4192-986a-6dabc71aa088 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:20.005096 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ecb054-088b-4192-986a-6dabc71aa088 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:20.007429 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 299/591] 10.222.0.36 () {56 vars in 1109 bytes} [Fri Jun 24 22:26:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:20.008303 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8485a873-ead1-4a4a-9ca3-c185d8e49a9d None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:20.015082 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ecb054-088b-4192-986a-6dabc71aa088 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:20.016821 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ecb054-088b-4192-986a-6dabc71aa088 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:20.016930 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:20.036637 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-65ecb054-088b-4192-986a-6dabc71aa088 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 24 22:26:20.036637 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:20.036637 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:20.036637 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:20.036637 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:20.036637 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:20.036637 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:20.036637 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:20.036637 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:20.036637 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:20.036637 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:20.036637 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:20.036637 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 22:26:20.036637 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 22:26:20.036637 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 22:26:20.036637 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 22:26:20.037645 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:20.037645 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:20.037645 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 22:26:20.037645 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 22:26:20.037645 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 22:26:20.037645 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 22:26:20.037645 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:20.037645 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:20.037645 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:20.037645 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:20.037645 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:20.037645 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:20.037645 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:20.037645 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:20.037645 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:20.037645 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:20.037645 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:20.037645 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:20.038577 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:20.038577 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:20.038577 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 22:26:20.038577 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 22:26:20.038577 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 22:26:20.038577 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 22:26:20.038577 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 22:26:20.038577 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 22:26:20.038577 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 24 22:26:20.038577 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:26:20.041556 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 293/592] 10.222.0.36 () {56 vars in 1102 bytes} [Fri Jun 24 22:26:19 2022] GET /identity/v3/users/neutron => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:20.042717 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ecb054-088b-4192-986a-6dabc71aa088 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:20.063300 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:20.120516 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8485a873-ead1-4a4a-9ca3-c185d8e49a9d None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:20.172707 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceec008-7495-4463-a4e7-a7d6de0c9168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:20.174108 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceec008-7495-4463-a4e7-a7d6de0c9168 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:20.174768 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceec008-7495-4463-a4e7-a7d6de0c9168 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:20.175145 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceec008-7495-4463-a4e7-a7d6de0c9168 None admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:20.176473 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceec008-7495-4463-a4e7-a7d6de0c9168 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:20.177271 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceec008-7495-4463-a4e7-a7d6de0c9168 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:20.179088 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceec008-7495-4463-a4e7-a7d6de0c9168 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:20.179849 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ecb054-088b-4192-986a-6dabc71aa088 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:20.203716 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 300/593] 10.222.0.36 () {56 vars in 1137 bytes} [Fri Jun 24 22:26:20 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:20.204584 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceec008-7495-4463-a4e7-a7d6de0c9168 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:20.223473 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102293a6-bedb-4584-a144-1234f14a4c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:20.224807 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102293a6-bedb-4584-a144-1234f14a4c30 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:20.225350 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102293a6-bedb-4584-a144-1234f14a4c30 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:20.225630 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102293a6-bedb-4584-a144-1234f14a4c30 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:20.234469 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102293a6-bedb-4584-a144-1234f14a4c30 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:20.236640 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102293a6-bedb-4584-a144-1234f14a4c30 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:20.254856 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-102293a6-bedb-4584-a144-1234f14a4c30 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 22:26:20.254856 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:20.254856 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:20.254856 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:20.254856 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:20.254856 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:20.254856 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:20.254856 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:20.254856 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:20.254856 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:20.254856 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:20.254856 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:20.254856 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 22:26:20.254856 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 22:26:20.254856 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 22:26:20.256139 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 22:26:20.256139 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:20.256139 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:20.256139 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:20.256139 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:20.256139 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:20.256139 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:20.256139 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:20.256139 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:20.256139 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:20.256139 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:20.256139 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:20.256139 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:20.256139 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:20.256139 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:20.256139 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:20.256139 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:20.257435 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 22:26:20.257435 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 22:26:20.257435 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 22:26:20.257435 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 22:26:20.257435 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 22:26:20.257435 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 22:26:20.257435 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 22:26:20.257435 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:26:20.257435 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 294/594] 10.222.0.36 () {56 vars in 1111 bytes} [Fri Jun 24 22:26:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:20.258424 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102293a6-bedb-4584-a144-1234f14a4c30 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:20.284249 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:20.335224 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceec008-7495-4463-a4e7-a7d6de0c9168 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:20.344257 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:20.382666 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fee85e2-e190-473f-9126-7bf70f8d2198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:20.383486 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fee85e2-e190-473f-9126-7bf70f8d2198 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:20.384078 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fee85e2-e190-473f-9126-7bf70f8d2198 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:20.384362 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fee85e2-e190-473f-9126-7bf70f8d2198 None admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:20.385426 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fee85e2-e190-473f-9126-7bf70f8d2198 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:20.385751 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fee85e2-e190-473f-9126-7bf70f8d2198 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:20.387920 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fee85e2-e190-473f-9126-7bf70f8d2198 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:20.389687 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102293a6-bedb-4584-a144-1234f14a4c30 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:20.409023 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 301/595] 10.222.0.36 () {56 vars in 1139 bytes} [Fri Jun 24 22:26:20 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:20.410813 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fee85e2-e190-473f-9126-7bf70f8d2198 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:20.438568 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8819ea27-7de3-4af8-b937-613d375ad917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:20.439420 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8819ea27-7de3-4af8-b937-613d375ad917 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:20.439769 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8819ea27-7de3-4af8-b937-613d375ad917 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:20.442641 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8819ea27-7de3-4af8-b937-613d375ad917 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:20.454518 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8819ea27-7de3-4af8-b937-613d375ad917 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:20.455944 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8819ea27-7de3-4af8-b937-613d375ad917 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:20.479220 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-8819ea27-7de3-4af8-b937-613d375ad917 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:20.479220 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:20.479220 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:20.479220 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:20.479220 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:20.479220 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:20.479220 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:20.479220 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:20.479220 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:20.479220 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:20.479220 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:20.479220 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:20.479220 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 22:26:20.479220 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 22:26:20.479220 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 22:26:20.480296 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 22:26:20.480296 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:20.480296 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:20.480296 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:20.480296 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:20.480296 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:20.480296 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:20.480296 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:20.480296 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:20.480296 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:20.480296 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:20.480296 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:20.480296 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:20.480296 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:20.480296 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:20.480296 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:20.480296 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:20.481248 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 22:26:20.481248 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 22:26:20.481248 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:20.481248 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:26:20.481248 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 295/596] 10.222.0.36 () {56 vars in 1108 bytes} [Fri Jun 24 22:26:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:20.481718 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8819ea27-7de3-4af8-b937-613d375ad917 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:20.517754 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fee85e2-e190-473f-9126-7bf70f8d2198 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:20.542651 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:20.561582 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b71b95-18d1-46f0-8792-5f386bf8c859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:20.562318 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b71b95-18d1-46f0-8792-5f386bf8c859 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:20.562615 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b71b95-18d1-46f0-8792-5f386bf8c859 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:20.563108 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b71b95-18d1-46f0-8792-5f386bf8c859 None admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:20.564326 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b71b95-18d1-46f0-8792-5f386bf8c859 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:20.564650 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b71b95-18d1-46f0-8792-5f386bf8c859 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:20.566424 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b71b95-18d1-46f0-8792-5f386bf8c859 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:20.587978 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 302/597] 10.222.0.36 () {56 vars in 1148 bytes} [Fri Jun 24 22:26:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:20.589010 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b71b95-18d1-46f0-8792-5f386bf8c859 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:20.605018 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8819ea27-7de3-4af8-b937-613d375ad917 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:20.623108 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:20.642426 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b3922e-c1fe-43d5-b8ff-b877520e400b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:20.643737 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b3922e-c1fe-43d5-b8ff-b877520e400b None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:20.644222 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b3922e-c1fe-43d5-b8ff-b877520e400b None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:20.644717 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b3922e-c1fe-43d5-b8ff-b877520e400b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:20.657063 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b3922e-c1fe-43d5-b8ff-b877520e400b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:20.658842 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b3922e-c1fe-43d5-b8ff-b877520e400b None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:20.677859 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-05b3922e-c1fe-43d5-b8ff-b877520e400b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:20.677859 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:20.677859 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:20.677859 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:20.677859 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:20.677859 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:20.677859 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:20.677859 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:20.677859 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:20.677859 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:20.677859 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:20.677859 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:20.677859 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 22:26:20.677859 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 22:26:20.677859 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 22:26:20.678850 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 22:26:20.678850 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:20.678850 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:20.678850 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:20.678850 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:20.678850 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:20.678850 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:20.678850 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:20.678850 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:20.678850 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:20.678850 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:20.678850 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:20.678850 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:20.678850 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:20.678850 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:20.678850 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:20.678850 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:20.679724 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 22:26:20.679724 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 22:26:20.679724 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:20.679724 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:26:20.682436 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 296/598] 10.222.0.36 () {56 vars in 1108 bytes} [Fri Jun 24 22:26:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:20.683570 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b3922e-c1fe-43d5-b8ff-b877520e400b None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:20.699957 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b71b95-18d1-46f0-8792-5f386bf8c859 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:20.735719 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bf9f2d-5ce7-41e1-96a1-9d92cc075842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:20.736305 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf9f2d-5ce7-41e1-96a1-9d92cc075842 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:20.736587 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf9f2d-5ce7-41e1-96a1-9d92cc075842 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:20.736903 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf9f2d-5ce7-41e1-96a1-9d92cc075842 None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:20.737573 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bf9f2d-5ce7-41e1-96a1-9d92cc075842 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:20.737877 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bf9f2d-5ce7-41e1-96a1-9d92cc075842 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:20.739409 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bf9f2d-5ce7-41e1-96a1-9d92cc075842 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:20.752851 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 303/599] 10.222.0.36 () {56 vars in 1109 bytes} [Fri Jun 24 22:26:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:20.753727 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bf9f2d-5ce7-41e1-96a1-9d92cc075842 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:20.793653 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b3922e-c1fe-43d5-b8ff-b877520e400b None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:20.799920 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:20.831799 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4b666f-4785-44f2-9d35-7995646fdeac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:20.833107 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4b666f-4785-44f2-9d35-7995646fdeac None admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:20.833587 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4b666f-4785-44f2-9d35-7995646fdeac None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:20.834144 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4b666f-4785-44f2-9d35-7995646fdeac None admin] PATH_INFO: `/v3/projects/d189b31bbec0469381292d2cde3cb420/users/e4a747e2a5684843a6ee9e3480badac7/roles/3265c7c44fb144a0a56467ded2a39413` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:20.849972 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4b666f-4785-44f2-9d35-7995646fdeac None admin] RBAC: Authorizing `identity:create_grant(project_id=d189b31bbec0469381292d2cde3cb420, user_id=e4a747e2a5684843a6ee9e3480badac7, role_id=3265c7c44fb144a0a56467ded2a39413)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:20.851912 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4b666f-4785-44f2-9d35-7995646fdeac None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:20.860609 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bf9f2d-5ce7-41e1-96a1-9d92cc075842 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:20.866640 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 297/600] 10.222.0.36 () {58 vars in 1439 bytes} [Fri Jun 24 22:26:20 2022] PUT /identity/v3/projects/d189b31bbec0469381292d2cde3cb420/users/e4a747e2a5684843a6ee9e3480badac7/roles/3265c7c44fb144a0a56467ded2a39413 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:26:20.867743 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4b666f-4785-44f2-9d35-7995646fdeac None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:20.896220 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:20.931902 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6fc60c-9ec1-48c9-962a-6302110a8a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:20.932830 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6fc60c-9ec1-48c9-962a-6302110a8a2f None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:20.932962 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6fc60c-9ec1-48c9-962a-6302110a8a2f None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:20.933231 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6fc60c-9ec1-48c9-962a-6302110a8a2f None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:20.934053 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6fc60c-9ec1-48c9-962a-6302110a8a2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:20.934263 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6fc60c-9ec1-48c9-962a-6302110a8a2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:20.935863 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6fc60c-9ec1-48c9-962a-6302110a8a2f None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:20.958361 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 304/601] 10.222.0.36 () {56 vars in 1109 bytes} [Fri Jun 24 22:26:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:20.964103 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6fc60c-9ec1-48c9-962a-6302110a8a2f None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:21.001610 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4b666f-4785-44f2-9d35-7995646fdeac None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:21.075167 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddce897-bc4d-4a0d-9082-a0c951716ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:21.076391 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddce897-bc4d-4a0d-9082-a0c951716ff9 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:21.076766 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6fc60c-9ec1-48c9-962a-6302110a8a2f None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:21.077088 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddce897-bc4d-4a0d-9082-a0c951716ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:21.077586 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddce897-bc4d-4a0d-9082-a0c951716ff9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:21.078397 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:21.091063 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddce897-bc4d-4a0d-9082-a0c951716ff9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:21.092916 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddce897-bc4d-4a0d-9082-a0c951716ff9 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:21.115177 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-5ddce897-bc4d-4a0d-9082-a0c951716ff9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 22:26:21.115177 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:21.115177 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:21.115177 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:21.115177 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:21.115177 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:21.115177 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:21.115177 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:21.115177 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:21.115177 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:21.115177 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:21.115177 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:21.115177 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 22:26:21.115177 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 22:26:21.115177 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 22:26:21.116149 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 22:26:21.116149 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:21.116149 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:21.116149 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:21.116149 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:21.116149 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:21.116149 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:21.116149 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:21.116149 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:21.116149 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:21.116149 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:21.116149 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:21.116149 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:21.116149 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:21.116149 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:21.116149 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:21.116149 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:21.117046 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 22:26:21.117046 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 22:26:21.117046 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 22:26:21.117046 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 22:26:21.117046 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 22:26:21.117046 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 22:26:21.117046 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 22:26:21.117046 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:26:21.120174 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 298/602] 10.222.0.36 () {56 vars in 1111 bytes} [Fri Jun 24 22:26:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:21.125816 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddce897-bc4d-4a0d-9082-a0c951716ff9 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:21.130368 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad5de60-b2fa-4ce3-ab6b-5c91deb77734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:21.131560 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad5de60-b2fa-4ce3-ab6b-5c91deb77734 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:21.131847 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad5de60-b2fa-4ce3-ab6b-5c91deb77734 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:21.132121 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad5de60-b2fa-4ce3-ab6b-5c91deb77734 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:21.141552 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad5de60-b2fa-4ce3-ab6b-5c91deb77734 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:21.143177 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad5de60-b2fa-4ce3-ab6b-5c91deb77734 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:21.159641 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-dad5de60-b2fa-4ce3-ab6b-5c91deb77734 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 22:26:21.159641 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:21.159641 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:21.159641 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:21.159641 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:21.159641 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:21.159641 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:21.159641 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:21.159641 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:21.159641 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:21.159641 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:21.159641 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:21.159641 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 22:26:21.159641 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 22:26:21.159641 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 22:26:21.160587 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 22:26:21.160587 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:21.160587 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:21.160587 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:21.160587 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:21.160587 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:21.160587 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:21.160587 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:21.160587 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:21.160587 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:21.160587 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:21.160587 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:21.160587 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:21.160587 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:21.160587 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:21.160587 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:21.160587 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:21.161466 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 22:26:21.161466 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 22:26:21.161466 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 22:26:21.161466 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 22:26:21.161466 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 22:26:21.161466 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 22:26:21.161466 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 22:26:21.161466 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:26:21.161466 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 305/603] 10.222.0.36 () {56 vars in 1111 bytes} [Fri Jun 24 22:26:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:21.162680 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d36c69-8f24-4853-96fb-398bd82bbd95 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:21.162967 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d36c69-8f24-4853-96fb-398bd82bbd95 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:21.163240 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d36c69-8f24-4853-96fb-398bd82bbd95 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:21.169539 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 306/604] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:26:21 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:26:21.170196 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d36c69-8f24-4853-96fb-398bd82bbd95 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:21.229426 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:21.260173 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddce897-bc4d-4a0d-9082-a0c951716ff9 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:21.299811 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d36c69-8f24-4853-96fb-398bd82bbd95 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:21.306120 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8c8f64-8c6a-46c8-8d3a-5a8021b8eb06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:21.306923 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8c8f64-8c6a-46c8-8d3a-5a8021b8eb06 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:21.307345 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8c8f64-8c6a-46c8-8d3a-5a8021b8eb06 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:21.307722 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8c8f64-8c6a-46c8-8d3a-5a8021b8eb06 None admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:21.308611 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8c8f64-8c6a-46c8-8d3a-5a8021b8eb06 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:21.309020 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8c8f64-8c6a-46c8-8d3a-5a8021b8eb06 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:21.310648 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8c8f64-8c6a-46c8-8d3a-5a8021b8eb06 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:21.334479 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 299/605] 10.222.0.36 () {56 vars in 1148 bytes} [Fri Jun 24 22:26:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:21.336063 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86760208-33d4-4d0b-a34c-5fe1f8b0c3cd None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:21.336494 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86760208-33d4-4d0b-a34c-5fe1f8b0c3cd None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:21.336969 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86760208-33d4-4d0b-a34c-5fe1f8b0c3cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:21.341913 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bec70d-c4a0-4fd1-9d1a-c3b2879ef43f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:21.342790 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bec70d-c4a0-4fd1-9d1a-c3b2879ef43f None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:21.343164 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bec70d-c4a0-4fd1-9d1a-c3b2879ef43f None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:21.343578 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bec70d-c4a0-4fd1-9d1a-c3b2879ef43f None admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:21.344787 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bec70d-c4a0-4fd1-9d1a-c3b2879ef43f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:21.344927 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bec70d-c4a0-4fd1-9d1a-c3b2879ef43f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:21.346467 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bec70d-c4a0-4fd1-9d1a-c3b2879ef43f None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:21.355307 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-86760208-33d4-4d0b-a34c-5fe1f8b0c3cd None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:26:21.356703 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-86760208-33d4-4d0b-a34c-5fe1f8b0c3cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:26:21.360374 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 307/606] 10.222.0.36 () {56 vars in 1148 bytes} [Fri Jun 24 22:26:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:21.361182 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bec70d-c4a0-4fd1-9d1a-c3b2879ef43f None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:21.388895 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:21.428321 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 300/607] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:26:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 22:26:21.429383 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86760208-33d4-4d0b-a34c-5fe1f8b0c3cd None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:21.474360 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bec70d-c4a0-4fd1-9d1a-c3b2879ef43f None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:21.509664 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011e0472-6931-4dc4-b7dc-45a2f4be86fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:21.510729 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e0472-6931-4dc4-b7dc-45a2f4be86fa None admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:21.511022 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e0472-6931-4dc4-b7dc-45a2f4be86fa None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:21.511412 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e0472-6931-4dc4-b7dc-45a2f4be86fa None admin] PATH_INFO: `/v3/projects/d189b31bbec0469381292d2cde3cb420/users/d156158fa06647569a8bb2d8d0019f28/roles/3265c7c44fb144a0a56467ded2a39413` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:21.523930 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:21.528894 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011e0472-6931-4dc4-b7dc-45a2f4be86fa None admin] RBAC: Authorizing `identity:create_grant(project_id=d189b31bbec0469381292d2cde3cb420, user_id=d156158fa06647569a8bb2d8d0019f28, role_id=3265c7c44fb144a0a56467ded2a39413)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:21.530374 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011e0472-6931-4dc4-b7dc-45a2f4be86fa None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:21.548691 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 308/608] 10.222.0.36 () {58 vars in 1439 bytes} [Fri Jun 24 22:26:21 2022] PUT /identity/v3/projects/d189b31bbec0469381292d2cde3cb420/users/d156158fa06647569a8bb2d8d0019f28/roles/3265c7c44fb144a0a56467ded2a39413 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:26:21.549343 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011e0472-6931-4dc4-b7dc-45a2f4be86fa None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:21.562061 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86760208-33d4-4d0b-a34c-5fe1f8b0c3cd None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:21.600207 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bca3100-2447-4f3f-a1c3-374265e6b9d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:21.601528 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bca3100-2447-4f3f-a1c3-374265e6b9d8 None admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:21.602105 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bca3100-2447-4f3f-a1c3-374265e6b9d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:21.602637 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bca3100-2447-4f3f-a1c3-374265e6b9d8 None admin] PATH_INFO: `/v3/projects/d189b31bbec0469381292d2cde3cb420/users/b78f1fcce4174d1a931453d930d306f9/roles/3265c7c44fb144a0a56467ded2a39413` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:21.619696 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bca3100-2447-4f3f-a1c3-374265e6b9d8 None admin] RBAC: Authorizing `identity:create_grant(project_id=d189b31bbec0469381292d2cde3cb420, user_id=b78f1fcce4174d1a931453d930d306f9, role_id=3265c7c44fb144a0a56467ded2a39413)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:21.622200 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bca3100-2447-4f3f-a1c3-374265e6b9d8 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:21.631021 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:21.640769 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 301/609] 10.222.0.36 () {58 vars in 1439 bytes} [Fri Jun 24 22:26:21 2022] PUT /identity/v3/projects/d189b31bbec0469381292d2cde3cb420/users/b78f1fcce4174d1a931453d930d306f9/roles/3265c7c44fb144a0a56467ded2a39413 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:26:21.689957 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6828f9-3832-452f-bace-e61d759832ec None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:21.690316 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6828f9-3832-452f-bace-e61d759832ec None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:21.690513 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6828f9-3832-452f-bace-e61d759832ec None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:21.692213 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 302/610] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:26:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 22:26:21.693866 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011e0472-6931-4dc4-b7dc-45a2f4be86fa None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:21.698112 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347da3fd-871f-4cce-8a8a-b23f73f034f2 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:21.698402 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347da3fd-871f-4cce-8a8a-b23f73f034f2 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:21.698674 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347da3fd-871f-4cce-8a8a-b23f73f034f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:21.716839 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-347da3fd-871f-4cce-8a8a-b23f73f034f2 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:26:21.718124 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-347da3fd-871f-4cce-8a8a-b23f73f034f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:26:21.765248 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505a341e-2427-4fb4-ad58-64f9def42500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:21.765970 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505a341e-2427-4fb4-ad58-64f9def42500 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:21.766363 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505a341e-2427-4fb4-ad58-64f9def42500 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:21.766640 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505a341e-2427-4fb4-ad58-64f9def42500 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:21.780137 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505a341e-2427-4fb4-ad58-64f9def42500 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 22:26:21.788429 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-505a341e-2427-4fb4-ad58-64f9def42500 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 22:26:21.788429 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:21.788429 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:21.788429 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:21.788429 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:21.788429 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:21.788429 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:21.788429 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:21.788429 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:21.788429 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:21.788429 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:21.788429 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:21.788429 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 22:26:21.788429 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 22:26:21.788429 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 22:26:21.788429 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 22:26:21.789397 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 22:26:21.789397 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 22:26:21.789397 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 22:26:21.789397 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 22:26:21.789397 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:21.789397 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:21.789397 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:21.789397 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:21.789397 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:21.789397 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:21.789397 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:21.789397 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:21.789397 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:21.789397 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:21.789397 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:21.789397 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:21.790372 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:21.790372 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:21.790372 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:21.790372 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:21.790372 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 22:26:21.790372 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 22:26:21.790372 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 22:26:21.790372 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 22:26:21.790372 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 22:26:21.790372 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 22:26:21.790372 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 22:26:21.790372 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:26:21.790372 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 309/611] 10.222.0.36 () {56 vars in 1102 bytes} [Fri Jun 24 22:26:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:21.795936 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505a341e-2427-4fb4-ad58-64f9def42500 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:21.818225 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 303/612] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:26:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 22:26:21.839540 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347da3fd-871f-4cce-8a8a-b23f73f034f2 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:21.914363 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:21.938848 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505a341e-2427-4fb4-ad58-64f9def42500 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:21.969069 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347da3fd-871f-4cce-8a8a-b23f73f034f2 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:21.975154 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:21.985156 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc0fb28-6774-4147-b0ce-c4c755b081f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:21.985834 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc0fb28-6774-4147-b0ce-c4c755b081f6 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:21.986329 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc0fb28-6774-4147-b0ce-c4c755b081f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:21.986602 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc0fb28-6774-4147-b0ce-c4c755b081f6 None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:21.988700 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc0fb28-6774-4147-b0ce-c4c755b081f6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:21.989010 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc0fb28-6774-4147-b0ce-c4c755b081f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:21.990396 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc0fb28-6774-4147-b0ce-c4c755b081f6 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:22.009500 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 310/613] 10.222.0.36 () {56 vars in 1103 bytes} [Fri Jun 24 22:26:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 22:26:22.015914 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc0fb28-6774-4147-b0ce-c4c755b081f6 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:22.030941 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6472dbbf-c7a2-4470-bade-d2eac28dbfcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:22.031823 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6472dbbf-c7a2-4470-bade-d2eac28dbfcb None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:22.032102 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6472dbbf-c7a2-4470-bade-d2eac28dbfcb None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:22.032377 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6472dbbf-c7a2-4470-bade-d2eac28dbfcb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:22.051891 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6472dbbf-c7a2-4470-bade-d2eac28dbfcb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 22:26:22.064797 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-6472dbbf-c7a2-4470-bade-d2eac28dbfcb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 22:26:22.064797 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:22.064797 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:22.064797 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:22.064797 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:22.064797 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:22.064797 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:22.064797 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:22.064797 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:22.064797 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:22.064797 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:22.064797 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:22.064797 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 22:26:22.064797 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 22:26:22.064797 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 22:26:22.064797 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 22:26:22.065755 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 22:26:22.065755 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 22:26:22.065755 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 22:26:22.065755 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 22:26:22.065755 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:22.065755 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:22.065755 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:22.065755 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:22.065755 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:22.065755 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:22.065755 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:22.065755 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:22.065755 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:22.065755 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:22.065755 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:22.065755 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:22.066589 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:22.066589 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:22.066589 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:22.066589 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:22.066589 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 22:26:22.066589 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 22:26:22.066589 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 22:26:22.066589 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 22:26:22.066589 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 22:26:22.066589 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 22:26:22.066589 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 22:26:22.066589 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:26:22.068671 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 304/614] 10.222.0.36 () {56 vars in 1102 bytes} [Fri Jun 24 22:26:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:22.075521 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6472dbbf-c7a2-4470-bade-d2eac28dbfcb None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:22.181904 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc0fb28-6774-4147-b0ce-c4c755b081f6 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:22.203660 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6472dbbf-c7a2-4470-bade-d2eac28dbfcb None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:22.215976 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:22.250595 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f832fb0-745d-42e0-9349-61034e289945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:22.251285 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f832fb0-745d-42e0-9349-61034e289945 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:22.251580 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f832fb0-745d-42e0-9349-61034e289945 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:22.251863 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f832fb0-745d-42e0-9349-61034e289945 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:22.252607 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f832fb0-745d-42e0-9349-61034e289945 None admin] RBAC: Adding query filter params (name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:22.252911 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f832fb0-745d-42e0-9349-61034e289945 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:22.254289 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f832fb0-745d-42e0-9349-61034e289945 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:22.264364 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 305/615] 10.222.0.36 () {56 vars in 1103 bytes} [Fri Jun 24 22:26:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:22.269973 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f832fb0-745d-42e0-9349-61034e289945 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:22.270545 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236be713-53c5-464f-9cd5-896fb55446cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:22.271381 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236be713-53c5-464f-9cd5-896fb55446cd None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:22.271669 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236be713-53c5-464f-9cd5-896fb55446cd None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:22.271944 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236be713-53c5-464f-9cd5-896fb55446cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:22.300234 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236be713-53c5-464f-9cd5-896fb55446cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:22.301711 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236be713-53c5-464f-9cd5-896fb55446cd None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:22.330502 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-236be713-53c5-464f-9cd5-896fb55446cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:22.330502 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:22.330502 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:22.330502 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:22.330502 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:22.330502 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:22.330502 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:22.330502 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:22.330502 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:22.330502 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:22.330502 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:22.330502 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:22.330502 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 22:26:22.330502 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 22:26:22.330502 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 22:26:22.331587 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 22:26:22.331587 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:22.331587 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:22.331587 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:22.331587 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:22.331587 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:22.331587 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:22.331587 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:22.331587 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:22.331587 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:22.331587 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:22.331587 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:22.331587 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:22.331587 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:22.331587 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:22.331587 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:22.331587 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:22.332429 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 22:26:22.332429 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 22:26:22.332429 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:22.332429 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:26:22.332653 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 311/616] 10.222.0.36 () {56 vars in 1108 bytes} [Fri Jun 24 22:26:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 22:26:22.337732 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236be713-53c5-464f-9cd5-896fb55446cd None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:22.419422 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f832fb0-745d-42e0-9349-61034e289945 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:22.421480 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:22.456260 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cd024d-4da1-42f6-bb7c-d40e2a8bcee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:22.457059 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cd024d-4da1-42f6-bb7c-d40e2a8bcee5 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:22.457396 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cd024d-4da1-42f6-bb7c-d40e2a8bcee5 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:22.457670 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cd024d-4da1-42f6-bb7c-d40e2a8bcee5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:22.468891 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cd024d-4da1-42f6-bb7c-d40e2a8bcee5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:22.470505 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cd024d-4da1-42f6-bb7c-d40e2a8bcee5 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:22.488526 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-57cd024d-4da1-42f6-bb7c-d40e2a8bcee5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:22.488526 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:22.488526 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:22.488526 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:22.488526 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:22.488526 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:22.488526 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:22.488526 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:22.488526 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:22.488526 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:22.488526 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:22.488526 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:22.488526 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 22:26:22.488526 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 22:26:22.488526 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 22:26:22.489459 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 22:26:22.489459 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:22.489459 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:22.489459 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:22.489459 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:22.489459 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:22.489459 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:22.489459 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:22.489459 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:22.489459 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:22.489459 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:22.489459 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:22.489459 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:22.489459 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:22.489459 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:22.489459 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:22.489459 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:22.490336 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 22:26:22.490336 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 22:26:22.490336 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:22.490336 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:26:22.490336 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 306/617] 10.222.0.36 () {56 vars in 1108 bytes} [Fri Jun 24 22:26:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 22:26:22.495800 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cd024d-4da1-42f6-bb7c-d40e2a8bcee5 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:22.547837 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:22.569457 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236be713-53c5-464f-9cd5-896fb55446cd None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:22.640656 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cd024d-4da1-42f6-bb7c-d40e2a8bcee5 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:22.652273 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2519dd02-4660-47ac-aabe-5c8ee530d53d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:22.652957 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2519dd02-4660-47ac-aabe-5c8ee530d53d None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:22.653244 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2519dd02-4660-47ac-aabe-5c8ee530d53d None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:22.653523 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2519dd02-4660-47ac-aabe-5c8ee530d53d None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:22.654253 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2519dd02-4660-47ac-aabe-5c8ee530d53d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:22.654562 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2519dd02-4660-47ac-aabe-5c8ee530d53d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:22.655997 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2519dd02-4660-47ac-aabe-5c8ee530d53d None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:22.681416 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 312/618] 10.222.0.36 () {56 vars in 1109 bytes} [Fri Jun 24 22:26:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:22.682870 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8136e117-680c-46a4-b365-2630e393c5b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:22.683622 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8136e117-680c-46a4-b365-2630e393c5b9 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:22.683954 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8136e117-680c-46a4-b365-2630e393c5b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:22.684274 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8136e117-680c-46a4-b365-2630e393c5b9 None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:22.684999 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8136e117-680c-46a4-b365-2630e393c5b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:22.685354 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8136e117-680c-46a4-b365-2630e393c5b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:22.687417 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2519dd02-4660-47ac-aabe-5c8ee530d53d None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:22.688213 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8136e117-680c-46a4-b365-2630e393c5b9 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:22.713534 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 307/619] 10.222.0.36 () {56 vars in 1109 bytes} [Fri Jun 24 22:26:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:22.716452 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8136e117-680c-46a4-b365-2630e393c5b9 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:22.884241 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:22.890206 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2519dd02-4660-47ac-aabe-5c8ee530d53d None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:22.899723 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:22.915568 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8136e117-680c-46a4-b365-2630e393c5b9 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:22.935502 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b918f094-b33b-4158-9ef4-83133ff8ce42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:22.936667 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b918f094-b33b-4158-9ef4-83133ff8ce42 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:22.937241 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b918f094-b33b-4158-9ef4-83133ff8ce42 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:22.937726 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b918f094-b33b-4158-9ef4-83133ff8ce42 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:22.946403 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b918f094-b33b-4158-9ef4-83133ff8ce42 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:22.948743 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b918f094-b33b-4158-9ef4-83133ff8ce42 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:22.951589 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2829dad-bebf-49e0-8626-052bc4d063c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:22.952304 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2829dad-bebf-49e0-8626-052bc4d063c3 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:22.952589 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2829dad-bebf-49e0-8626-052bc4d063c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:22.952868 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2829dad-bebf-49e0-8626-052bc4d063c3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:22.960401 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2829dad-bebf-49e0-8626-052bc4d063c3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:22.961917 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2829dad-bebf-49e0-8626-052bc4d063c3 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:22.967051 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-b918f094-b33b-4158-9ef4-83133ff8ce42 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 24 22:26:22.967051 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:22.967051 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:22.967051 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:22.967051 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:22.967051 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:22.967051 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:22.967051 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:22.967051 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:22.967051 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:22.967051 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:22.967051 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:22.967051 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 22:26:22.967051 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 22:26:22.967051 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 22:26:22.967051 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 22:26:22.967999 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:22.967999 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:22.967999 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 22:26:22.967999 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 22:26:22.967999 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 22:26:22.967999 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 22:26:22.967999 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:22.967999 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:22.967999 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:22.967999 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:22.967999 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:22.967999 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:22.967999 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:22.967999 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:22.967999 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:22.967999 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:22.967999 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:22.967999 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:22.968917 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:22.968917 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:22.968917 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 22:26:22.968917 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 22:26:22.968917 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 22:26:22.968917 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 22:26:22.968917 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 22:26:22.968917 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 22:26:22.968917 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 24 22:26:22.968917 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:26:22.971558 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 313/620] 10.222.0.36 () {56 vars in 1093 bytes} [Fri Jun 24 22:26:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:22.984390 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-f2829dad-bebf-49e0-8626-052bc4d063c3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 24 22:26:22.984390 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:22.984390 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:22.984390 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:22.984390 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:22.984390 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:22.984390 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:22.984390 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:22.984390 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:22.984390 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:22.984390 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:22.984390 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:22.984390 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 22:26:22.984390 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 22:26:22.984390 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 22:26:22.984390 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 22:26:22.985410 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:22.985410 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:22.985410 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 22:26:22.985410 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 22:26:22.985410 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 22:26:22.985410 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 22:26:22.985410 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:22.985410 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:22.985410 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:22.985410 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:22.985410 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:22.985410 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:22.985410 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:22.985410 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:22.985410 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:22.985410 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:22.985410 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:22.985410 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:22.987228 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:22.987228 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:22.987228 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 22:26:22.987228 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 22:26:22.987228 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 22:26:22.987228 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 22:26:22.987228 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 22:26:22.987228 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 22:26:22.987228 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 24 22:26:22.987228 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:26:22.988311 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 308/621] 10.222.0.36 () {56 vars in 1096 bytes} [Fri Jun 24 22:26:22 2022] GET /identity/v3/users/swift => generated 83 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:22.989640 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b918f094-b33b-4158-9ef4-83133ff8ce42 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:22.991323 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2829dad-bebf-49e0-8626-052bc4d063c3 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:23.190886 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b918f094-b33b-4158-9ef4-83133ff8ce42 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:23.206926 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2829dad-bebf-49e0-8626-052bc4d063c3 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:23.253422 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3b49e6-b595-46a3-9e09-f0268b9097ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:23.254108 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3b49e6-b595-46a3-9e09-f0268b9097ec None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:23.254383 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3b49e6-b595-46a3-9e09-f0268b9097ec None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:23.254656 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3b49e6-b595-46a3-9e09-f0268b9097ec None admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:23.255524 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3b49e6-b595-46a3-9e09-f0268b9097ec None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:23.256162 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3b49e6-b595-46a3-9e09-f0268b9097ec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:23.257616 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3b49e6-b595-46a3-9e09-f0268b9097ec None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:23.267284 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1958af5c-3142-413d-bc61-d865e2527b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:23.268022 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1958af5c-3142-413d-bc61-d865e2527b19 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:23.268305 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1958af5c-3142-413d-bc61-d865e2527b19 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:23.268579 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1958af5c-3142-413d-bc61-d865e2527b19 None admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:23.269417 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1958af5c-3142-413d-bc61-d865e2527b19 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:23.269722 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1958af5c-3142-413d-bc61-d865e2527b19 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:23.271146 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1958af5c-3142-413d-bc61-d865e2527b19 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:23.300961 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 314/622] 10.222.0.36 () {56 vars in 1135 bytes} [Fri Jun 24 22:26:22 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:23.302194 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 309/623] 10.222.0.36 () {56 vars in 1133 bytes} [Fri Jun 24 22:26:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:23.307176 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f8f60-43b1-41cf-a61f-6981cdc6cfb9 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:23.307503 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f8f60-43b1-41cf-a61f-6981cdc6cfb9 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:23.307792 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f8f60-43b1-41cf-a61f-6981cdc6cfb9 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:23.308239 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1958af5c-3142-413d-bc61-d865e2527b19 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:23.309791 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 315/624] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:26:23 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:26:23.310995 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719f8f60-43b1-41cf-a61f-6981cdc6cfb9 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:23.314323 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:23.343874 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:23.424566 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1958af5c-3142-413d-bc61-d865e2527b19 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:23.443947 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719f8f60-43b1-41cf-a61f-6981cdc6cfb9 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:23.471985 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54a1d23-f79d-4dcd-9838-2e4fefcc57ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:23.473160 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a1d23-f79d-4dcd-9838-2e4fefcc57ad None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:23.473659 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a1d23-f79d-4dcd-9838-2e4fefcc57ad None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:23.474133 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a1d23-f79d-4dcd-9838-2e4fefcc57ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:23.485421 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54a1d23-f79d-4dcd-9838-2e4fefcc57ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:23.487194 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54a1d23-f79d-4dcd-9838-2e4fefcc57ad None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:23.488220 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d36987-6626-4259-9b56-141247d1e25f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:23.488881 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d36987-6626-4259-9b56-141247d1e25f None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:23.489166 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d36987-6626-4259-9b56-141247d1e25f None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:23.489437 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d36987-6626-4259-9b56-141247d1e25f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:23.508275 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-e54a1d23-f79d-4dcd-9838-2e4fefcc57ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:23.508275 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:23.508275 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:23.508275 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:23.508275 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:23.508275 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:23.508275 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:23.508275 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:23.508275 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:23.508275 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:23.508275 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:23.508275 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:23.508275 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 22:26:23.508275 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 22:26:23.508275 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 22:26:23.509391 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 22:26:23.509391 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:23.509391 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:23.509391 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:23.509391 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:23.509391 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:23.509391 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:23.509391 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:23.509391 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:23.509391 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:23.509391 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:23.509391 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:23.509391 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:23.509391 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:23.509391 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:23.509391 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:23.509391 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:23.510294 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 22:26:23.510294 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 22:26:23.510294 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:23.510294 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:26:23.512626 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 310/625] 10.222.0.36 () {56 vars in 1108 bytes} [Fri Jun 24 22:26:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:23.514110 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd8c0d-8353-4cb1-96d0-a38d55357710 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:23.514595 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd8c0d-8353-4cb1-96d0-a38d55357710 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:23.515063 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd8c0d-8353-4cb1-96d0-a38d55357710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:23.533986 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-28dd8c0d-8353-4cb1-96d0-a38d55357710 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:26:23.535659 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-28dd8c0d-8353-4cb1-96d0-a38d55357710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:26:23.573836 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d36987-6626-4259-9b56-141247d1e25f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:23.575748 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d36987-6626-4259-9b56-141247d1e25f None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:23.596609 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:23.609608 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:23.618633 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 311/626] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:26:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 22:26:23.619940 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dd8c0d-8353-4cb1-96d0-a38d55357710 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:23.735812 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 316/627] 10.222.0.36 () {58 vars in 1282 bytes} [Fri Jun 24 22:26:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 22:26:23.735812 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d36987-6626-4259-9b56-141247d1e25f None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:23.758746 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dd8c0d-8353-4cb1-96d0-a38d55357710 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:23.794992 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d88c3d-7d98-4105-8edd-7d907244a729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:23.796106 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d88c3d-7d98-4105-8edd-7d907244a729 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:23.796580 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d88c3d-7d98-4105-8edd-7d907244a729 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:23.797058 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d88c3d-7d98-4105-8edd-7d907244a729 None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:23.797977 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d88c3d-7d98-4105-8edd-7d907244a729 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:23.798483 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d88c3d-7d98-4105-8edd-7d907244a729 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:23.800183 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d88c3d-7d98-4105-8edd-7d907244a729 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:23.817550 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 312/628] 10.222.0.36 () {56 vars in 1109 bytes} [Fri Jun 24 22:26:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:23.818759 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d88c3d-7d98-4105-8edd-7d907244a729 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:23.859877 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d36987-6626-4259-9b56-141247d1e25f None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:23.874158 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:23.893483 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:23.914636 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf632eb2-2755-46e2-87d5-584d338b648b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:23.915577 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf632eb2-2755-46e2-87d5-584d338b648b None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:23.915860 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf632eb2-2755-46e2-87d5-584d338b648b None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:23.916525 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf632eb2-2755-46e2-87d5-584d338b648b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:23.929409 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf632eb2-2755-46e2-87d5-584d338b648b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 22:26:23.937643 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-bf632eb2-2755-46e2-87d5-584d338b648b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 22:26:23.937643 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:23.937643 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:23.937643 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:23.937643 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:23.937643 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:23.937643 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:23.937643 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:23.937643 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:23.937643 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:23.937643 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:23.937643 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:23.937643 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 22:26:23.937643 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 22:26:23.937643 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 22:26:23.937643 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 22:26:23.938649 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 22:26:23.938649 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 22:26:23.938649 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 22:26:23.938649 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 22:26:23.938649 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:23.938649 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:23.938649 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:23.938649 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:23.938649 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:23.938649 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:23.938649 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:23.938649 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:23.938649 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:23.938649 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:23.938649 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:23.938649 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:23.939523 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:23.939523 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:23.939523 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:23.939523 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:23.939523 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 22:26:23.939523 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 22:26:23.939523 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 22:26:23.939523 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 22:26:23.939523 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 22:26:23.939523 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 22:26:23.939523 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 22:26:23.939523 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:26:23.939523 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 317/629] 10.222.0.36 () {56 vars in 1102 bytes} [Fri Jun 24 22:26:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:23.940241 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d88c3d-7d98-4105-8edd-7d907244a729 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:23.944108 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf632eb2-2755-46e2-87d5-584d338b648b None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:23.975357 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73883159-8079-4eef-a459-328936a3c573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:23.976447 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73883159-8079-4eef-a459-328936a3c573 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:23.976737 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73883159-8079-4eef-a459-328936a3c573 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:23.977013 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73883159-8079-4eef-a459-328936a3c573 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:23.988091 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73883159-8079-4eef-a459-328936a3c573 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:23.989518 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73883159-8079-4eef-a459-328936a3c573 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:24.006705 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-73883159-8079-4eef-a459-328936a3c573 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:24.006705 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:24.006705 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:24.006705 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:24.006705 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:24.006705 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:24.006705 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:24.006705 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:24.006705 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:24.006705 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:24.006705 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:24.006705 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:24.006705 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 22:26:24.006705 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 22:26:24.006705 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 22:26:24.007616 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 22:26:24.007616 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:24.007616 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:24.007616 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:24.007616 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:24.007616 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:24.007616 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:24.007616 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:24.007616 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:24.007616 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:24.007616 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:24.007616 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:24.007616 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:24.007616 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:24.007616 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:24.007616 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:24.007616 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:24.008666 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 22:26:24.008666 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 22:26:24.008666 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:24.008666 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:26:24.008666 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 313/630] 10.222.0.36 () {56 vars in 1108 bytes} [Fri Jun 24 22:26:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:24.009407 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590d14d2-8a1b-42c8-adbe-fad57c9320fc None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:24.009574 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590d14d2-8a1b-42c8-adbe-fad57c9320fc None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:24.009824 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590d14d2-8a1b-42c8-adbe-fad57c9320fc None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:24.011078 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 314/631] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:26:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:26:24.011787 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590d14d2-8a1b-42c8-adbe-fad57c9320fc None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:24.047378 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf632eb2-2755-46e2-87d5-584d338b648b None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:24.079600 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d801501-87f1-4452-950f-237112a7f7c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:24.080393 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d801501-87f1-4452-950f-237112a7f7c0 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:24.080675 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d801501-87f1-4452-950f-237112a7f7c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:24.080952 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d801501-87f1-4452-950f-237112a7f7c0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:24.087571 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d801501-87f1-4452-950f-237112a7f7c0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:24.089054 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d801501-87f1-4452-950f-237112a7f7c0 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:24.102838 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-6d801501-87f1-4452-950f-237112a7f7c0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 22:26:24.102838 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:24.102838 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:24.102838 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:24.102838 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:24.102838 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:24.102838 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:24.102838 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:24.102838 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:24.102838 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:24.102838 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:24.102838 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:24.102838 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 22:26:24.102838 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 22:26:24.102838 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 22:26:24.103768 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 22:26:24.103768 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:24.103768 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:24.103768 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:24.103768 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:24.103768 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:24.103768 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:24.103768 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:24.103768 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:24.103768 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:24.103768 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:24.103768 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:24.103768 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:24.103768 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:24.103768 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:24.103768 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:24.103768 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:24.104638 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 22:26:24.104638 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 22:26:24.104638 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 22:26:24.104638 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 22:26:24.104638 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 22:26:24.104638 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 22:26:24.104638 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 22:26:24.104638 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:26:24.104638 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 318/632] 10.222.0.36 () {56 vars in 1111 bytes} [Fri Jun 24 22:26:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:24.105247 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29048c02-1635-476a-b536-2b907cd453cc None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:24.105523 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29048c02-1635-476a-b536-2b907cd453cc None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:24.105757 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29048c02-1635-476a-b536-2b907cd453cc None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:24.106990 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 319/633] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:26:24 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:26:24.107693 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29048c02-1635-476a-b536-2b907cd453cc None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:24.109377 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:24.116938 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590d14d2-8a1b-42c8-adbe-fad57c9320fc None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:24.152238 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefcd0bd-6ac9-4b34-a66a-6a1a361bbde7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:24.152790 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefcd0bd-6ac9-4b34-a66a-6a1a361bbde7 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:24.153075 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefcd0bd-6ac9-4b34-a66a-6a1a361bbde7 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:24.153369 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefcd0bd-6ac9-4b34-a66a-6a1a361bbde7 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:24.154124 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefcd0bd-6ac9-4b34-a66a-6a1a361bbde7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:24.154420 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefcd0bd-6ac9-4b34-a66a-6a1a361bbde7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:24.155568 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:24.155834 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefcd0bd-6ac9-4b34-a66a-6a1a361bbde7 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:24.163947 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 315/634] 10.222.0.36 () {56 vars in 1103 bytes} [Fri Jun 24 22:26:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:24.165338 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0935a85-6cc5-41ce-bb72-23d2b8e289cd None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:24.165672 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0935a85-6cc5-41ce-bb72-23d2b8e289cd None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:24.165955 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0935a85-6cc5-41ce-bb72-23d2b8e289cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:24.182026 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-f0935a85-6cc5-41ce-bb72-23d2b8e289cd None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:26:24.183225 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-f0935a85-6cc5-41ce-bb72-23d2b8e289cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:26:24.214641 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29048c02-1635-476a-b536-2b907cd453cc None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:24.249287 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 316/635] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:26:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 22:26:24.249784 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbb15a1-74ca-48c6-8301-ce4cb143cc2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:24.250004 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbb15a1-74ca-48c6-8301-ce4cb143cc2e None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:24.250107 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0935a85-6cc5-41ce-bb72-23d2b8e289cd None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:24.250276 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbb15a1-74ca-48c6-8301-ce4cb143cc2e None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:24.250549 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbb15a1-74ca-48c6-8301-ce4cb143cc2e None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:24.251293 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbb15a1-74ca-48c6-8301-ce4cb143cc2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:24.251604 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbb15a1-74ca-48c6-8301-ce4cb143cc2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:24.252996 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbb15a1-74ca-48c6-8301-ce4cb143cc2e None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:24.264559 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 320/636] 10.222.0.36 () {56 vars in 1109 bytes} [Fri Jun 24 22:26:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:24.265762 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689c6ca5-e6e1-4acb-8b70-843a0efae0c7 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:24.266048 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689c6ca5-e6e1-4acb-8b70-843a0efae0c7 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:24.266325 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689c6ca5-e6e1-4acb-8b70-843a0efae0c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:24.282488 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-689c6ca5-e6e1-4acb-8b70-843a0efae0c7 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:26:24.283725 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-689c6ca5-e6e1-4acb-8b70-843a0efae0c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:26:24.344899 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:24.349356 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 321/637] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:26:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 22:26:24.350176 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689c6ca5-e6e1-4acb-8b70-843a0efae0c7 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:24.357786 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0935a85-6cc5-41ce-bb72-23d2b8e289cd None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:24.390946 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:24.393636 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e51b4f1-6850-4d2f-bc5b-9ac10c74a617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:24.394303 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e51b4f1-6850-4d2f-bc5b-9ac10c74a617 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:24.394586 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e51b4f1-6850-4d2f-bc5b-9ac10c74a617 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:24.394858 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e51b4f1-6850-4d2f-bc5b-9ac10c74a617 None admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:24.395692 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e51b4f1-6850-4d2f-bc5b-9ac10c74a617 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:24.396001 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e51b4f1-6850-4d2f-bc5b-9ac10c74a617 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:24.397459 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e51b4f1-6850-4d2f-bc5b-9ac10c74a617 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:24.409020 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 317/638] 10.222.0.36 () {56 vars in 1148 bytes} [Fri Jun 24 22:26:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:24.409799 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e51b4f1-6850-4d2f-bc5b-9ac10c74a617 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:24.460769 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689c6ca5-e6e1-4acb-8b70-843a0efae0c7 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:24.494054 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa05a7f-08fd-4161-b564-9086bfa4889f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:24.494849 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa05a7f-08fd-4161-b564-9086bfa4889f None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:24.495129 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa05a7f-08fd-4161-b564-9086bfa4889f None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:24.495433 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa05a7f-08fd-4161-b564-9086bfa4889f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:24.506093 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa05a7f-08fd-4161-b564-9086bfa4889f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:24.507537 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa05a7f-08fd-4161-b564-9086bfa4889f None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:24.515675 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e51b4f1-6850-4d2f-bc5b-9ac10c74a617 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:24.524882 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-1aa05a7f-08fd-4161-b564-9086bfa4889f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:24.524882 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:24.524882 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:24.524882 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:24.524882 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:24.524882 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:24.524882 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:24.524882 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:24.524882 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:24.524882 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:24.524882 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:24.524882 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:24.524882 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 22:26:24.524882 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 22:26:24.524882 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 22:26:24.525831 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 22:26:24.525831 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:24.525831 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:24.525831 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:24.525831 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:24.525831 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:24.525831 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:24.525831 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:24.525831 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:24.525831 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:24.525831 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:24.525831 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:24.525831 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:24.525831 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:24.525831 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:24.525831 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:24.525831 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:24.526668 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 22:26:24.526668 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 22:26:24.526668 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:24.526668 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:26:24.526668 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 322/639] 10.222.0.36 () {56 vars in 1108 bytes} [Fri Jun 24 22:26:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:24.526958 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa05a7f-08fd-4161-b564-9086bfa4889f None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:24.550712 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f23b448-40dd-4f67-a10f-13f5a5babbec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:24.551529 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f23b448-40dd-4f67-a10f-13f5a5babbec None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:24.551815 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f23b448-40dd-4f67-a10f-13f5a5babbec None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:24.552093 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f23b448-40dd-4f67-a10f-13f5a5babbec None admin] PATH_INFO: `/v3/projects/service` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:24.558953 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f23b448-40dd-4f67-a10f-13f5a5babbec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:24.560440 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f23b448-40dd-4f67-a10f-13f5a5babbec None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:24.574511 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-4f23b448-40dd-4f67-a10f-13f5a5babbec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 22:26:24.574511 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:24.574511 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:24.574511 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:24.574511 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:24.574511 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:24.574511 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:24.574511 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:24.574511 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:24.574511 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:24.574511 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:24.574511 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:24.574511 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 22:26:24.574511 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 22:26:24.574511 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 22:26:24.575706 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 22:26:24.575706 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:24.575706 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:24.575706 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:24.575706 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:24.575706 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:24.575706 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:24.575706 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:24.575706 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:24.575706 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:24.575706 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:24.575706 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:24.575706 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:24.575706 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:24.575706 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:24.575706 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:24.575706 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:24.576733 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 22:26:24.576733 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 22:26:24.576733 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 22:26:24.576733 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 22:26:24.576733 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 22:26:24.576733 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 22:26:24.576733 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 22:26:24.576733 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:26:24.576733 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 318/640] 10.222.0.36 () {56 vars in 1111 bytes} [Fri Jun 24 22:26:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:24.576733 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f23b448-40dd-4f67-a10f-13f5a5babbec None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:24.587470 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:24.612353 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:24.627592 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa05a7f-08fd-4161-b564-9086bfa4889f None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:24.662204 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0efd125-3c87-4fbc-99cf-1203e944df19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:24.663003 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0efd125-3c87-4fbc-99cf-1203e944df19 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:24.663301 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0efd125-3c87-4fbc-99cf-1203e944df19 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:24.663573 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0efd125-3c87-4fbc-99cf-1203e944df19 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:24.673666 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0efd125-3c87-4fbc-99cf-1203e944df19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 22:26:24.676504 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f23b448-40dd-4f67-a10f-13f5a5babbec None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:24.681381 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-e0efd125-3c87-4fbc-99cf-1203e944df19 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 22:26:24.681381 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:24.681381 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:24.681381 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:24.681381 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:24.681381 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:24.681381 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:24.681381 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:24.681381 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:24.681381 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:24.681381 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:24.681381 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:24.681381 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 22:26:24.681381 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 22:26:24.681381 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 22:26:24.681381 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 22:26:24.682360 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 22:26:24.682360 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 22:26:24.682360 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 22:26:24.682360 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 22:26:24.682360 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:24.682360 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:24.682360 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:24.682360 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:24.682360 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:24.682360 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:24.682360 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:24.682360 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:24.682360 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:24.682360 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:24.682360 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:24.682360 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:24.683189 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:24.683189 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:24.683189 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:24.683189 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:24.683189 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 22:26:24.683189 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 22:26:24.683189 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 22:26:24.683189 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 22:26:24.683189 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 22:26:24.683189 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 22:26:24.683189 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 22:26:24.683189 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:26:24.683189 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 323/641] 10.222.0.36 () {56 vars in 1102 bytes} [Fri Jun 24 22:26:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:24.684529 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0efd125-3c87-4fbc-99cf-1203e944df19 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:24.711781 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891d8957-1a21-4433-8986-26de44173e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:24.712837 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891d8957-1a21-4433-8986-26de44173e69 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:24.713122 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891d8957-1a21-4433-8986-26de44173e69 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:24.713396 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891d8957-1a21-4433-8986-26de44173e69 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:24.723394 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891d8957-1a21-4433-8986-26de44173e69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 22:26:24.731090 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-891d8957-1a21-4433-8986-26de44173e69 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 22:26:24.731090 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:24.731090 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:24.731090 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:24.731090 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:24.731090 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:24.731090 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:24.731090 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:24.731090 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:24.731090 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:24.731090 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:24.731090 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:24.731090 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 22:26:24.731090 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 22:26:24.731090 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 22:26:24.731090 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 22:26:24.732089 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 22:26:24.732089 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 22:26:24.732089 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 22:26:24.732089 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 22:26:24.732089 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:24.732089 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:24.732089 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:24.732089 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:24.732089 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:24.732089 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:24.732089 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:24.732089 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:24.732089 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:24.732089 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:24.732089 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:24.732089 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:24.738058 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:24.738058 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:24.738058 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:24.738058 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:24.738058 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 22:26:24.738058 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 22:26:24.738058 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 22:26:24.738058 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 22:26:24.738058 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 22:26:24.738058 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 22:26:24.738058 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 22:26:24.738058 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:26:24.738058 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 319/642] 10.222.0.36 () {56 vars in 1102 bytes} [Fri Jun 24 22:26:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:24.738058 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891d8957-1a21-4433-8986-26de44173e69 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:24.788692 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0efd125-3c87-4fbc-99cf-1203e944df19 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:24.806228 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:24.823567 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556d12bf-902b-437c-bc6b-d7c4db966485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:24.824476 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556d12bf-902b-437c-bc6b-d7c4db966485 None admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:24.824760 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556d12bf-902b-437c-bc6b-d7c4db966485 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:24.825032 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556d12bf-902b-437c-bc6b-d7c4db966485 None admin] PATH_INFO: `/v3/projects/d189b31bbec0469381292d2cde3cb420/users/6b95846f7f2a453f85ddb41a5d3327f3/roles/3265c7c44fb144a0a56467ded2a39413` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:24.838810 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891d8957-1a21-4433-8986-26de44173e69 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:24.839871 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556d12bf-902b-437c-bc6b-d7c4db966485 None admin] RBAC: Authorizing `identity:create_grant(project_id=d189b31bbec0469381292d2cde3cb420, user_id=6b95846f7f2a453f85ddb41a5d3327f3, role_id=3265c7c44fb144a0a56467ded2a39413)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:24.841354 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556d12bf-902b-437c-bc6b-d7c4db966485 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:24.844256 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:24.855131 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 324/643] 10.222.0.36 () {58 vars in 1439 bytes} [Fri Jun 24 22:26:24 2022] PUT /identity/v3/projects/d189b31bbec0469381292d2cde3cb420/users/6b95846f7f2a453f85ddb41a5d3327f3/roles/3265c7c44fb144a0a56467ded2a39413 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:26:24.856076 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556d12bf-902b-437c-bc6b-d7c4db966485 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:24.889823 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67676de1-c3de-4726-9374-d0f6fa560129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:24.890519 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67676de1-c3de-4726-9374-d0f6fa560129 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:24.890819 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67676de1-c3de-4726-9374-d0f6fa560129 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:24.891085 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67676de1-c3de-4726-9374-d0f6fa560129 None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:24.891898 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67676de1-c3de-4726-9374-d0f6fa560129 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:24.892263 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67676de1-c3de-4726-9374-d0f6fa560129 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:24.893724 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67676de1-c3de-4726-9374-d0f6fa560129 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:24.908159 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 320/644] 10.222.0.36 () {56 vars in 1109 bytes} [Fri Jun 24 22:26:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:24.908886 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67676de1-c3de-4726-9374-d0f6fa560129 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:24.974864 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556d12bf-902b-437c-bc6b-d7c4db966485 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:25.017842 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3932fd-a3e0-4eab-876c-34a59d223cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:25.018345 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3932fd-a3e0-4eab-876c-34a59d223cdb None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:25.018629 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3932fd-a3e0-4eab-876c-34a59d223cdb None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:25.018905 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3932fd-a3e0-4eab-876c-34a59d223cdb None admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:25.019739 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3932fd-a3e0-4eab-876c-34a59d223cdb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:25.020061 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3932fd-a3e0-4eab-876c-34a59d223cdb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:25.021611 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3932fd-a3e0-4eab-876c-34a59d223cdb None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:25.025564 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67676de1-c3de-4726-9374-d0f6fa560129 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:25.034557 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 325/645] 10.222.0.36 () {56 vars in 1148 bytes} [Fri Jun 24 22:26:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:25.035482 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3932fd-a3e0-4eab-876c-34a59d223cdb None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:25.053545 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:25.067600 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac2270d-bdb7-48e4-9e73-8978e04b8d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:25.068554 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac2270d-bdb7-48e4-9e73-8978e04b8d5b None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:25.068843 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac2270d-bdb7-48e4-9e73-8978e04b8d5b None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:25.069121 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac2270d-bdb7-48e4-9e73-8978e04b8d5b None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:25.069931 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac2270d-bdb7-48e4-9e73-8978e04b8d5b None admin] RBAC: Adding query filter params (name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:25.070398 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac2270d-bdb7-48e4-9e73-8978e04b8d5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:25.072663 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac2270d-bdb7-48e4-9e73-8978e04b8d5b None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:25.082227 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 321/646] 10.222.0.36 () {56 vars in 1103 bytes} [Fri Jun 24 22:26:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:25.083331 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac2270d-bdb7-48e4-9e73-8978e04b8d5b None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:25.096670 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:25.144092 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3932fd-a3e0-4eab-876c-34a59d223cdb None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:25.179765 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51946109-84d9-4859-96f7-4c6e074b4747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:25.180595 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51946109-84d9-4859-96f7-4c6e074b4747 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:25.180925 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51946109-84d9-4859-96f7-4c6e074b4747 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:25.181190 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51946109-84d9-4859-96f7-4c6e074b4747 None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:25.182009 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51946109-84d9-4859-96f7-4c6e074b4747 None admin] RBAC: Adding query filter params (name=service) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:25.182319 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51946109-84d9-4859-96f7-4c6e074b4747 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:25.183735 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51946109-84d9-4859-96f7-4c6e074b4747 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:25.184558 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac2270d-bdb7-48e4-9e73-8978e04b8d5b None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:25.197172 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 326/647] 10.222.0.36 () {56 vars in 1103 bytes} [Fri Jun 24 22:26:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:25.197172 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51946109-84d9-4859-96f7-4c6e074b4747 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:25.220449 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baac533f-511b-45c1-bf03-b9b4fbf853c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:25.221259 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baac533f-511b-45c1-bf03-b9b4fbf853c8 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:25.221534 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baac533f-511b-45c1-bf03-b9b4fbf853c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:25.221814 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baac533f-511b-45c1-bf03-b9b4fbf853c8 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:25.229806 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baac533f-511b-45c1-bf03-b9b4fbf853c8 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:25.231294 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baac533f-511b-45c1-bf03-b9b4fbf853c8 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:25.245172 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-baac533f-511b-45c1-bf03-b9b4fbf853c8 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 24 22:26:25.245172 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:25.245172 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:25.245172 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:25.245172 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:25.245172 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:25.245172 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:25.245172 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:25.245172 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:25.245172 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:25.245172 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:25.245172 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:25.245172 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 22:26:25.245172 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 22:26:25.245172 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 22:26:25.245172 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 22:26:25.246122 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:25.246122 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:25.246122 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 22:26:25.246122 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 22:26:25.246122 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 22:26:25.246122 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 22:26:25.246122 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:25.246122 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:25.246122 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:25.246122 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:25.246122 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:25.246122 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:25.246122 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:25.246122 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:25.246122 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:25.246122 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:25.246122 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:25.246122 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:25.247057 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:25.247057 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:25.247057 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 22:26:25.247057 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 22:26:25.247057 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 22:26:25.247057 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 22:26:25.247057 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 22:26:25.247057 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 22:26:25.247057 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 24 22:26:25.247057 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:26:25.247057 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 322/648] 10.222.0.36 () {56 vars in 1099 bytes} [Fri Jun 24 22:26:25 2022] GET /identity/v3/users/cinder => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:25.247837 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baac533f-511b-45c1-bf03-b9b4fbf853c8 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:25.303027 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:25.304395 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51946109-84d9-4859-96f7-4c6e074b4747 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:25.326761 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:25.343642 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1471011e-95bc-4fad-a097-962c785b00d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:25.344325 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1471011e-95bc-4fad-a097-962c785b00d8 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:25.344613 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1471011e-95bc-4fad-a097-962c785b00d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:25.345277 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1471011e-95bc-4fad-a097-962c785b00d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:25.346144 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1471011e-95bc-4fad-a097-962c785b00d8 None admin] RBAC: Adding query filter params (role.id=3265c7c44fb144a0a56467ded2a39413, scope.project.id=d189b31bbec0469381292d2cde3cb420, user.id=214d9071042c4bad886bf060a079b6e2) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:25.346487 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1471011e-95bc-4fad-a097-962c785b00d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:25.347997 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1471011e-95bc-4fad-a097-962c785b00d8 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:25.354698 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 327/649] 10.222.0.36 () {56 vars in 1374 bytes} [Fri Jun 24 22:26:25 2022] GET /identity/v3/role_assignments?user.id=214d9071042c4bad886bf060a079b6e2&scope.project.id=d189b31bbec0469381292d2cde3cb420&role.id=3265c7c44fb144a0a56467ded2a39413 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:25.355538 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1471011e-95bc-4fad-a097-962c785b00d8 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:25.371177 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baac533f-511b-45c1-bf03-b9b4fbf853c8 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:25.419347 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476d5418-e074-426d-a7dd-2a74040ccff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:25.419757 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476d5418-e074-426d-a7dd-2a74040ccff1 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:25.420041 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476d5418-e074-426d-a7dd-2a74040ccff1 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:25.420317 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476d5418-e074-426d-a7dd-2a74040ccff1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:25.433714 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476d5418-e074-426d-a7dd-2a74040ccff1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:25.435071 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476d5418-e074-426d-a7dd-2a74040ccff1 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:25.453850 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-476d5418-e074-426d-a7dd-2a74040ccff1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:25.453850 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:25.453850 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:25.453850 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:25.453850 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:25.453850 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:25.453850 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:25.453850 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:25.453850 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:25.453850 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:25.453850 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:25.453850 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:25.453850 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 22:26:25.453850 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 22:26:25.453850 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 22:26:25.454693 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 22:26:25.454693 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:25.454693 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:25.454693 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:25.454693 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:25.454693 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:25.454693 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:25.454693 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:25.454693 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:25.454693 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:25.454693 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:25.454693 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:25.454693 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:25.454693 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:25.454693 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:25.454693 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:25.454693 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:25.455601 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 22:26:25.455601 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 22:26:25.455601 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:25.455601 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:26:25.459729 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 323/650] 10.222.0.36 () {56 vars in 1108 bytes} [Fri Jun 24 22:26:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:25.461149 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476d5418-e074-426d-a7dd-2a74040ccff1 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:25.492167 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1471011e-95bc-4fad-a097-962c785b00d8 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:25.531179 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159e6d45-cdd5-41cf-9e64-e5b3c9d2f0fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:25.532791 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e6d45-cdd5-41cf-9e64-e5b3c9d2f0fc None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:25.533074 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e6d45-cdd5-41cf-9e64-e5b3c9d2f0fc None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:25.533348 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e6d45-cdd5-41cf-9e64-e5b3c9d2f0fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:25.545894 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159e6d45-cdd5-41cf-9e64-e5b3c9d2f0fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:25.547411 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159e6d45-cdd5-41cf-9e64-e5b3c9d2f0fc None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:25.566538 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-159e6d45-cdd5-41cf-9e64-e5b3c9d2f0fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:25.566538 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:25.566538 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:25.566538 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:25.566538 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:25.566538 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:25.566538 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:25.566538 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:25.566538 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:25.566538 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:25.566538 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:25.566538 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:25.566538 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 22:26:25.566538 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 22:26:25.566538 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 22:26:25.567499 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 22:26:25.567499 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:25.567499 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:25.567499 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:25.567499 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:25.567499 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:25.567499 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:25.567499 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:25.567499 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:25.567499 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:25.567499 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:25.567499 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:25.567499 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:25.567499 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:25.567499 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:25.567499 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:25.567499 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:25.568380 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 22:26:25.568380 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 22:26:25.568380 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:25.568380 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:26:25.568380 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 328/651] 10.222.0.36 () {56 vars in 1108 bytes} [Fri Jun 24 22:26:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:25.568919 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159e6d45-cdd5-41cf-9e64-e5b3c9d2f0fc None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:25.597405 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476d5418-e074-426d-a7dd-2a74040ccff1 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:25.599975 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:25.613513 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:25.644904 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89627ddd-27a1-4e08-8b55-1dc7de1087ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:25.645740 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89627ddd-27a1-4e08-8b55-1dc7de1087ff None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:25.646350 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89627ddd-27a1-4e08-8b55-1dc7de1087ff None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:25.646635 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89627ddd-27a1-4e08-8b55-1dc7de1087ff None admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:25.647673 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89627ddd-27a1-4e08-8b55-1dc7de1087ff None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:25.647979 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89627ddd-27a1-4e08-8b55-1dc7de1087ff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:25.649478 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89627ddd-27a1-4e08-8b55-1dc7de1087ff None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:25.671415 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 324/652] 10.222.0.36 () {56 vars in 1137 bytes} [Fri Jun 24 22:26:25 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:25.675237 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89627ddd-27a1-4e08-8b55-1dc7de1087ff None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:25.703143 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159e6d45-cdd5-41cf-9e64-e5b3c9d2f0fc None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:25.753105 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a36cfc5-58cf-4df6-ad13-7b82cceb8097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:25.754137 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a36cfc5-58cf-4df6-ad13-7b82cceb8097 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:25.754607 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a36cfc5-58cf-4df6-ad13-7b82cceb8097 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:25.755072 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a36cfc5-58cf-4df6-ad13-7b82cceb8097 None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:25.756384 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a36cfc5-58cf-4df6-ad13-7b82cceb8097 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:25.756871 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a36cfc5-58cf-4df6-ad13-7b82cceb8097 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:25.759026 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a36cfc5-58cf-4df6-ad13-7b82cceb8097 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:25.776856 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 329/653] 10.222.0.36 () {56 vars in 1109 bytes} [Fri Jun 24 22:26:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:25.778009 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a36cfc5-58cf-4df6-ad13-7b82cceb8097 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:25.789576 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89627ddd-27a1-4e08-8b55-1dc7de1087ff None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:25.832417 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c21b3f4-1a36-4423-8d52-0bdb8971a7a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:25.833114 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c21b3f4-1a36-4423-8d52-0bdb8971a7a8 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:25.833463 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c21b3f4-1a36-4423-8d52-0bdb8971a7a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:25.833806 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c21b3f4-1a36-4423-8d52-0bdb8971a7a8 None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:25.834603 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c21b3f4-1a36-4423-8d52-0bdb8971a7a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:25.834978 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c21b3f4-1a36-4423-8d52-0bdb8971a7a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:25.836471 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c21b3f4-1a36-4423-8d52-0bdb8971a7a8 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:25.849359 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 325/654] 10.222.0.36 () {56 vars in 1109 bytes} [Fri Jun 24 22:26:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:25.850368 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c21b3f4-1a36-4423-8d52-0bdb8971a7a8 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:25.874418 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:25.912282 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:25.919289 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a36cfc5-58cf-4df6-ad13-7b82cceb8097 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:25.954633 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e99075-2ad6-4f8f-b434-17d01b30879e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:25.955430 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e99075-2ad6-4f8f-b434-17d01b30879e None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:25.955810 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e99075-2ad6-4f8f-b434-17d01b30879e None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:25.956183 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e99075-2ad6-4f8f-b434-17d01b30879e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:25.976968 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c21b3f4-1a36-4423-8d52-0bdb8971a7a8 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:26.015074 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ac8967-21f8-4b20-b329-df88c02dcf66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:26.016211 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac8967-21f8-4b20-b329-df88c02dcf66 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:26.016681 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac8967-21f8-4b20-b329-df88c02dcf66 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:26.016963 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac8967-21f8-4b20-b329-df88c02dcf66 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:26.026580 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ac8967-21f8-4b20-b329-df88c02dcf66 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:26.028089 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ac8967-21f8-4b20-b329-df88c02dcf66 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:26.033588 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e99075-2ad6-4f8f-b434-17d01b30879e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:26.035761 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e99075-2ad6-4f8f-b434-17d01b30879e None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:26.047912 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-a6ac8967-21f8-4b20-b329-df88c02dcf66 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 24 22:26:26.047912 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:26.047912 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:26.047912 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:26.047912 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:26.047912 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:26.047912 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:26.047912 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:26.047912 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:26.047912 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:26.047912 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:26.047912 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:26.047912 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 22:26:26.047912 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 22:26:26.047912 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 22:26:26.047912 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 22:26:26.048900 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:26.048900 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:26.048900 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 22:26:26.048900 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 22:26:26.048900 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 22:26:26.048900 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 22:26:26.048900 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:26.048900 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:26.048900 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:26.048900 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:26.048900 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:26.048900 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:26.048900 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:26.048900 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:26.048900 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:26.048900 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:26.048900 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:26.048900 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:26.049858 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:26.049858 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:26.049858 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 22:26:26.049858 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 22:26:26.049858 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 22:26:26.049858 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 22:26:26.049858 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 22:26:26.049858 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 22:26:26.049858 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 24 22:26:26.049858 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:26:26.049858 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 326/655] 10.222.0.36 () {56 vars in 1099 bytes} [Fri Jun 24 22:26:25 2022] GET /identity/v3/users/glance => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:26.049858 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ac8967-21f8-4b20-b329-df88c02dcf66 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:26.136805 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:26.154020 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:26.154020 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 330/656] 10.222.0.36 () {58 vars in 1282 bytes} [Fri Jun 24 22:26:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 22:26:26.154020 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e99075-2ad6-4f8f-b434-17d01b30879e None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:26.167168 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ac8967-21f8-4b20-b329-df88c02dcf66 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:26.202378 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d85502-4598-42ce-bfa0-4e4e16f9d476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:26.204107 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d85502-4598-42ce-bfa0-4e4e16f9d476 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:26.204549 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d85502-4598-42ce-bfa0-4e4e16f9d476 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:26.204989 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d85502-4598-42ce-bfa0-4e4e16f9d476 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:26.215571 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d85502-4598-42ce-bfa0-4e4e16f9d476 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:26.217852 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d85502-4598-42ce-bfa0-4e4e16f9d476 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:26.236279 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-17d85502-4598-42ce-bfa0-4e4e16f9d476 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 24 22:26:26.236279 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:26.236279 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:26.236279 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:26.236279 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:26.236279 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:26.236279 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:26.236279 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:26.236279 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:26.236279 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:26.236279 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:26.236279 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:26.236279 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 22:26:26.236279 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 22:26:26.236279 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 22:26:26.236279 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 22:26:26.237473 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:26.237473 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:26.237473 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 22:26:26.237473 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 22:26:26.237473 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 22:26:26.237473 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 22:26:26.237473 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:26.237473 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:26.237473 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:26.237473 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:26.237473 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:26.237473 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:26.237473 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:26.237473 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:26.237473 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:26.237473 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:26.237473 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:26.237473 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:26.238634 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:26.238634 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:26.238634 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 22:26:26.238634 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 22:26:26.238634 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 22:26:26.238634 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 22:26:26.238634 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 22:26:26.238634 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 22:26:26.238634 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 24 22:26:26.238634 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:26:26.245586 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 327/657] 10.222.0.36 () {56 vars in 1102 bytes} [Fri Jun 24 22:26:26 2022] GET /identity/v3/users/neutron => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:26.245586 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d85502-4598-42ce-bfa0-4e4e16f9d476 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:26.277042 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e99075-2ad6-4f8f-b434-17d01b30879e None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:26.315454 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6d1c87-7419-4f5f-b2af-f755d12e3103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:26.316386 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6d1c87-7419-4f5f-b2af-f755d12e3103 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:26.316935 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6d1c87-7419-4f5f-b2af-f755d12e3103 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:26.317357 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6d1c87-7419-4f5f-b2af-f755d12e3103 None admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:26.318446 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6d1c87-7419-4f5f-b2af-f755d12e3103 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:26.318909 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6d1c87-7419-4f5f-b2af-f755d12e3103 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:26.320545 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6d1c87-7419-4f5f-b2af-f755d12e3103 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:26.340347 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 331/658] 10.222.0.36 () {56 vars in 1137 bytes} [Fri Jun 24 22:26:26 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:26.341399 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6d1c87-7419-4f5f-b2af-f755d12e3103 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:26.348138 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d85502-4598-42ce-bfa0-4e4e16f9d476 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:26.382688 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72731bf8-6027-4298-aaf6-1d7b624fff29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:26.383555 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72731bf8-6027-4298-aaf6-1d7b624fff29 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:26.383843 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72731bf8-6027-4298-aaf6-1d7b624fff29 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:26.384120 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72731bf8-6027-4298-aaf6-1d7b624fff29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:26.393305 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:26.395619 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72731bf8-6027-4298-aaf6-1d7b624fff29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:26.397086 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72731bf8-6027-4298-aaf6-1d7b624fff29 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:26.404093 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:26.415293 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-72731bf8-6027-4298-aaf6-1d7b624fff29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:26.415293 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:26.415293 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:26.415293 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:26.415293 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:26.415293 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:26.415293 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:26.415293 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:26.415293 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:26.415293 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:26.415293 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:26.415293 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:26.415293 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 22:26:26.415293 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 22:26:26.415293 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 22:26:26.416349 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 22:26:26.416349 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:26.416349 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:26.416349 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:26.416349 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:26.416349 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:26.416349 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:26.416349 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:26.416349 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:26.416349 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:26.416349 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:26.416349 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:26.416349 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:26.416349 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:26.416349 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:26.416349 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:26.416349 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:26.417362 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 22:26:26.417362 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 22:26:26.417362 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:26.417362 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:26:26.421077 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 328/659] 10.222.0.36 () {56 vars in 1108 bytes} [Fri Jun 24 22:26:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:26.421938 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72731bf8-6027-4298-aaf6-1d7b624fff29 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:26.458619 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6d1c87-7419-4f5f-b2af-f755d12e3103 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:26.496265 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3ac534-4ef5-45d5-a67c-fb1abb62c3e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:26.497282 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3ac534-4ef5-45d5-a67c-fb1abb62c3e9 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:26.497711 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3ac534-4ef5-45d5-a67c-fb1abb62c3e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:26.498162 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3ac534-4ef5-45d5-a67c-fb1abb62c3e9 None admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:26.499162 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3ac534-4ef5-45d5-a67c-fb1abb62c3e9 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:26.499659 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3ac534-4ef5-45d5-a67c-fb1abb62c3e9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:26.501439 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3ac534-4ef5-45d5-a67c-fb1abb62c3e9 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:26.526173 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 332/660] 10.222.0.36 () {56 vars in 1139 bytes} [Fri Jun 24 22:26:26 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:26.527436 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3ac534-4ef5-45d5-a67c-fb1abb62c3e9 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:26.528310 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72731bf8-6027-4298-aaf6-1d7b624fff29 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:26.566716 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a2870a-8975-421d-aacc-6e09ccb19ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:26.567409 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a2870a-8975-421d-aacc-6e09ccb19ca4 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:26.567741 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a2870a-8975-421d-aacc-6e09ccb19ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:26.568021 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a2870a-8975-421d-aacc-6e09ccb19ca4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:26.636708 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3ac534-4ef5-45d5-a67c-fb1abb62c3e9 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:26.643967 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:26.656392 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a2870a-8975-421d-aacc-6e09ccb19ca4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:26.658122 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a2870a-8975-421d-aacc-6e09ccb19ca4 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:26.663621 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:26.681873 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a02dea-2367-4d1e-ba06-4b20d84a9732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:26.682859 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a02dea-2367-4d1e-ba06-4b20d84a9732 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:26.683854 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a02dea-2367-4d1e-ba06-4b20d84a9732 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:26.684275 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a02dea-2367-4d1e-ba06-4b20d84a9732 None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:26.685442 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a02dea-2367-4d1e-ba06-4b20d84a9732 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:26.685916 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a02dea-2367-4d1e-ba06-4b20d84a9732 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:26.688022 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a02dea-2367-4d1e-ba06-4b20d84a9732 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:26.707874 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 333/661] 10.222.0.36 () {56 vars in 1109 bytes} [Fri Jun 24 22:26:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:26.709657 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a02dea-2367-4d1e-ba06-4b20d84a9732 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:26.776895 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 329/662] 10.222.0.36 () {58 vars in 1282 bytes} [Fri Jun 24 22:26:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 22:26:26.778170 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a2870a-8975-421d-aacc-6e09ccb19ca4 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:26.815204 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a02dea-2367-4d1e-ba06-4b20d84a9732 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:26.850451 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12068cd3-b9d7-4ded-95a6-4c340f124488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:26.851386 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12068cd3-b9d7-4ded-95a6-4c340f124488 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:26.851811 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12068cd3-b9d7-4ded-95a6-4c340f124488 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:26.852363 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12068cd3-b9d7-4ded-95a6-4c340f124488 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:26.871330 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:26.881294 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a2870a-8975-421d-aacc-6e09ccb19ca4 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:26.903708 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:26.916625 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31de4fce-c193-445e-bd4b-3f4189c56d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:26.917549 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31de4fce-c193-445e-bd4b-3f4189c56d96 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:26.917928 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31de4fce-c193-445e-bd4b-3f4189c56d96 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:26.918292 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31de4fce-c193-445e-bd4b-3f4189c56d96 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:26.925701 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31de4fce-c193-445e-bd4b-3f4189c56d96 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:26.931732 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31de4fce-c193-445e-bd4b-3f4189c56d96 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:26.931894 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12068cd3-b9d7-4ded-95a6-4c340f124488 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:26.933008 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12068cd3-b9d7-4ded-95a6-4c340f124488 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:26.947762 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-31de4fce-c193-445e-bd4b-3f4189c56d96 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 22:26:26.947762 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:26.947762 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:26.947762 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:26.947762 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:26.947762 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:26.947762 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:26.947762 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:26.947762 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:26.947762 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:26.947762 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:26.947762 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:26.947762 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 22:26:26.947762 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 22:26:26.947762 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 22:26:26.948678 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 22:26:26.948678 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:26.948678 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:26.948678 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:26.948678 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:26.948678 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:26.948678 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:26.948678 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:26.948678 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:26.948678 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:26.948678 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:26.948678 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:26.948678 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:26.948678 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:26.948678 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:26.948678 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:26.948678 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:26.949532 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 22:26:26.949532 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 22:26:26.949532 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 22:26:26.949532 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 22:26:26.949532 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 22:26:26.949532 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 22:26:26.949532 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 22:26:26.949532 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:26:26.949532 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 330/663] 10.222.0.36 () {56 vars in 1111 bytes} [Fri Jun 24 22:26:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:26.949993 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31de4fce-c193-445e-bd4b-3f4189c56d96 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:27.044221 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 334/664] 10.222.0.36 () {58 vars in 1282 bytes} [Fri Jun 24 22:26:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 22:26:27.045574 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67244bff-52a6-49a5-8c10-8db159e4aac0 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:27.045867 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67244bff-52a6-49a5-8c10-8db159e4aac0 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:27.046146 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67244bff-52a6-49a5-8c10-8db159e4aac0 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:27.051447 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 335/665] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:26:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:26:27.051447 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67244bff-52a6-49a5-8c10-8db159e4aac0 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:27.064300 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31de4fce-c193-445e-bd4b-3f4189c56d96 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:27.099373 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be56229-8e9f-47e0-8e61-f33a2f6ac48f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:27.100166 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be56229-8e9f-47e0-8e61-f33a2f6ac48f None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:27.100448 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be56229-8e9f-47e0-8e61-f33a2f6ac48f None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:27.100721 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be56229-8e9f-47e0-8e61-f33a2f6ac48f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:27.111691 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be56229-8e9f-47e0-8e61-f33a2f6ac48f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:27.113310 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be56229-8e9f-47e0-8e61-f33a2f6ac48f None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:27.123701 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:27.131934 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-2be56229-8e9f-47e0-8e61-f33a2f6ac48f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:27.131934 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:27.131934 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:27.131934 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:27.131934 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:27.131934 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:27.131934 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:27.131934 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:27.131934 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:27.131934 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:27.131934 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:27.131934 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:27.131934 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 22:26:27.131934 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 22:26:27.131934 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 22:26:27.132818 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 22:26:27.132818 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:27.132818 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:27.132818 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:27.132818 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:27.132818 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:27.132818 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:27.132818 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:27.132818 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:27.132818 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:27.132818 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:27.132818 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:27.132818 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:27.132818 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:27.132818 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:27.132818 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:27.132818 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:27.133774 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 22:26:27.133774 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 22:26:27.133774 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:27.133774 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:26:27.133774 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 331/666] 10.222.0.36 () {56 vars in 1108 bytes} [Fri Jun 24 22:26:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:27.134921 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be56229-8e9f-47e0-8e61-f33a2f6ac48f None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:27.138898 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:27.162638 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67244bff-52a6-49a5-8c10-8db159e4aac0 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:27.196749 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1064b41-039e-4c54-b9e1-506fffb5100f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:27.197417 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1064b41-039e-4c54-b9e1-506fffb5100f None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:27.197696 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1064b41-039e-4c54-b9e1-506fffb5100f None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:27.197959 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1064b41-039e-4c54-b9e1-506fffb5100f None admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:27.198738 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1064b41-039e-4c54-b9e1-506fffb5100f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:27.199042 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1064b41-039e-4c54-b9e1-506fffb5100f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:27.200524 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1064b41-039e-4c54-b9e1-506fffb5100f None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:27.212940 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 336/667] 10.222.0.36 () {56 vars in 1148 bytes} [Fri Jun 24 22:26:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:27.214457 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dfb0f7-03ee-4356-8755-854817f639c3 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:27.214927 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dfb0f7-03ee-4356-8755-854817f639c3 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:27.215204 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dfb0f7-03ee-4356-8755-854817f639c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:27.233986 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-b9dfb0f7-03ee-4356-8755-854817f639c3 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:26:27.235168 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-b9dfb0f7-03ee-4356-8755-854817f639c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:26:27.244331 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be56229-8e9f-47e0-8e61-f33a2f6ac48f None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:27.278909 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922dbcb1-0b16-4f1d-8340-17bcab1f41ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:27.279949 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922dbcb1-0b16-4f1d-8340-17bcab1f41ed None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:27.280080 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922dbcb1-0b16-4f1d-8340-17bcab1f41ed None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:27.280272 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922dbcb1-0b16-4f1d-8340-17bcab1f41ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:27.291726 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922dbcb1-0b16-4f1d-8340-17bcab1f41ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:27.293189 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922dbcb1-0b16-4f1d-8340-17bcab1f41ed None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:27.313492 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 337/668] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:26:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 22:26:27.313492 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dfb0f7-03ee-4356-8755-854817f639c3 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:27.313761 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-922dbcb1-0b16-4f1d-8340-17bcab1f41ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:27.313761 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:27.313761 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:27.313761 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:27.313761 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:27.313761 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:27.313761 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:27.313761 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:27.313761 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:27.313761 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:27.313761 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:27.313761 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:27.313761 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 22:26:27.313761 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 22:26:27.313761 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 22:26:27.314559 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 22:26:27.314559 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:27.314559 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:27.314559 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:27.314559 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:27.314559 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:27.314559 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:27.314559 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:27.314559 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:27.314559 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:27.314559 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:27.314559 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:27.314559 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:27.314559 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:27.314559 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:27.314559 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:27.314559 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:27.317368 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 22:26:27.317368 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 22:26:27.317368 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:27.317368 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:26:27.317368 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 332/669] 10.222.0.36 () {56 vars in 1108 bytes} [Fri Jun 24 22:26:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:27.317368 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922dbcb1-0b16-4f1d-8340-17bcab1f41ed None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:27.377075 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:27.385755 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:27.424006 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922dbcb1-0b16-4f1d-8340-17bcab1f41ed None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:27.434602 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dfb0f7-03ee-4356-8755-854817f639c3 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:27.468834 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0f9eec-d664-44b5-b175-d6ceeada61b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:27.469497 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0f9eec-d664-44b5-b175-d6ceeada61b3 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:27.469844 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0f9eec-d664-44b5-b175-d6ceeada61b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:27.470053 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0f9eec-d664-44b5-b175-d6ceeada61b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:27.470880 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0f9eec-d664-44b5-b175-d6ceeada61b3 None admin] RBAC: Adding query filter params (role.id=3265c7c44fb144a0a56467ded2a39413, scope.project.id=d189b31bbec0469381292d2cde3cb420, user.id=e4a747e2a5684843a6ee9e3480badac7) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:27.471198 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0f9eec-d664-44b5-b175-d6ceeada61b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:27.472688 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0f9eec-d664-44b5-b175-d6ceeada61b3 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:27.473284 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb11683-acc9-4c7a-8430-217e37dfb8af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:27.473955 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb11683-acc9-4c7a-8430-217e37dfb8af None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:27.474244 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb11683-acc9-4c7a-8430-217e37dfb8af None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:27.474532 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb11683-acc9-4c7a-8430-217e37dfb8af None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:27.475231 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb11683-acc9-4c7a-8430-217e37dfb8af None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:27.475843 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb11683-acc9-4c7a-8430-217e37dfb8af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:27.476949 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb11683-acc9-4c7a-8430-217e37dfb8af None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:27.479646 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 333/670] 10.222.0.36 () {56 vars in 1374 bytes} [Fri Jun 24 22:26:27 2022] GET /identity/v3/role_assignments?user.id=e4a747e2a5684843a6ee9e3480badac7&scope.project.id=d189b31bbec0469381292d2cde3cb420&role.id=3265c7c44fb144a0a56467ded2a39413 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:27.488356 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0f9eec-d664-44b5-b175-d6ceeada61b3 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:27.489418 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 338/671] 10.222.0.36 () {56 vars in 1109 bytes} [Fri Jun 24 22:26:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:27.490279 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb11683-acc9-4c7a-8430-217e37dfb8af None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:27.607721 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0f9eec-d664-44b5-b175-d6ceeada61b3 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:27.630154 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:27.634156 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb11683-acc9-4c7a-8430-217e37dfb8af None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:27.648680 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9123208-43c8-4a54-8d9b-1d4df20a9b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:27.649005 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9123208-43c8-4a54-8d9b-1d4df20a9b41 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:27.649379 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9123208-43c8-4a54-8d9b-1d4df20a9b41 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:27.650403 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9123208-43c8-4a54-8d9b-1d4df20a9b41 None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:27.651132 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9123208-43c8-4a54-8d9b-1d4df20a9b41 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:27.651479 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9123208-43c8-4a54-8d9b-1d4df20a9b41 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:27.652884 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9123208-43c8-4a54-8d9b-1d4df20a9b41 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:27.662228 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:27.669622 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 334/672] 10.222.0.36 () {56 vars in 1109 bytes} [Fri Jun 24 22:26:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:27.670485 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9123208-43c8-4a54-8d9b-1d4df20a9b41 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:27.681814 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8261606-c880-4407-a5aa-39836feefe26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:27.682913 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8261606-c880-4407-a5aa-39836feefe26 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:27.683404 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8261606-c880-4407-a5aa-39836feefe26 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:27.683780 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8261606-c880-4407-a5aa-39836feefe26 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:27.695089 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8261606-c880-4407-a5aa-39836feefe26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 22:26:27.704247 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-c8261606-c880-4407-a5aa-39836feefe26 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 22:26:27.704247 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:27.704247 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:27.704247 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:27.704247 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:27.704247 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:27.704247 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:27.704247 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:27.704247 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:27.704247 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:27.704247 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:27.704247 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:27.704247 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 22:26:27.704247 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 22:26:27.704247 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 22:26:27.704247 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 22:26:27.705225 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 22:26:27.705225 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 22:26:27.705225 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 22:26:27.705225 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 22:26:27.705225 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:27.705225 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:27.705225 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:27.705225 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:27.705225 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:27.705225 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:27.705225 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:27.705225 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:27.705225 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:27.705225 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:27.705225 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:27.705225 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:27.706317 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:27.706317 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:27.706317 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:27.706317 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:27.706317 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 22:26:27.706317 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 22:26:27.706317 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 22:26:27.706317 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 22:26:27.706317 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 22:26:27.706317 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 22:26:27.706317 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 22:26:27.706317 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:26:27.706317 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 339/673] 10.222.0.36 () {56 vars in 1102 bytes} [Fri Jun 24 22:26:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:27.707134 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09866a73-6be9-4365-86b1-dd3b2eee2842 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:27.707134 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09866a73-6be9-4365-86b1-dd3b2eee2842 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:27.707568 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09866a73-6be9-4365-86b1-dd3b2eee2842 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:27.708644 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 340/674] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:26:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:26:27.709588 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09866a73-6be9-4365-86b1-dd3b2eee2842 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:27.780632 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9123208-43c8-4a54-8d9b-1d4df20a9b41 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:27.815910 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355f962f-5a7d-4a80-9dd0-84062d828c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:27.816706 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355f962f-5a7d-4a80-9dd0-84062d828c6a None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:27.816985 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355f962f-5a7d-4a80-9dd0-84062d828c6a None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:27.817296 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355f962f-5a7d-4a80-9dd0-84062d828c6a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:27.818396 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09866a73-6be9-4365-86b1-dd3b2eee2842 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:27.825266 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355f962f-5a7d-4a80-9dd0-84062d828c6a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:27.827186 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355f962f-5a7d-4a80-9dd0-84062d828c6a None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:27.841917 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-355f962f-5a7d-4a80-9dd0-84062d828c6a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 22:26:27.841917 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:27.841917 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:27.841917 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:27.841917 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:27.841917 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:27.841917 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:27.841917 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:27.841917 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:27.841917 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:27.841917 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:27.841917 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:27.841917 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 22:26:27.841917 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 22:26:27.841917 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 22:26:27.842826 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 22:26:27.842826 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:27.842826 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:27.842826 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:27.842826 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:27.842826 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:27.842826 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:27.842826 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:27.842826 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:27.842826 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:27.842826 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:27.842826 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:27.842826 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:27.842826 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:27.842826 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:27.842826 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:27.842826 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:27.843748 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 22:26:27.843748 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 22:26:27.843748 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 22:26:27.843748 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 22:26:27.843748 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 22:26:27.843748 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 22:26:27.843748 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 22:26:27.843748 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:26:27.843748 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 335/675] 10.222.0.36 () {56 vars in 1111 bytes} [Fri Jun 24 22:26:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:27.844251 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355f962f-5a7d-4a80-9dd0-84062d828c6a None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:27.859736 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1da3686-118a-4df0-b488-856053b60a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:27.860674 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1da3686-118a-4df0-b488-856053b60a2a None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:27.861039 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1da3686-118a-4df0-b488-856053b60a2a None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:27.861313 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1da3686-118a-4df0-b488-856053b60a2a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:27.874099 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1da3686-118a-4df0-b488-856053b60a2a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:27.875682 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1da3686-118a-4df0-b488-856053b60a2a None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:27.891053 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-e1da3686-118a-4df0-b488-856053b60a2a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 22:26:27.891053 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:27.891053 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:27.891053 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:27.891053 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:27.891053 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:27.891053 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:27.891053 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:27.891053 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:27.891053 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:27.891053 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:27.891053 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:27.891053 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 22:26:27.891053 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 22:26:27.891053 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 22:26:27.892125 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 22:26:27.892125 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:27.892125 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:27.892125 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:27.892125 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:27.892125 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:27.892125 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:27.892125 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:27.892125 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:27.892125 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:27.892125 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:27.892125 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:27.892125 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:27.892125 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:27.892125 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:27.892125 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:27.892125 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:27.893135 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 22:26:27.893135 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 22:26:27.893135 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 22:26:27.893135 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 22:26:27.893135 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 22:26:27.893135 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 22:26:27.893135 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 22:26:27.893135 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:26:27.897040 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 341/676] 10.222.0.36 () {56 vars in 1111 bytes} [Fri Jun 24 22:26:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:27.897854 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:27.898183 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5444e69-0432-4265-a957-c717c026a6db None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:27.898495 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5444e69-0432-4265-a957-c717c026a6db None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:27.898721 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5444e69-0432-4265-a957-c717c026a6db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:27.915865 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-f5444e69-0432-4265-a957-c717c026a6db None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:26:27.917045 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-f5444e69-0432-4265-a957-c717c026a6db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:26:27.953935 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:27.962945 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355f962f-5a7d-4a80-9dd0-84062d828c6a None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:27.988744 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 342/677] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:26:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 22:26:27.989591 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5444e69-0432-4265-a957-c717c026a6db None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:28.006956 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51951d29-2d50-4495-b6ff-051c97c83e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:28.008060 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51951d29-2d50-4495-b6ff-051c97c83e83 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:28.009380 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51951d29-2d50-4495-b6ff-051c97c83e83 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:28.009904 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51951d29-2d50-4495-b6ff-051c97c83e83 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:28.010893 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51951d29-2d50-4495-b6ff-051c97c83e83 None admin] RBAC: Adding query filter params (name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:28.011476 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51951d29-2d50-4495-b6ff-051c97c83e83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:28.013183 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51951d29-2d50-4495-b6ff-051c97c83e83 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:28.022552 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 336/678] 10.222.0.36 () {56 vars in 1103 bytes} [Fri Jun 24 22:26:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:28.023687 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51951d29-2d50-4495-b6ff-051c97c83e83 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:28.097710 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5444e69-0432-4265-a957-c717c026a6db None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:28.133741 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51951d29-2d50-4495-b6ff-051c97c83e83 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:28.134873 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09d9a78-b516-47cf-ab71-7b0997ea0da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:28.135468 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:28.135936 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09d9a78-b516-47cf-ab71-7b0997ea0da4 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:28.136226 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09d9a78-b516-47cf-ab71-7b0997ea0da4 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:28.136505 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09d9a78-b516-47cf-ab71-7b0997ea0da4 None admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:28.137386 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09d9a78-b516-47cf-ab71-7b0997ea0da4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:28.137704 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09d9a78-b516-47cf-ab71-7b0997ea0da4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:28.139233 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09d9a78-b516-47cf-ab71-7b0997ea0da4 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:28.152663 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 343/679] 10.222.0.36 () {56 vars in 1148 bytes} [Fri Jun 24 22:26:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:28.153386 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09d9a78-b516-47cf-ab71-7b0997ea0da4 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:28.177203 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1e2855-5281-4b4c-8e36-0964d7d9af87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:28.177879 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1e2855-5281-4b4c-8e36-0964d7d9af87 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:28.178163 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1e2855-5281-4b4c-8e36-0964d7d9af87 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:28.178441 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1e2855-5281-4b4c-8e36-0964d7d9af87 None admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:28.179244 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1e2855-5281-4b4c-8e36-0964d7d9af87 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:28.179583 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1e2855-5281-4b4c-8e36-0964d7d9af87 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:28.181108 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1e2855-5281-4b4c-8e36-0964d7d9af87 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:28.188817 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:28.194451 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 337/680] 10.222.0.36 () {56 vars in 1148 bytes} [Fri Jun 24 22:26:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:28.195290 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1e2855-5281-4b4c-8e36-0964d7d9af87 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:28.267128 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09d9a78-b516-47cf-ab71-7b0997ea0da4 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:28.301347 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1e2855-5281-4b4c-8e36-0964d7d9af87 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:28.303445 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7451a4f4-78cc-4855-bd3a-c78d8ab67828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:28.304440 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7451a4f4-78cc-4855-bd3a-c78d8ab67828 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:28.304862 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7451a4f4-78cc-4855-bd3a-c78d8ab67828 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:28.305371 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7451a4f4-78cc-4855-bd3a-c78d8ab67828 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:28.316038 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7451a4f4-78cc-4855-bd3a-c78d8ab67828 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 22:26:28.323826 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-7451a4f4-78cc-4855-bd3a-c78d8ab67828 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 22:26:28.323826 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:28.323826 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:28.323826 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:28.323826 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:28.323826 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:28.323826 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:28.323826 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:28.323826 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:28.323826 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:28.323826 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:28.323826 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:28.323826 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 22:26:28.323826 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 22:26:28.323826 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 22:26:28.323826 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 22:26:28.324757 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 22:26:28.324757 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 22:26:28.324757 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 22:26:28.324757 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 22:26:28.324757 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:28.324757 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:28.324757 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:28.324757 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:28.324757 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:28.324757 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:28.324757 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:28.324757 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:28.324757 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:28.324757 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:28.324757 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:28.324757 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:28.325602 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:28.325602 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:28.325602 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:28.325602 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:28.325602 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 22:26:28.325602 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 22:26:28.325602 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 22:26:28.325602 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 22:26:28.325602 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 22:26:28.325602 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 22:26:28.325602 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 22:26:28.325602 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:26:28.325602 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 344/681] 10.222.0.36 () {56 vars in 1096 bytes} [Fri Jun 24 22:26:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:28.326309 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7451a4f4-78cc-4855-bd3a-c78d8ab67828 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:28.342288 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36cd629-403a-498b-b730-efb8981e5a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:28.343096 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36cd629-403a-498b-b730-efb8981e5a11 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:28.343410 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36cd629-403a-498b-b730-efb8981e5a11 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:28.343688 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36cd629-403a-498b-b730-efb8981e5a11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:28.356901 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36cd629-403a-498b-b730-efb8981e5a11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:28.358401 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36cd629-403a-498b-b730-efb8981e5a11 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:28.376351 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-f36cd629-403a-498b-b730-efb8981e5a11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:28.376351 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:28.376351 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:28.376351 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:28.376351 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:28.376351 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:28.376351 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:28.376351 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:28.376351 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:28.376351 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:28.376351 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:28.376351 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:28.376351 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 22:26:28.376351 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 22:26:28.376351 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 22:26:28.377755 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 22:26:28.377755 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:28.377755 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:28.377755 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:28.377755 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:28.377755 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:28.377755 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:28.377755 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:28.377755 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:28.377755 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:28.377755 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:28.377755 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:28.377755 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:28.377755 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:28.377755 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:28.377755 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:28.377755 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:28.378614 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 22:26:28.378614 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 22:26:28.378614 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:28.378614 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:26:28.378614 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 338/682] 10.222.0.36 () {56 vars in 1108 bytes} [Fri Jun 24 22:26:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:28.378614 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36cd629-403a-498b-b730-efb8981e5a11 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:28.397901 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:28.443874 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:28.450603 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7451a4f4-78cc-4855-bd3a-c78d8ab67828 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:28.489014 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf7bbab-ff76-4b2f-87b1-0826a6e29314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:28.489752 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf7bbab-ff76-4b2f-87b1-0826a6e29314 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:28.490089 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf7bbab-ff76-4b2f-87b1-0826a6e29314 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:28.490369 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf7bbab-ff76-4b2f-87b1-0826a6e29314 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:28.491206 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf7bbab-ff76-4b2f-87b1-0826a6e29314 None admin] RBAC: Adding query filter params (role.id=3265c7c44fb144a0a56467ded2a39413, scope.project.id=d189b31bbec0469381292d2cde3cb420, user.id=d156158fa06647569a8bb2d8d0019f28) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:28.491569 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf7bbab-ff76-4b2f-87b1-0826a6e29314 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:28.492439 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36cd629-403a-498b-b730-efb8981e5a11 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:28.493703 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf7bbab-ff76-4b2f-87b1-0826a6e29314 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:28.500405 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 345/683] 10.222.0.36 () {56 vars in 1374 bytes} [Fri Jun 24 22:26:28 2022] GET /identity/v3/role_assignments?user.id=d156158fa06647569a8bb2d8d0019f28&scope.project.id=d189b31bbec0469381292d2cde3cb420&role.id=3265c7c44fb144a0a56467ded2a39413 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:28.503477 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf7bbab-ff76-4b2f-87b1-0826a6e29314 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:28.542514 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f188fd7-3b47-4842-b760-509679669fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:28.544185 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f188fd7-3b47-4842-b760-509679669fe7 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:28.544618 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f188fd7-3b47-4842-b760-509679669fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:28.545322 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f188fd7-3b47-4842-b760-509679669fe7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:28.546577 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f188fd7-3b47-4842-b760-509679669fe7 None admin] RBAC: Adding query filter params (role.id=3265c7c44fb144a0a56467ded2a39413, scope.project.id=d189b31bbec0469381292d2cde3cb420, user.id=b78f1fcce4174d1a931453d930d306f9) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:28.547061 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f188fd7-3b47-4842-b760-509679669fe7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:28.549400 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f188fd7-3b47-4842-b760-509679669fe7 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:28.564139 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 339/684] 10.222.0.36 () {56 vars in 1374 bytes} [Fri Jun 24 22:26:28 2022] GET /identity/v3/role_assignments?user.id=b78f1fcce4174d1a931453d930d306f9&scope.project.id=d189b31bbec0469381292d2cde3cb420&role.id=3265c7c44fb144a0a56467ded2a39413 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:28.564712 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f188fd7-3b47-4842-b760-509679669fe7 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:28.694293 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf7bbab-ff76-4b2f-87b1-0826a6e29314 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:28.727003 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:28.747962 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9feeff-25b8-414e-81e1-24fe478df2ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:28.749196 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9feeff-25b8-414e-81e1-24fe478df2ee None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:28.749778 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9feeff-25b8-414e-81e1-24fe478df2ee None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:28.750074 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9feeff-25b8-414e-81e1-24fe478df2ee None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:28.751143 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9feeff-25b8-414e-81e1-24fe478df2ee None admin] RBAC: Adding query filter params (name=admin) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:28.751506 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9feeff-25b8-414e-81e1-24fe478df2ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:28.753700 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9feeff-25b8-414e-81e1-24fe478df2ee None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:28.759281 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f188fd7-3b47-4842-b760-509679669fe7 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:28.772986 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 346/685] 10.222.0.36 () {56 vars in 1099 bytes} [Fri Jun 24 22:26:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:28.779065 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9feeff-25b8-414e-81e1-24fe478df2ee None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:28.804797 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:28.813817 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33808588-992b-463f-8705-c996f09108bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:28.814504 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33808588-992b-463f-8705-c996f09108bf None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:28.814791 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33808588-992b-463f-8705-c996f09108bf None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:28.815068 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33808588-992b-463f-8705-c996f09108bf None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:28.815834 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33808588-992b-463f-8705-c996f09108bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:28.816148 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33808588-992b-463f-8705-c996f09108bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:28.817542 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33808588-992b-463f-8705-c996f09108bf None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:28.835981 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 340/686] 10.222.0.36 () {56 vars in 1109 bytes} [Fri Jun 24 22:26:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:28.841910 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33808588-992b-463f-8705-c996f09108bf None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:28.929449 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9feeff-25b8-414e-81e1-24fe478df2ee None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:28.969961 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33808588-992b-463f-8705-c996f09108bf None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:28.990749 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceec0d1-713c-4a9d-9e90-44ac986f9660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:28.996208 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceec0d1-713c-4a9d-9e90-44ac986f9660 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:28.996495 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceec0d1-713c-4a9d-9e90-44ac986f9660 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:28.996773 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceec0d1-713c-4a9d-9e90-44ac986f9660 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:29.019492 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceec0d1-713c-4a9d-9e90-44ac986f9660 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:29.020957 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceec0d1-713c-4a9d-9e90-44ac986f9660 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:29.022670 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f190fd-a979-44b1-8b99-9abf461f5d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:29.023798 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f190fd-a979-44b1-8b99-9abf461f5d16 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:29.024349 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f190fd-a979-44b1-8b99-9abf461f5d16 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:29.024816 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f190fd-a979-44b1-8b99-9abf461f5d16 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:29.033662 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f190fd-a979-44b1-8b99-9abf461f5d16 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:29.035427 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f190fd-a979-44b1-8b99-9abf461f5d16 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:29.037521 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:29.052295 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-72f190fd-a979-44b1-8b99-9abf461f5d16 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 24 22:26:29.052295 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:29.052295 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:29.052295 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:29.052295 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:29.052295 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:29.052295 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:29.052295 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:29.052295 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:29.052295 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:29.052295 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:29.052295 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:29.052295 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 22:26:29.052295 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 22:26:29.052295 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 22:26:29.052295 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 22:26:29.053263 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:29.053263 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:29.053263 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 22:26:29.053263 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 22:26:29.053263 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 22:26:29.053263 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 22:26:29.053263 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:29.053263 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:29.053263 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:29.053263 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:29.053263 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:29.053263 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:29.053263 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:29.053263 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:29.053263 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:29.053263 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:29.053263 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:29.053263 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:29.054171 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:29.054171 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:29.054171 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 22:26:29.054171 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 22:26:29.054171 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 22:26:29.054171 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 22:26:29.054171 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 22:26:29.054171 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 22:26:29.054171 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 24 22:26:29.054171 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:26:29.057414 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 341/687] 10.222.0.36 () {56 vars in 1096 bytes} [Fri Jun 24 22:26:28 2022] GET /identity/v3/users/swift => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:29.061313 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-9ceec0d1-713c-4a9d-9e90-44ac986f9660 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:29.061313 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:29.061313 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:29.061313 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:29.061313 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:29.061313 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:29.061313 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:29.061313 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:29.061313 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:29.061313 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:29.061313 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:29.061313 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:29.061313 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 22:26:29.061313 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 22:26:29.061313 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 22:26:29.062192 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 22:26:29.062192 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:29.062192 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:29.062192 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:29.062192 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:29.062192 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:29.062192 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:29.062192 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:29.062192 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:29.062192 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:29.062192 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:29.062192 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:29.062192 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:29.062192 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:29.062192 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:29.062192 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:29.062192 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:29.064412 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 22:26:29.064412 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 22:26:29.064412 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:29.064412 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:26:29.064412 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 347/688] 10.222.0.36 () {56 vars in 1108 bytes} [Fri Jun 24 22:26:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 22:26:29.065787 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f190fd-a979-44b1-8b99-9abf461f5d16 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:29.071271 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceec0d1-713c-4a9d-9e90-44ac986f9660 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:29.155707 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:29.178395 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceec0d1-713c-4a9d-9e90-44ac986f9660 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:29.221964 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f4ad1f-cf26-4667-96db-f01d3e416f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:29.222649 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f4ad1f-cf26-4667-96db-f01d3e416f50 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:29.222930 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f4ad1f-cf26-4667-96db-f01d3e416f50 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:29.223203 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f4ad1f-cf26-4667-96db-f01d3e416f50 None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:29.223963 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f4ad1f-cf26-4667-96db-f01d3e416f50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:29.224267 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f4ad1f-cf26-4667-96db-f01d3e416f50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:29.225663 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f4ad1f-cf26-4667-96db-f01d3e416f50 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:29.247053 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 348/689] 10.222.0.36 () {56 vars in 1109 bytes} [Fri Jun 24 22:26:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:29.251654 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f4ad1f-cf26-4667-96db-f01d3e416f50 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:29.274426 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f190fd-a979-44b1-8b99-9abf461f5d16 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:29.331626 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c2e1fa-e1d9-4512-a546-88e3ee940a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:29.332231 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c2e1fa-e1d9-4512-a546-88e3ee940a57 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:29.332513 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c2e1fa-e1d9-4512-a546-88e3ee940a57 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:29.332789 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c2e1fa-e1d9-4512-a546-88e3ee940a57 None admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:29.333638 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c2e1fa-e1d9-4512-a546-88e3ee940a57 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:29.333948 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c2e1fa-e1d9-4512-a546-88e3ee940a57 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:29.335435 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c2e1fa-e1d9-4512-a546-88e3ee940a57 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:29.368620 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 342/690] 10.222.0.36 () {56 vars in 1135 bytes} [Fri Jun 24 22:26:29 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:29.371437 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c2e1fa-e1d9-4512-a546-88e3ee940a57 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:29.427997 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f4ad1f-cf26-4667-96db-f01d3e416f50 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:29.474125 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:29.478334 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:29.492182 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9e1ef8-5ab1-4f83-be53-83c1f5b82eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:29.493543 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e1ef8-5ab1-4f83-be53-83c1f5b82eaa None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:29.494001 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e1ef8-5ab1-4f83-be53-83c1f5b82eaa None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:29.494444 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e1ef8-5ab1-4f83-be53-83c1f5b82eaa None admin] PATH_INFO: `/v3/users/nova` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:29.511293 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9e1ef8-5ab1-4f83-be53-83c1f5b82eaa None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:29.514071 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9e1ef8-5ab1-4f83-be53-83c1f5b82eaa None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:29.534419 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-6f9e1ef8-5ab1-4f83-be53-83c1f5b82eaa None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 24 22:26:29.534419 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:29.534419 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:29.534419 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:29.534419 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:29.534419 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:29.534419 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:29.534419 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:29.534419 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:29.534419 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:29.534419 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:29.534419 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:29.534419 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 22:26:29.534419 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 22:26:29.534419 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 22:26:29.534419 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 22:26:29.535415 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:29.535415 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:29.535415 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 22:26:29.535415 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 22:26:29.535415 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 22:26:29.535415 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 22:26:29.535415 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:29.535415 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:29.535415 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:29.535415 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:29.535415 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:29.535415 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:29.535415 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:29.535415 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:29.535415 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:29.535415 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:29.535415 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:29.535415 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:29.537138 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:29.537138 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:29.537138 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 22:26:29.537138 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 22:26:29.537138 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 22:26:29.537138 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 22:26:29.537138 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 22:26:29.537138 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 22:26:29.537138 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 24 22:26:29.537138 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:26:29.537138 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 349/691] 10.222.0.36 () {56 vars in 1093 bytes} [Fri Jun 24 22:26:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:29.537730 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c2e1fa-e1d9-4512-a546-88e3ee940a57 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:29.542235 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9e1ef8-5ab1-4f83-be53-83c1f5b82eaa None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:29.592410 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14daebd0-6d11-42c1-904b-63ea16e67e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:29.593005 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14daebd0-6d11-42c1-904b-63ea16e67e87 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:29.593291 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14daebd0-6d11-42c1-904b-63ea16e67e87 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:29.593569 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14daebd0-6d11-42c1-904b-63ea16e67e87 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:29.686427 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9e1ef8-5ab1-4f83-be53-83c1f5b82eaa None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:29.689217 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14daebd0-6d11-42c1-904b-63ea16e67e87 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:29.690724 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14daebd0-6d11-42c1-904b-63ea16e67e87 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:29.722809 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b6def8-9140-499f-ae79-491294e3f9db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:29.723517 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b6def8-9140-499f-ae79-491294e3f9db None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:29.723800 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b6def8-9140-499f-ae79-491294e3f9db None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:29.724075 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b6def8-9140-499f-ae79-491294e3f9db None admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:29.724913 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b6def8-9140-499f-ae79-491294e3f9db None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:29.725221 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b6def8-9140-499f-ae79-491294e3f9db None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:29.726912 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b6def8-9140-499f-ae79-491294e3f9db None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:29.745250 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 350/692] 10.222.0.36 () {56 vars in 1133 bytes} [Fri Jun 24 22:26:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:29.746537 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3e60f5-68d6-443a-9758-cdc0545e79c7 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:29.746831 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3e60f5-68d6-443a-9758-cdc0545e79c7 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:29.747108 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3e60f5-68d6-443a-9758-cdc0545e79c7 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:29.748393 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:29.753962 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 351/693] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:26:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:26:29.755189 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3e60f5-68d6-443a-9758-cdc0545e79c7 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:29.801443 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 343/694] 10.222.0.36 () {58 vars in 1282 bytes} [Fri Jun 24 22:26:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 22:26:29.802912 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a48f4fe-46db-4959-afa8-a4870c13daee None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:29.803299 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a48f4fe-46db-4959-afa8-a4870c13daee None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:29.803792 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a48f4fe-46db-4959-afa8-a4870c13daee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:29.804820 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:29.823011 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-5a48f4fe-46db-4959-afa8-a4870c13daee None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:26:29.824316 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-5a48f4fe-46db-4959-afa8-a4870c13daee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:26:29.862240 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3e60f5-68d6-443a-9758-cdc0545e79c7 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:29.897228 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 344/695] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:26:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 22:26:29.898192 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a48f4fe-46db-4959-afa8-a4870c13daee None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:29.921316 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aa971b-2a37-48cf-a59e-8b548bc12ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:29.921984 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aa971b-2a37-48cf-a59e-8b548bc12ddc None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:29.922272 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aa971b-2a37-48cf-a59e-8b548bc12ddc None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:29.922553 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aa971b-2a37-48cf-a59e-8b548bc12ddc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:29.995644 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:30.005079 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aa971b-2a37-48cf-a59e-8b548bc12ddc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:30.006932 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aa971b-2a37-48cf-a59e-8b548bc12ddc None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:30.012018 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a48f4fe-46db-4959-afa8-a4870c13daee None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:30.050371 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7e18ef-9797-44d9-a952-5813314652da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:30.051364 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7e18ef-9797-44d9-a952-5813314652da None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:30.051654 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7e18ef-9797-44d9-a952-5813314652da None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:30.051936 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7e18ef-9797-44d9-a952-5813314652da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:30.056317 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:30.064732 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7e18ef-9797-44d9-a952-5813314652da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:30.066401 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7e18ef-9797-44d9-a952-5813314652da None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:30.085887 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-3b7e18ef-9797-44d9-a952-5813314652da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:30.085887 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:30.085887 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:30.085887 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:30.085887 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:30.085887 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:30.085887 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:30.085887 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:30.085887 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:30.085887 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:30.085887 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:30.085887 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:30.085887 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 22:26:30.085887 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 22:26:30.085887 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 22:26:30.087008 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 22:26:30.087008 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:30.087008 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:30.087008 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:30.087008 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:30.087008 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:30.087008 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:30.087008 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:30.087008 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:30.087008 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:30.087008 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:30.087008 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:30.087008 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:30.087008 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:30.087008 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:30.087008 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:30.087008 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:30.087912 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 22:26:30.087912 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 22:26:30.087912 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:30.087912 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:26:30.091917 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 345/696] 10.222.0.36 () {56 vars in 1108 bytes} [Fri Jun 24 22:26:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:30.093131 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7e18ef-9797-44d9-a952-5813314652da None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:30.111778 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 352/697] 10.222.0.36 () {58 vars in 1282 bytes} [Fri Jun 24 22:26:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 22:26:30.112687 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aa971b-2a37-48cf-a59e-8b548bc12ddc None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:30.198699 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7e18ef-9797-44d9-a952-5813314652da None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:30.211526 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aa971b-2a37-48cf-a59e-8b548bc12ddc None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:30.235465 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29baaa54-c7e7-498c-ab46-883a9e5d0f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:30.236612 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29baaa54-c7e7-498c-ab46-883a9e5d0f9b None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:30.237125 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29baaa54-c7e7-498c-ab46-883a9e5d0f9b None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:30.237716 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29baaa54-c7e7-498c-ab46-883a9e5d0f9b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:30.238669 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29baaa54-c7e7-498c-ab46-883a9e5d0f9b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:30.240410 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29baaa54-c7e7-498c-ab46-883a9e5d0f9b None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:30.246076 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dec2a3-5ef2-4581-b9ed-16282db39aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:30.246746 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dec2a3-5ef2-4581-b9ed-16282db39aac None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:30.247027 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dec2a3-5ef2-4581-b9ed-16282db39aac None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:30.247335 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dec2a3-5ef2-4581-b9ed-16282db39aac None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:30.248056 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dec2a3-5ef2-4581-b9ed-16282db39aac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:30.248358 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dec2a3-5ef2-4581-b9ed-16282db39aac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:30.249735 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dec2a3-5ef2-4581-b9ed-16282db39aac None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:30.257532 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-29baaa54-c7e7-498c-ab46-883a9e5d0f9b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 24 22:26:30.257532 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:30.257532 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 22:26:30.257532 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 22:26:30.257532 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 22:26:30.257532 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 22:26:30.257532 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 22:26:30.257532 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 22:26:30.257532 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 24 22:26:30.257532 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:26:30.257532 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 22:26:30.257532 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:26:30.257532 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:30.257532 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:30.257532 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:30.257532 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:30.258525 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:30.258525 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:30.258525 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:30.258525 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:30.258525 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:30.258525 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:30.258525 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:30.258525 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 22:26:30.258525 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 22:26:30.258525 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 22:26:30.258525 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 22:26:30.258525 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:30.258525 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:30.258525 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:30.258525 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:30.258525 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:30.259447 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:30.259447 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:30.259447 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:30.259447 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:30.259447 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:30.259447 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:30.259447 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:30.259447 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:30.259447 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:30.259447 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:30.259447 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:30.259447 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 22:26:30.259447 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 22:26:30.259447 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 24 22:26:30.259447 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:26:30.266456 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 353/698] 10.222.0.36 () {56 vars in 1109 bytes} [Fri Jun 24 22:26:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:30.266456 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dec2a3-5ef2-4581-b9ed-16282db39aac None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:30.267070 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 346/699] 10.222.0.36 () {56 vars in 1129 bytes} [Fri Jun 24 22:26:30 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:30.268147 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29baaa54-c7e7-498c-ab46-883a9e5d0f9b None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:30.271512 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:30.277615 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:30.383145 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29baaa54-c7e7-498c-ab46-883a9e5d0f9b None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:30.388896 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dec2a3-5ef2-4581-b9ed-16282db39aac None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:30.425660 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d06d6f7-2614-4bc4-8d9f-7224fea3a185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:30.426591 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d06d6f7-2614-4bc4-8d9f-7224fea3a185 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:30.426876 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d06d6f7-2614-4bc4-8d9f-7224fea3a185 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:30.427150 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d06d6f7-2614-4bc4-8d9f-7224fea3a185 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:30.431959 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90e9004-dd8a-4ce2-b22e-b6e97bb1983f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:30.433053 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90e9004-dd8a-4ce2-b22e-b6e97bb1983f None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:30.433053 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90e9004-dd8a-4ce2-b22e-b6e97bb1983f None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:30.433309 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90e9004-dd8a-4ce2-b22e-b6e97bb1983f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:30.445315 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90e9004-dd8a-4ce2-b22e-b6e97bb1983f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:30.446817 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90e9004-dd8a-4ce2-b22e-b6e97bb1983f None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:30.447002 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d06d6f7-2614-4bc4-8d9f-7224fea3a185 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:30.448640 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d06d6f7-2614-4bc4-8d9f-7224fea3a185 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:30.463962 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-4d06d6f7-2614-4bc4-8d9f-7224fea3a185 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 22:26:30.463962 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:30.463962 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:30.463962 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:30.463962 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:30.463962 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:30.463962 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:30.463962 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:30.463962 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:30.463962 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:30.463962 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:30.463962 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:30.463962 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 22:26:30.463962 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 22:26:30.463962 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 22:26:30.465057 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 22:26:30.465057 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:30.465057 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:30.465057 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:30.465057 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:30.465057 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:30.465057 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:30.465057 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:30.465057 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:30.465057 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:30.465057 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:30.465057 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:30.465057 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:30.465057 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:30.465057 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:30.465057 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:30.465057 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:30.466016 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 22:26:30.466016 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 22:26:30.466016 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 22:26:30.466016 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 22:26:30.466016 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 22:26:30.466016 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 22:26:30.466016 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 22:26:30.466016 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:26:30.466444 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-c90e9004-dd8a-4ce2-b22e-b6e97bb1983f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:30.466444 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:30.466444 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:30.466444 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:30.466444 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:30.466444 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:30.466444 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:30.466444 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:30.466444 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:30.466444 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:30.466444 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:30.466444 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:30.466444 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 22:26:30.466444 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 22:26:30.466444 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 22:26:30.467333 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 22:26:30.467333 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:30.467333 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:30.467333 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:30.467333 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:30.467333 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:30.467333 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:30.467333 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:30.467333 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:30.467333 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:30.467333 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:30.467333 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:30.467333 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:30.467333 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:30.467333 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:30.467333 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:30.467333 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:30.468390 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 22:26:30.468390 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 22:26:30.468390 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:30.468390 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:26:30.468390 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 354/700] 10.222.0.36 () {56 vars in 1108 bytes} [Fri Jun 24 22:26:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:30.468390 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90e9004-dd8a-4ce2-b22e-b6e97bb1983f None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:30.470495 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 347/701] 10.222.0.36 () {56 vars in 1111 bytes} [Fri Jun 24 22:26:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:30.471519 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d06d6f7-2614-4bc4-8d9f-7224fea3a185 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:30.530754 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:30.536541 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:30.576764 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d06d6f7-2614-4bc4-8d9f-7224fea3a185 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:30.577589 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90e9004-dd8a-4ce2-b22e-b6e97bb1983f None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:30.612914 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965117b9-e6d0-4ea1-a008-dfba9a5b84c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:30.613531 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2ab1b2-6702-4012-b8d3-ce201f158ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:30.614212 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ab1b2-6702-4012-b8d3-ce201f158ff6 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:30.614493 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ab1b2-6702-4012-b8d3-ce201f158ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:30.614595 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965117b9-e6d0-4ea1-a008-dfba9a5b84c8 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:30.614759 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ab1b2-6702-4012-b8d3-ce201f158ff6 None admin] PATH_INFO: `/v3/services` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:30.615240 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965117b9-e6d0-4ea1-a008-dfba9a5b84c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:30.615569 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2ab1b2-6702-4012-b8d3-ce201f158ff6 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:30.615873 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2ab1b2-6702-4012-b8d3-ce201f158ff6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:30.616135 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965117b9-e6d0-4ea1-a008-dfba9a5b84c8 None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:30.617050 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965117b9-e6d0-4ea1-a008-dfba9a5b84c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:30.617311 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2ab1b2-6702-4012-b8d3-ce201f158ff6 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:30.617822 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965117b9-e6d0-4ea1-a008-dfba9a5b84c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:30.619426 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965117b9-e6d0-4ea1-a008-dfba9a5b84c8 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:30.627206 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 355/702] 10.222.0.36 () {56 vars in 1124 bytes} [Fri Jun 24 22:26:30 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:30.627206 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2ab1b2-6702-4012-b8d3-ce201f158ff6 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:30.640943 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 348/703] 10.222.0.36 () {56 vars in 1109 bytes} [Fri Jun 24 22:26:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:30.642296 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965117b9-e6d0-4ea1-a008-dfba9a5b84c8 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:30.730404 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2ab1b2-6702-4012-b8d3-ce201f158ff6 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:30.752621 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:30.755064 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965117b9-e6d0-4ea1-a008-dfba9a5b84c8 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:30.764941 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0439447a-58e3-40fd-a5f3-7f3c073f136c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:30.765615 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0439447a-58e3-40fd-a5f3-7f3c073f136c None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:30.765893 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0439447a-58e3-40fd-a5f3-7f3c073f136c None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:30.766165 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0439447a-58e3-40fd-a5f3-7f3c073f136c None admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:30.766947 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0439447a-58e3-40fd-a5f3-7f3c073f136c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:30.767269 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0439447a-58e3-40fd-a5f3-7f3c073f136c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:30.768729 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0439447a-58e3-40fd-a5f3-7f3c073f136c None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:30.781488 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 356/704] 10.222.0.36 () {56 vars in 1148 bytes} [Fri Jun 24 22:26:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:30.782415 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0439447a-58e3-40fd-a5f3-7f3c073f136c None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:30.786084 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:30.802222 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72a7394-5c8c-4dce-b797-ca880f391633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:30.803286 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72a7394-5c8c-4dce-b797-ca880f391633 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:30.803770 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72a7394-5c8c-4dce-b797-ca880f391633 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:30.804329 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72a7394-5c8c-4dce-b797-ca880f391633 None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:30.805357 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72a7394-5c8c-4dce-b797-ca880f391633 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:30.805863 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72a7394-5c8c-4dce-b797-ca880f391633 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:30.807950 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72a7394-5c8c-4dce-b797-ca880f391633 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:30.823642 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 349/705] 10.222.0.36 () {56 vars in 1124 bytes} [Fri Jun 24 22:26:30 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:30.825051 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72a7394-5c8c-4dce-b797-ca880f391633 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:30.887461 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0439447a-58e3-40fd-a5f3-7f3c073f136c None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:30.929485 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf113ed6-3324-4094-95a7-34bacbf6c3f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:30.930331 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf113ed6-3324-4094-95a7-34bacbf6c3f6 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:30.930714 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf113ed6-3324-4094-95a7-34bacbf6c3f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:30.930988 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf113ed6-3324-4094-95a7-34bacbf6c3f6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:30.938997 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf113ed6-3324-4094-95a7-34bacbf6c3f6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:30.940593 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf113ed6-3324-4094-95a7-34bacbf6c3f6 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:30.955872 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-cf113ed6-3324-4094-95a7-34bacbf6c3f6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 22:26:30.955872 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:30.955872 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:30.955872 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:30.955872 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:30.955872 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:30.955872 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:30.955872 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:30.955872 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:30.955872 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:30.955872 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:30.955872 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:30.955872 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 22:26:30.955872 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 22:26:30.955872 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 22:26:30.956824 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 22:26:30.956824 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:30.956824 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:30.956824 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:30.956824 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:30.956824 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:30.956824 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:30.956824 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:30.956824 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:30.956824 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:30.956824 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:30.956824 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:30.956824 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:30.956824 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:30.956824 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:30.956824 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:30.956824 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:30.957691 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 22:26:30.957691 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 22:26:30.957691 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 22:26:30.957691 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 22:26:30.957691 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 22:26:30.957691 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 22:26:30.957691 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 22:26:30.957691 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:26:30.957691 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 357/706] 10.222.0.36 () {56 vars in 1111 bytes} [Fri Jun 24 22:26:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:30.959071 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324b203b-ad93-4d25-b9a5-55ad4885baa2 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:30.959399 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324b203b-ad93-4d25-b9a5-55ad4885baa2 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:30.959703 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324b203b-ad93-4d25-b9a5-55ad4885baa2 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:30.965056 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 358/707] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:26:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:26:30.965056 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324b203b-ad93-4d25-b9a5-55ad4885baa2 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:30.996469 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72a7394-5c8c-4dce-b797-ca880f391633 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:31.019356 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:31.037604 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874b0bea-a986-4cbd-8058-86ecb8b102ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:31.038416 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874b0bea-a986-4cbd-8058-86ecb8b102ed None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:31.038972 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874b0bea-a986-4cbd-8058-86ecb8b102ed None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:31.039297 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874b0bea-a986-4cbd-8058-86ecb8b102ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:31.040798 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874b0bea-a986-4cbd-8058-86ecb8b102ed None admin] RBAC: Adding query filter params (role.id=3265c7c44fb144a0a56467ded2a39413, scope.project.id=d189b31bbec0469381292d2cde3cb420, user.id=6b95846f7f2a453f85ddb41a5d3327f3) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:31.040978 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874b0bea-a986-4cbd-8058-86ecb8b102ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:31.042570 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874b0bea-a986-4cbd-8058-86ecb8b102ed None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:31.052025 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 350/708] 10.222.0.36 () {56 vars in 1374 bytes} [Fri Jun 24 22:26:30 2022] GET /identity/v3/role_assignments?user.id=6b95846f7f2a453f85ddb41a5d3327f3&scope.project.id=d189b31bbec0469381292d2cde3cb420&role.id=3265c7c44fb144a0a56467ded2a39413 => generated 608 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:31.052966 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9041369a-e60a-4f8d-a4b2-dea8046fee56 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:31.053255 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9041369a-e60a-4f8d-a4b2-dea8046fee56 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:31.053536 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9041369a-e60a-4f8d-a4b2-dea8046fee56 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:31.059419 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 351/709] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:26:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:26:31.059419 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e3fd41-f0de-4f67-baec-b7be38f5c38e None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:31.059419 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e3fd41-f0de-4f67-baec-b7be38f5c38e None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:31.059419 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e3fd41-f0de-4f67-baec-b7be38f5c38e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:31.077816 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-58e3fd41-f0de-4f67-baec-b7be38f5c38e None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:26:31.079506 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-58e3fd41-f0de-4f67-baec-b7be38f5c38e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:26:31.087490 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324b203b-ad93-4d25-b9a5-55ad4885baa2 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:31.126388 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914f6b1a-3548-447f-8e82-26244f23e521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:31.127500 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914f6b1a-3548-447f-8e82-26244f23e521 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:31.127983 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914f6b1a-3548-447f-8e82-26244f23e521 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:31.128501 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914f6b1a-3548-447f-8e82-26244f23e521 None admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:31.129565 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914f6b1a-3548-447f-8e82-26244f23e521 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:31.130151 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914f6b1a-3548-447f-8e82-26244f23e521 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:31.132238 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914f6b1a-3548-447f-8e82-26244f23e521 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:31.146599 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:31.153803 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 359/710] 10.222.0.36 () {56 vars in 1148 bytes} [Fri Jun 24 22:26:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 22:26:31.155686 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05321032-9bff-46a4-90eb-e85b57331044 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:31.156237 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05321032-9bff-46a4-90eb-e85b57331044 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:31.157584 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05321032-9bff-46a4-90eb-e85b57331044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:31.174990 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 352/711] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:26:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 22:26:31.175962 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e3fd41-f0de-4f67-baec-b7be38f5c38e None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:31.177322 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-05321032-9bff-46a4-90eb-e85b57331044 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:26:31.178828 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-05321032-9bff-46a4-90eb-e85b57331044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:26:31.276996 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 360/712] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:26:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 22:26:31.283291 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05321032-9bff-46a4-90eb-e85b57331044 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:31.310908 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e3fd41-f0de-4f67-baec-b7be38f5c38e None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:31.318922 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:31.352729 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0932c827-63cf-4215-b8f5-9a7bbd0e781c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:31.353779 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0932c827-63cf-4215-b8f5-9a7bbd0e781c None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:31.354271 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0932c827-63cf-4215-b8f5-9a7bbd0e781c None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:31.354647 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0932c827-63cf-4215-b8f5-9a7bbd0e781c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:31.355533 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0932c827-63cf-4215-b8f5-9a7bbd0e781c None admin] RBAC: Adding query filter params (role.id=1a1c43cc97a0407eb7a7c7a1333a9d4a, scope.project.id=d189b31bbec0469381292d2cde3cb420, user.id=214d9071042c4bad886bf060a079b6e2) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:31.355851 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0932c827-63cf-4215-b8f5-9a7bbd0e781c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:31.357301 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0932c827-63cf-4215-b8f5-9a7bbd0e781c None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:31.364655 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 353/713] 10.222.0.36 () {56 vars in 1374 bytes} [Fri Jun 24 22:26:31 2022] GET /identity/v3/role_assignments?user.id=214d9071042c4bad886bf060a079b6e2&scope.project.id=d189b31bbec0469381292d2cde3cb420&role.id=1a1c43cc97a0407eb7a7c7a1333a9d4a => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:31.365302 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0932c827-63cf-4215-b8f5-9a7bbd0e781c None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:31.412479 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05321032-9bff-46a4-90eb-e85b57331044 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:31.455708 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:31.481902 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceb775a-6b9a-4c9b-bec0-2cbb665e3965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:31.482728 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb775a-6b9a-4c9b-bec0-2cbb665e3965 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:31.483006 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb775a-6b9a-4c9b-bec0-2cbb665e3965 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:31.483293 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb775a-6b9a-4c9b-bec0-2cbb665e3965 None admin] PATH_INFO: `/v3/services/network` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:31.483956 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceb775a-6b9a-4c9b-bec0-2cbb665e3965 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:31.485356 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceb775a-6b9a-4c9b-bec0-2cbb665e3965 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:31.507756 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-3ceb775a-6b9a-4c9b-bec0-2cbb665e3965 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 24 22:26:31.507756 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:31.507756 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 22:26:31.507756 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 22:26:31.507756 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 22:26:31.507756 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 22:26:31.507756 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 22:26:31.507756 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 22:26:31.507756 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 24 22:26:31.507756 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:26:31.507756 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 22:26:31.507756 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:26:31.507756 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:31.507756 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:31.507756 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:31.507756 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:31.507756 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:31.508986 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:31.508986 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:31.508986 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:31.508986 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:31.508986 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:31.508986 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:31.508986 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 22:26:31.508986 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 22:26:31.508986 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 22:26:31.508986 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 22:26:31.508986 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:31.508986 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:31.508986 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:31.508986 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:31.508986 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:31.508986 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:31.509822 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:31.509822 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:31.509822 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:31.509822 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:31.509822 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:31.509822 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:31.509822 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:31.509822 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:31.509822 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:31.509822 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:31.509822 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 22:26:31.509822 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 22:26:31.509822 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 24 22:26:31.509822 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:26:31.514228 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 361/714] 10.222.0.36 () {56 vars in 1111 bytes} [Fri Jun 24 22:26:31 2022] GET /identity/v3/services/network => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:31.515700 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceb775a-6b9a-4c9b-bec0-2cbb665e3965 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:31.568442 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0932c827-63cf-4215-b8f5-9a7bbd0e781c None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:31.631083 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047c052a-9a75-430d-bd0a-916310019552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:31.632112 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c052a-9a75-430d-bd0a-916310019552 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:31.632391 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c052a-9a75-430d-bd0a-916310019552 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:31.632657 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c052a-9a75-430d-bd0a-916310019552 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:31.651830 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:31.662174 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047c052a-9a75-430d-bd0a-916310019552 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:31.665341 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047c052a-9a75-430d-bd0a-916310019552 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:31.666488 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceb775a-6b9a-4c9b-bec0-2cbb665e3965 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:31.694024 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-047c052a-9a75-430d-bd0a-916310019552 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:31.694024 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:31.694024 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:31.694024 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:31.694024 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:31.694024 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:31.694024 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:31.694024 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:31.694024 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:31.694024 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:31.694024 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:31.694024 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:31.694024 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 22:26:31.694024 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 22:26:31.694024 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 22:26:31.694967 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 22:26:31.694967 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:31.694967 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:31.694967 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:31.694967 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:31.694967 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:31.694967 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:31.694967 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:31.694967 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:31.694967 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:31.694967 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:31.694967 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:31.694967 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:31.694967 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:31.694967 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:31.694967 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:31.694967 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:31.695944 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 22:26:31.695944 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 22:26:31.695944 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:31.695944 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:26:31.695944 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 354/715] 10.222.0.36 () {56 vars in 1108 bytes} [Fri Jun 24 22:26:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:31.702192 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047c052a-9a75-430d-bd0a-916310019552 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:31.748071 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd667282-8a63-4c3d-aa66-f728ee828681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:31.748757 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd667282-8a63-4c3d-aa66-f728ee828681 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:31.749085 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd667282-8a63-4c3d-aa66-f728ee828681 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:31.749362 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd667282-8a63-4c3d-aa66-f728ee828681 None admin] PATH_INFO: `/v3/services` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:31.750072 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd667282-8a63-4c3d-aa66-f728ee828681 None admin] RBAC: Adding query filter params (name=network) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:31.750378 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd667282-8a63-4c3d-aa66-f728ee828681 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:31.751987 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd667282-8a63-4c3d-aa66-f728ee828681 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:31.773555 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 362/716] 10.222.0.36 () {56 vars in 1112 bytes} [Fri Jun 24 22:26:31 2022] GET /identity/v3/services?name=network => generated 124 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 22:26:31.779214 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd667282-8a63-4c3d-aa66-f728ee828681 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:31.818352 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047c052a-9a75-430d-bd0a-916310019552 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:31.831664 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:31.858832 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41b46e4-964d-4628-abe1-bb37c7889eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:31.859538 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b46e4-964d-4628-abe1-bb37c7889eaa None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:31.859826 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b46e4-964d-4628-abe1-bb37c7889eaa None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:31.860107 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b46e4-964d-4628-abe1-bb37c7889eaa None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:31.860841 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41b46e4-964d-4628-abe1-bb37c7889eaa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:31.861149 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41b46e4-964d-4628-abe1-bb37c7889eaa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:31.862537 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41b46e4-964d-4628-abe1-bb37c7889eaa None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:31.889810 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 355/717] 10.222.0.36 () {56 vars in 1109 bytes} [Fri Jun 24 22:26:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:31.897000 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41b46e4-964d-4628-abe1-bb37c7889eaa None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:32.005102 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd667282-8a63-4c3d-aa66-f728ee828681 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:32.035038 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41b46e4-964d-4628-abe1-bb37c7889eaa None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:32.082322 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fdcae9-18da-4f01-aafd-3f73eb39199c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:32.082919 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fdcae9-18da-4f01-aafd-3f73eb39199c None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:32.083206 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fdcae9-18da-4f01-aafd-3f73eb39199c None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:32.083510 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fdcae9-18da-4f01-aafd-3f73eb39199c None admin] PATH_INFO: `/v3/services` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:32.084228 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fdcae9-18da-4f01-aafd-3f73eb39199c None admin] RBAC: Adding query filter params (type=network) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:32.084541 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fdcae9-18da-4f01-aafd-3f73eb39199c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:32.085936 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fdcae9-18da-4f01-aafd-3f73eb39199c None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:32.092747 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468bc79d-9a9d-4ac1-8ac1-5cbac2aaad72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:32.093439 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468bc79d-9a9d-4ac1-8ac1-5cbac2aaad72 None admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:32.093725 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468bc79d-9a9d-4ac1-8ac1-5cbac2aaad72 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:32.094004 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468bc79d-9a9d-4ac1-8ac1-5cbac2aaad72 None admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:32.094729 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468bc79d-9a9d-4ac1-8ac1-5cbac2aaad72 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:32.096259 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468bc79d-9a9d-4ac1-8ac1-5cbac2aaad72 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:32.107226 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 363/718] 10.222.0.36 () {56 vars in 1112 bytes} [Fri Jun 24 22:26:31 2022] GET /identity/v3/services?type=network => generated 124 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 22:26:32.124595 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 356/719] 10.222.0.36 () {60 vars in 1132 bytes} [Fri Jun 24 22:26:31 2022] POST /identity/v3/users => generated 254 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:26:33.081866 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba75c5e-3bb4-4dce-9f10-34c424664122 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:33.082404 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba75c5e-3bb4-4dce-9f10-34c424664122 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:33.082404 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba75c5e-3bb4-4dce-9f10-34c424664122 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:33.084112 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 364/720] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:26:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:26:33.089606 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ff8d9-ee04-4d33-b8bc-dd21ec878f2b None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:33.090044 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ff8d9-ee04-4d33-b8bc-dd21ec878f2b None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:33.090239 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ff8d9-ee04-4d33-b8bc-dd21ec878f2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:33.107710 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-0f2ff8d9-ee04-4d33-b8bc-dd21ec878f2b None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:26:33.108910 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-0f2ff8d9-ee04-4d33-b8bc-dd21ec878f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:26:33.117294 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:33.181556 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 357/721] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:26:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 22:26:33.204029 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba75c5e-3bb4-4dce-9f10-34c424664122 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:33.232158 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:33.319901 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba75c5e-3bb4-4dce-9f10-34c424664122 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:33.366230 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50585d38-ea61-4ca9-8e6e-aa6faf13a505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:33.366905 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50585d38-ea61-4ca9-8e6e-aa6faf13a505 None admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:33.367187 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50585d38-ea61-4ca9-8e6e-aa6faf13a505 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:33.367487 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50585d38-ea61-4ca9-8e6e-aa6faf13a505 None admin] PATH_INFO: `/v3/services` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:33.368276 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50585d38-ea61-4ca9-8e6e-aa6faf13a505 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:33.369663 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50585d38-ea61-4ca9-8e6e-aa6faf13a505 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:33.390281 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 365/722] 10.222.0.36 () {60 vars in 1141 bytes} [Fri Jun 24 22:26:33 2022] POST /identity/v3/services => generated 251 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:26:33.745084 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde75a5-a122-445a-8469-b2241a258458 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:33.745432 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde75a5-a122-445a-8469-b2241a258458 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:33.745608 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde75a5-a122-445a-8469-b2241a258458 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:33.747317 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 358/723] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:26:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:26:33.752889 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60bc0c7-9cca-4ba9-b8a2-aed6569fe337 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:33.753188 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60bc0c7-9cca-4ba9-b8a2-aed6569fe337 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:33.753474 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60bc0c7-9cca-4ba9-b8a2-aed6569fe337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:33.770781 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-a60bc0c7-9cca-4ba9-b8a2-aed6569fe337 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:26:33.772060 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-a60bc0c7-9cca-4ba9-b8a2-aed6569fe337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:26:33.862137 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 366/724] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:26:33 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 22:26:33.885792 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bde75a5-a122-445a-8469-b2241a258458 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:33.954415 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d1c42f-cb67-483d-a40e-223b2423bae9 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:33.954694 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d1c42f-cb67-483d-a40e-223b2423bae9 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:33.954971 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d1c42f-cb67-483d-a40e-223b2423bae9 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:33.956682 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 367/725] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:26:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:26:33.964771 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156850dc-c29e-4482-90c2-1cdff7955b29 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:33.965316 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156850dc-c29e-4482-90c2-1cdff7955b29 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:33.965789 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156850dc-c29e-4482-90c2-1cdff7955b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:33.991504 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-156850dc-c29e-4482-90c2-1cdff7955b29 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:26:33.993644 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-156850dc-c29e-4482-90c2-1cdff7955b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:26:34.007684 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:34.063230 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bde75a5-a122-445a-8469-b2241a258458 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:34.118778 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 368/726] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:26:33 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 22:26:34.122837 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8a0f7e-8a4e-485b-a69d-6130dc2f9a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:34.123756 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8a0f7e-8a4e-485b-a69d-6130dc2f9a67 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:34.124039 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8a0f7e-8a4e-485b-a69d-6130dc2f9a67 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:34.124315 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8a0f7e-8a4e-485b-a69d-6130dc2f9a67 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:34.141426 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156850dc-c29e-4482-90c2-1cdff7955b29 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:34.156296 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8a0f7e-8a4e-485b-a69d-6130dc2f9a67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 22:26:34.164682 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-0b8a0f7e-8a4e-485b-a69d-6130dc2f9a67 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 22:26:34.164682 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:34.164682 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:34.164682 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:34.164682 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:34.164682 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:34.164682 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:34.164682 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:34.164682 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:34.164682 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:34.164682 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:34.164682 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:34.164682 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 22:26:34.164682 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 22:26:34.164682 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 22:26:34.164682 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 22:26:34.166771 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 22:26:34.166771 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 22:26:34.166771 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 22:26:34.166771 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 22:26:34.166771 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:34.166771 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:34.166771 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:34.166771 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:34.166771 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:34.166771 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:34.166771 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:34.166771 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:34.166771 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:34.166771 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:34.166771 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:34.166771 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:34.168488 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:34.168488 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:34.168488 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:34.168488 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:34.168488 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 22:26:34.168488 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 22:26:34.168488 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 22:26:34.168488 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 22:26:34.168488 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 22:26:34.168488 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 22:26:34.168488 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 22:26:34.168488 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:26:34.168488 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 359/727] 10.222.0.36 () {56 vars in 1096 bytes} [Fri Jun 24 22:26:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:34.176279 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8a0f7e-8a4e-485b-a69d-6130dc2f9a67 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:34.211710 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:34.244926 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156850dc-c29e-4482-90c2-1cdff7955b29 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:34.289485 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d61b8d-7eb1-485d-a618-885a695d5087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:34.290849 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d61b8d-7eb1-485d-a618-885a695d5087 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:34.291166 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d61b8d-7eb1-485d-a618-885a695d5087 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:34.291471 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d61b8d-7eb1-485d-a618-885a695d5087 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:34.315614 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:34.317854 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d61b8d-7eb1-485d-a618-885a695d5087 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 22:26:34.325626 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-e1d61b8d-7eb1-485d-a618-885a695d5087 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 22:26:34.325626 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:34.325626 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:34.325626 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:34.325626 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:34.325626 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:34.325626 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:34.325626 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:34.325626 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:34.325626 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:34.325626 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:34.325626 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:34.325626 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 22:26:34.325626 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 22:26:34.325626 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 22:26:34.325626 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 22:26:34.326573 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 22:26:34.326573 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 22:26:34.326573 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 22:26:34.326573 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 22:26:34.326573 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:34.326573 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:34.326573 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:34.326573 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:34.326573 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:34.326573 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:34.326573 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:34.326573 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:34.326573 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:34.326573 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:34.326573 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:34.326573 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:34.327423 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:34.327423 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:34.327423 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:34.327423 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:34.327423 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 22:26:34.327423 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 22:26:34.327423 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 22:26:34.327423 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 22:26:34.327423 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 22:26:34.327423 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 22:26:34.327423 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 22:26:34.327423 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:26:34.333367 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 369/728] 10.222.0.36 () {56 vars in 1096 bytes} [Fri Jun 24 22:26:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 22:26:34.339386 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d61b8d-7eb1-485d-a618-885a695d5087 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:34.377221 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8a0f7e-8a4e-485b-a69d-6130dc2f9a67 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:34.447332 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2e4cf3-7e2a-463e-8496-c97422acf52b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:34.448413 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e4cf3-7e2a-463e-8496-c97422acf52b None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:34.448892 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e4cf3-7e2a-463e-8496-c97422acf52b None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:34.449360 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e4cf3-7e2a-463e-8496-c97422acf52b None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:34.450339 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2e4cf3-7e2a-463e-8496-c97422acf52b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:34.450840 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2e4cf3-7e2a-463e-8496-c97422acf52b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:34.452481 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2e4cf3-7e2a-463e-8496-c97422acf52b None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:34.468221 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 360/729] 10.222.0.36 () {56 vars in 1099 bytes} [Fri Jun 24 22:26:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:34.474470 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2e4cf3-7e2a-463e-8496-c97422acf52b None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:34.499919 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d61b8d-7eb1-485d-a618-885a695d5087 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:34.538810 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb93afe-079a-49fc-b8d7-d75a71fb7517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:34.540236 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb93afe-079a-49fc-b8d7-d75a71fb7517 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:34.540725 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb93afe-079a-49fc-b8d7-d75a71fb7517 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:34.541198 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb93afe-079a-49fc-b8d7-d75a71fb7517 None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:34.542159 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb93afe-079a-49fc-b8d7-d75a71fb7517 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:34.542661 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb93afe-079a-49fc-b8d7-d75a71fb7517 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:34.544731 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb93afe-079a-49fc-b8d7-d75a71fb7517 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:34.563669 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 370/730] 10.222.0.36 () {56 vars in 1099 bytes} [Fri Jun 24 22:26:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:34.569353 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb93afe-079a-49fc-b8d7-d75a71fb7517 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:34.605859 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:34.650829 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:34.654476 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2e4cf3-7e2a-463e-8496-c97422acf52b None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:34.689451 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785710db-21a2-41ec-bf43-12f5aab4e52a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:34.690240 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785710db-21a2-41ec-bf43-12f5aab4e52a None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:34.690514 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785710db-21a2-41ec-bf43-12f5aab4e52a None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:34.690939 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785710db-21a2-41ec-bf43-12f5aab4e52a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:34.693553 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb93afe-079a-49fc-b8d7-d75a71fb7517 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:34.701798 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785710db-21a2-41ec-bf43-12f5aab4e52a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:34.703262 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785710db-21a2-41ec-bf43-12f5aab4e52a None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:34.720338 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-785710db-21a2-41ec-bf43-12f5aab4e52a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:34.720338 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:34.720338 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:34.720338 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:34.720338 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:34.720338 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:34.720338 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:34.720338 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:34.720338 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:34.720338 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:34.720338 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:34.720338 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:34.720338 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 22:26:34.720338 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 22:26:34.720338 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 22:26:34.721275 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 22:26:34.721275 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:34.721275 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:34.721275 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:34.721275 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:34.721275 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:34.721275 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:34.721275 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:34.721275 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:34.721275 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:34.721275 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:34.721275 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:34.721275 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:34.721275 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:34.721275 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:34.721275 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:34.721275 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:34.722148 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 22:26:34.722148 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 22:26:34.722148 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:34.722148 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:26:34.722148 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 361/731] 10.222.0.36 () {56 vars in 1108 bytes} [Fri Jun 24 22:26:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:34.722945 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c2e20a-1191-45a6-8cad-cfd3d5c0b629 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:34.723047 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c2e20a-1191-45a6-8cad-cfd3d5c0b629 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:34.723443 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c2e20a-1191-45a6-8cad-cfd3d5c0b629 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:34.727639 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 362/732] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:26:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:26:34.727639 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3694029e-6a74-446f-acd1-473fcc41ef0f None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:34.727639 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3694029e-6a74-446f-acd1-473fcc41ef0f None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:34.727639 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3694029e-6a74-446f-acd1-473fcc41ef0f None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:34.731825 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 363/733] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:26:34 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:26:34.732694 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3694029e-6a74-446f-acd1-473fcc41ef0f None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:34.735825 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042ab9c3-c934-4dcd-bbfd-e185ba1b2a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:34.736627 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042ab9c3-c934-4dcd-bbfd-e185ba1b2a99 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:34.736910 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042ab9c3-c934-4dcd-bbfd-e185ba1b2a99 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:34.737185 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042ab9c3-c934-4dcd-bbfd-e185ba1b2a99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:34.748853 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042ab9c3-c934-4dcd-bbfd-e185ba1b2a99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:34.750314 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042ab9c3-c934-4dcd-bbfd-e185ba1b2a99 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:34.767769 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-042ab9c3-c934-4dcd-bbfd-e185ba1b2a99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:34.767769 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:34.767769 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:34.767769 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:34.767769 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:34.767769 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:34.767769 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:34.767769 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:34.767769 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:34.767769 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:34.767769 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:34.767769 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:34.767769 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 22:26:34.767769 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 22:26:34.767769 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 22:26:34.768637 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 22:26:34.768637 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:34.768637 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:34.768637 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:34.768637 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:34.768637 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:34.768637 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:34.768637 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:34.768637 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:34.768637 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:34.768637 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:34.768637 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:34.768637 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:34.768637 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:34.768637 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:34.768637 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:34.768637 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:34.769520 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 22:26:34.769520 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 22:26:34.769520 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:34.769520 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:26:34.773672 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 371/734] 10.222.0.36 () {56 vars in 1108 bytes} [Fri Jun 24 22:26:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 22:26:34.775060 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36159996-8fea-4932-83d2-27d4cb2fabca None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:34.775361 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36159996-8fea-4932-83d2-27d4cb2fabca None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:34.775642 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36159996-8fea-4932-83d2-27d4cb2fabca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:34.792917 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-36159996-8fea-4932-83d2-27d4cb2fabca None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:26:34.794029 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-36159996-8fea-4932-83d2-27d4cb2fabca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:26:34.840180 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3694029e-6a74-446f-acd1-473fcc41ef0f None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:34.857244 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:34.870976 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 372/735] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:26:34 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 22:26:34.870976 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb36960-4e1a-4814-86db-111dd91be90c None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:34.870976 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb36960-4e1a-4814-86db-111dd91be90c None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:34.870976 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb36960-4e1a-4814-86db-111dd91be90c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:34.883768 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-ffb36960-4e1a-4814-86db-111dd91be90c None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:26:34.884957 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-ffb36960-4e1a-4814-86db-111dd91be90c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:26:34.885665 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627035d2-6cbe-4407-81e1-1372cb116f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:34.886391 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627035d2-6cbe-4407-81e1-1372cb116f69 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:34.886700 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627035d2-6cbe-4407-81e1-1372cb116f69 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:34.887038 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627035d2-6cbe-4407-81e1-1372cb116f69 None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:34.887972 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627035d2-6cbe-4407-81e1-1372cb116f69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:34.888281 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627035d2-6cbe-4407-81e1-1372cb116f69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:34.889721 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627035d2-6cbe-4407-81e1-1372cb116f69 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:34.903125 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 364/736] 10.222.0.36 () {56 vars in 1109 bytes} [Fri Jun 24 22:26:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:34.903907 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627035d2-6cbe-4407-81e1-1372cb116f69 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:34.931783 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:34.962039 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 373/737] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:26:34 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 22:26:34.963406 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb36960-4e1a-4814-86db-111dd91be90c None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:35.016771 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627035d2-6cbe-4407-81e1-1372cb116f69 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:35.053262 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321bfee0-00d7-4902-88d8-c29454ceddd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:35.053842 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321bfee0-00d7-4902-88d8-c29454ceddd6 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:35.054121 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321bfee0-00d7-4902-88d8-c29454ceddd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:35.054397 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321bfee0-00d7-4902-88d8-c29454ceddd6 None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:35.055283 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321bfee0-00d7-4902-88d8-c29454ceddd6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:35.055688 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321bfee0-00d7-4902-88d8-c29454ceddd6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:35.057071 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321bfee0-00d7-4902-88d8-c29454ceddd6 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:35.068328 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 365/738] 10.222.0.36 () {56 vars in 1109 bytes} [Fri Jun 24 22:26:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:35.069115 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321bfee0-00d7-4902-88d8-c29454ceddd6 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:35.085031 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb36960-4e1a-4814-86db-111dd91be90c None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:35.104794 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:35.122304 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fc45b0-ebd2-475d-b731-0d934905c91f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:35.123716 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fc45b0-ebd2-475d-b731-0d934905c91f None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:35.124146 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fc45b0-ebd2-475d-b731-0d934905c91f None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:35.124586 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fc45b0-ebd2-475d-b731-0d934905c91f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:35.135475 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fc45b0-ebd2-475d-b731-0d934905c91f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 22:26:35.143278 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-c6fc45b0-ebd2-475d-b731-0d934905c91f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 22:26:35.143278 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:35.143278 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:35.143278 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:35.143278 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:35.143278 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:35.143278 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:35.143278 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:35.143278 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:35.143278 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:35.143278 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:35.143278 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:35.143278 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 22:26:35.143278 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 22:26:35.143278 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 22:26:35.143278 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 22:26:35.144768 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 22:26:35.144768 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 22:26:35.144768 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 22:26:35.144768 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 22:26:35.144768 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:35.144768 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:35.144768 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:35.144768 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:35.144768 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:35.144768 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:35.144768 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:35.144768 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:35.144768 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:35.144768 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:35.144768 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:35.144768 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:35.145756 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:35.145756 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:35.145756 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:35.145756 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:35.145756 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 22:26:35.145756 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 22:26:35.145756 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 22:26:35.145756 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 22:26:35.145756 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 22:26:35.145756 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 22:26:35.145756 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 22:26:35.145756 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:26:35.152878 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 374/739] 10.222.0.36 () {56 vars in 1102 bytes} [Fri Jun 24 22:26:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:35.153875 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fc45b0-ebd2-475d-b731-0d934905c91f None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:35.172212 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321bfee0-00d7-4902-88d8-c29454ceddd6 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:35.190106 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:35.208507 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c1fcca-9205-4da9-b9e4-2a9785f84864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:35.209561 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c1fcca-9205-4da9-b9e4-2a9785f84864 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:35.209994 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c1fcca-9205-4da9-b9e4-2a9785f84864 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:35.210443 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c1fcca-9205-4da9-b9e4-2a9785f84864 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:35.218645 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c1fcca-9205-4da9-b9e4-2a9785f84864 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:35.220277 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c1fcca-9205-4da9-b9e4-2a9785f84864 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:35.234987 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-b9c1fcca-9205-4da9-b9e4-2a9785f84864 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 24 22:26:35.234987 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:35.234987 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:35.234987 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:35.234987 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:35.234987 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:35.234987 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:35.234987 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:35.234987 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:35.234987 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:35.234987 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:35.234987 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:35.234987 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 22:26:35.234987 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 22:26:35.234987 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 22:26:35.234987 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 22:26:35.236098 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:35.236098 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:35.236098 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 22:26:35.236098 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 22:26:35.236098 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 22:26:35.236098 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 22:26:35.236098 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:35.236098 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:35.236098 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:35.236098 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:35.236098 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:35.236098 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:35.236098 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:35.236098 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:35.236098 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:35.236098 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:35.236098 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:35.236098 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:35.237222 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:35.237222 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:35.237222 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 22:26:35.237222 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 22:26:35.237222 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 22:26:35.237222 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 22:26:35.237222 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 22:26:35.237222 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 22:26:35.237222 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 24 22:26:35.237222 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:26:35.239206 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 366/740] 10.222.0.36 () {56 vars in 1096 bytes} [Fri Jun 24 22:26:35 2022] GET /identity/v3/users/swift => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:35.239992 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c1fcca-9205-4da9-b9e4-2a9785f84864 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:35.263292 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fc45b0-ebd2-475d-b731-0d934905c91f None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:35.296640 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca22a9-ea6a-40df-ab9d-7942fd159ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:35.297300 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca22a9-ea6a-40df-ab9d-7942fd159ae4 None admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:35.297580 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca22a9-ea6a-40df-ab9d-7942fd159ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:35.297851 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca22a9-ea6a-40df-ab9d-7942fd159ae4 None admin] PATH_INFO: `/v3/services` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:35.298571 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cca22a9-ea6a-40df-ab9d-7942fd159ae4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:35.299993 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cca22a9-ea6a-40df-ab9d-7942fd159ae4 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:35.314591 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 375/741] 10.222.0.36 () {60 vars in 1141 bytes} [Fri Jun 24 22:26:35 2022] POST /identity/v3/services => generated 240 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:26:35.315700 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca22a9-ea6a-40df-ab9d-7942fd159ae4 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:35.353001 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:35.360496 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c1fcca-9205-4da9-b9e4-2a9785f84864 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:35.428938 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241915dc-d772-4c9a-a686-f88f3471f1d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:35.429859 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241915dc-d772-4c9a-a686-f88f3471f1d9 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:35.430583 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241915dc-d772-4c9a-a686-f88f3471f1d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:35.430934 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241915dc-d772-4c9a-a686-f88f3471f1d9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:35.442599 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241915dc-d772-4c9a-a686-f88f3471f1d9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:35.443468 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241915dc-d772-4c9a-a686-f88f3471f1d9 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:35.452887 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:35.463137 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca22a9-ea6a-40df-ab9d-7942fd159ae4 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:35.466103 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-241915dc-d772-4c9a-a686-f88f3471f1d9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 24 22:26:35.466103 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:35.466103 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:35.466103 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:35.466103 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:35.466103 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:35.466103 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:35.466103 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:35.466103 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:35.466103 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:35.466103 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:35.466103 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:35.466103 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 22:26:35.466103 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 22:26:35.466103 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 22:26:35.466103 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 22:26:35.467025 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:35.467025 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:35.467025 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 22:26:35.467025 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 22:26:35.467025 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 22:26:35.467025 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 22:26:35.467025 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:35.467025 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:35.467025 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:35.467025 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:35.467025 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:35.467025 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:35.467025 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:35.467025 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:35.467025 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:35.467025 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:35.467025 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:35.467025 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:35.468612 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:35.468612 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:35.468612 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 22:26:35.468612 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 22:26:35.468612 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 22:26:35.468612 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 22:26:35.468612 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 22:26:35.468612 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 22:26:35.468612 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 24 22:26:35.468612 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:26:35.468612 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 367/742] 10.222.0.36 () {56 vars in 1093 bytes} [Fri Jun 24 22:26:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:35.471114 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241915dc-d772-4c9a-a686-f88f3471f1d9 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:35.506273 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb23c995-c149-449b-893b-82f7d24e6b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:35.507207 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb23c995-c149-449b-893b-82f7d24e6b9e None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:35.507672 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb23c995-c149-449b-893b-82f7d24e6b9e None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:35.507944 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb23c995-c149-449b-893b-82f7d24e6b9e None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:35.508823 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb23c995-c149-449b-893b-82f7d24e6b9e None admin] RBAC: Adding query filter params (name=service) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:35.509129 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb23c995-c149-449b-893b-82f7d24e6b9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:35.510777 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb23c995-c149-449b-893b-82f7d24e6b9e None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:35.519845 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 376/743] 10.222.0.36 () {56 vars in 1103 bytes} [Fri Jun 24 22:26:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:35.520677 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb23c995-c149-449b-893b-82f7d24e6b9e None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:35.592538 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241915dc-d772-4c9a-a686-f88f3471f1d9 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:35.633286 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c584a010-f9bc-46cf-94c8-5c75d43d726f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:35.634243 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c584a010-f9bc-46cf-94c8-5c75d43d726f None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:35.634607 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c584a010-f9bc-46cf-94c8-5c75d43d726f None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:35.634973 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c584a010-f9bc-46cf-94c8-5c75d43d726f None admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:35.636082 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c584a010-f9bc-46cf-94c8-5c75d43d726f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:35.636499 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c584a010-f9bc-46cf-94c8-5c75d43d726f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:35.638074 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c584a010-f9bc-46cf-94c8-5c75d43d726f None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:35.646493 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb23c995-c149-449b-893b-82f7d24e6b9e None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:35.662849 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 368/744] 10.222.0.36 () {56 vars in 1135 bytes} [Fri Jun 24 22:26:35 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:35.662849 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c584a010-f9bc-46cf-94c8-5c75d43d726f None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:35.677971 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:35.691140 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8b676c-5738-4ee1-a607-1894841fbec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:35.691994 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8b676c-5738-4ee1-a607-1894841fbec0 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:35.692400 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8b676c-5738-4ee1-a607-1894841fbec0 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:35.692776 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8b676c-5738-4ee1-a607-1894841fbec0 None admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:35.693780 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8b676c-5738-4ee1-a607-1894841fbec0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:35.694190 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8b676c-5738-4ee1-a607-1894841fbec0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:35.695872 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8b676c-5738-4ee1-a607-1894841fbec0 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:35.720694 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 377/745] 10.222.0.36 () {56 vars in 1133 bytes} [Fri Jun 24 22:26:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:35.720694 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8b676c-5738-4ee1-a607-1894841fbec0 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:35.741246 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:35.789643 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c584a010-f9bc-46cf-94c8-5c75d43d726f None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:35.830152 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b14d15d-876d-434e-89ae-ada6ce4f0d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:35.831371 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b14d15d-876d-434e-89ae-ada6ce4f0d6d None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:35.831983 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b14d15d-876d-434e-89ae-ada6ce4f0d6d None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:35.832469 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b14d15d-876d-434e-89ae-ada6ce4f0d6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:35.844383 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b14d15d-876d-434e-89ae-ada6ce4f0d6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:35.846246 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b14d15d-876d-434e-89ae-ada6ce4f0d6d None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:35.850201 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8b676c-5738-4ee1-a607-1894841fbec0 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:35.866527 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-7b14d15d-876d-434e-89ae-ada6ce4f0d6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:35.866527 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:35.866527 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:35.866527 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:35.866527 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:35.866527 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:35.866527 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:35.866527 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:35.866527 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:35.866527 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:35.866527 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:35.866527 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:35.866527 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 22:26:35.866527 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 22:26:35.866527 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 22:26:35.867556 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 22:26:35.867556 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:35.867556 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:35.867556 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:35.867556 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:35.867556 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:35.867556 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:35.867556 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:35.867556 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:35.867556 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:35.867556 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:35.867556 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:35.867556 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:35.867556 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:35.867556 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:35.867556 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:35.867556 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:35.868437 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 22:26:35.868437 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 22:26:35.868437 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:35.868437 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:26:35.875224 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 369/746] 10.222.0.36 () {56 vars in 1108 bytes} [Fri Jun 24 22:26:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:35.876423 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b14d15d-876d-434e-89ae-ada6ce4f0d6d None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:35.888272 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9bc534-4d69-4d87-85d8-48f617831de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:35.889380 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9bc534-4d69-4d87-85d8-48f617831de0 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:35.889675 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9bc534-4d69-4d87-85d8-48f617831de0 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:35.889953 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9bc534-4d69-4d87-85d8-48f617831de0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:35.950848 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:35.971936 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9bc534-4d69-4d87-85d8-48f617831de0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:35.973414 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9bc534-4d69-4d87-85d8-48f617831de0 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:35.989678 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:35.992530 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b14d15d-876d-434e-89ae-ada6ce4f0d6d None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:36.027427 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf979d7f-2328-4ea4-9cc0-bb2de287978a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:36.028239 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf979d7f-2328-4ea4-9cc0-bb2de287978a None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:36.028529 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf979d7f-2328-4ea4-9cc0-bb2de287978a None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:36.028799 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf979d7f-2328-4ea4-9cc0-bb2de287978a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:36.038904 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf979d7f-2328-4ea4-9cc0-bb2de287978a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:36.040651 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf979d7f-2328-4ea4-9cc0-bb2de287978a None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:36.058737 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-bf979d7f-2328-4ea4-9cc0-bb2de287978a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:36.058737 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:36.058737 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:36.058737 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:36.058737 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:36.058737 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:36.058737 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:36.058737 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:36.058737 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:36.058737 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:36.058737 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:36.058737 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:36.058737 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 22:26:36.058737 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 22:26:36.058737 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 22:26:36.059860 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 22:26:36.059860 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:36.059860 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:36.059860 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:36.059860 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:36.059860 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:36.059860 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:36.059860 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:36.059860 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:36.059860 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:36.059860 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:36.059860 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:36.059860 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:36.059860 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:36.059860 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:36.059860 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:36.059860 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:36.060750 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 22:26:36.060750 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 22:26:36.060750 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:36.060750 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:26:36.060750 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 370/747] 10.222.0.36 () {56 vars in 1108 bytes} [Fri Jun 24 22:26:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:36.060750 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf979d7f-2328-4ea4-9cc0-bb2de287978a None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:36.087811 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 378/748] 10.222.0.36 () {58 vars in 1282 bytes} [Fri Jun 24 22:26:35 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 22:26:36.089393 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec6f47-5f2c-480d-9201-364a14b13f4b None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:36.089682 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec6f47-5f2c-480d-9201-364a14b13f4b None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:36.089958 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec6f47-5f2c-480d-9201-364a14b13f4b None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:36.091384 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 379/749] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:26:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:26:36.095997 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec6f47-5f2c-480d-9201-364a14b13f4b None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:36.171816 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf979d7f-2328-4ea4-9cc0-bb2de287978a None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:36.188046 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:36.204547 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec6f47-5f2c-480d-9201-364a14b13f4b None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:36.210382 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38124a08-77e5-4e23-936c-5d1b22ee638c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:36.211053 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38124a08-77e5-4e23-936c-5d1b22ee638c None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:36.211524 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38124a08-77e5-4e23-936c-5d1b22ee638c None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:36.211807 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38124a08-77e5-4e23-936c-5d1b22ee638c None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:36.212657 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38124a08-77e5-4e23-936c-5d1b22ee638c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:36.212969 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38124a08-77e5-4e23-936c-5d1b22ee638c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:36.214421 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38124a08-77e5-4e23-936c-5d1b22ee638c None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:36.220195 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:36.230598 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 371/750] 10.222.0.36 () {56 vars in 1109 bytes} [Fri Jun 24 22:26:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:36.230598 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38124a08-77e5-4e23-936c-5d1b22ee638c None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:36.246699 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a87a47-604e-417d-b7d5-e901d02c973c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:36.247164 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a87a47-604e-417d-b7d5-e901d02c973c None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:36.247490 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a87a47-604e-417d-b7d5-e901d02c973c None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:36.247826 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a87a47-604e-417d-b7d5-e901d02c973c None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:36.248484 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a87a47-604e-417d-b7d5-e901d02c973c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:36.248789 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a87a47-604e-417d-b7d5-e901d02c973c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:36.250257 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a87a47-604e-417d-b7d5-e901d02c973c None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:36.263582 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 380/751] 10.222.0.36 () {56 vars in 1109 bytes} [Fri Jun 24 22:26:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:36.264626 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0979cf-e608-4707-a491-6130edd28cff None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:36.264917 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0979cf-e608-4707-a491-6130edd28cff None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:36.265197 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0979cf-e608-4707-a491-6130edd28cff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:36.281220 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-1f0979cf-e608-4707-a491-6130edd28cff None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:26:36.282409 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-1f0979cf-e608-4707-a491-6130edd28cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:26:36.338449 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38124a08-77e5-4e23-936c-5d1b22ee638c None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:36.363347 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 381/752] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:26:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 22:26:36.363347 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0979cf-e608-4707-a491-6130edd28cff None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:36.373476 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59158184-331f-4bf1-9c67-4f86082d028d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:36.374416 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59158184-331f-4bf1-9c67-4f86082d028d None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:36.374800 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59158184-331f-4bf1-9c67-4f86082d028d None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:36.375170 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59158184-331f-4bf1-9c67-4f86082d028d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:36.387750 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59158184-331f-4bf1-9c67-4f86082d028d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:36.389625 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59158184-331f-4bf1-9c67-4f86082d028d None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:36.408510 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-59158184-331f-4bf1-9c67-4f86082d028d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:36.408510 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:36.408510 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:36.408510 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:36.408510 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:36.408510 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:36.408510 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:36.408510 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:36.408510 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:36.408510 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:36.408510 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:36.408510 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:36.408510 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 22:26:36.408510 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 22:26:36.408510 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 22:26:36.409436 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 22:26:36.409436 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:36.409436 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:36.409436 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:36.409436 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:36.409436 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:36.409436 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:36.409436 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:36.409436 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:36.409436 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:36.409436 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:36.409436 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:36.409436 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:36.409436 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:36.409436 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:36.409436 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:36.409436 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:36.410325 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 22:26:36.410325 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 22:26:36.410325 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:36.410325 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:26:36.410551 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 372/753] 10.222.0.36 () {56 vars in 1108 bytes} [Fri Jun 24 22:26:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:36.411154 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59158184-331f-4bf1-9c67-4f86082d028d None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:36.450486 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:36.480331 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0979cf-e608-4707-a491-6130edd28cff None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:36.484434 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:36.526636 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfc6484-862a-44e9-93de-2adcb3d164bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:36.527717 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfc6484-862a-44e9-93de-2adcb3d164bf None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:36.528130 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfc6484-862a-44e9-93de-2adcb3d164bf None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:36.528409 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfc6484-862a-44e9-93de-2adcb3d164bf None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:36.530480 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59158184-331f-4bf1-9c67-4f86082d028d None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:36.536308 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfc6484-862a-44e9-93de-2adcb3d164bf None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:36.537847 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfc6484-862a-44e9-93de-2adcb3d164bf None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:36.554090 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-9dfc6484-862a-44e9-93de-2adcb3d164bf None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 22:26:36.554090 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:36.554090 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:36.554090 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:36.554090 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:36.554090 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:36.554090 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:36.554090 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:36.554090 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:36.554090 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:36.554090 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:36.554090 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:36.554090 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 22:26:36.554090 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 22:26:36.554090 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 22:26:36.554090 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 22:26:36.555339 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:36.555339 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:36.555339 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 22:26:36.555339 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 22:26:36.555339 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 22:26:36.555339 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 22:26:36.555339 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:36.555339 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:36.555339 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:36.555339 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:36.555339 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:36.555339 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:36.555339 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:36.555339 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:36.555339 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:36.555339 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:36.555339 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:36.555339 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:36.556278 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:36.556278 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:36.556278 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 22:26:36.556278 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 22:26:36.556278 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 22:26:36.556278 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 22:26:36.556278 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 22:26:36.556278 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 22:26:36.556278 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 22:26:36.556278 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:26:36.556278 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 382/754] 10.222.0.36 () {56 vars in 1117 bytes} [Fri Jun 24 22:26:36 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:36.556278 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfc6484-862a-44e9-93de-2adcb3d164bf None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:36.571286 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223cf2e9-058e-4e04-8915-f184b1ad8047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:36.572316 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223cf2e9-058e-4e04-8915-f184b1ad8047 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:36.572540 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223cf2e9-058e-4e04-8915-f184b1ad8047 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:36.572816 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223cf2e9-058e-4e04-8915-f184b1ad8047 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:36.580230 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223cf2e9-058e-4e04-8915-f184b1ad8047 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:36.581668 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223cf2e9-058e-4e04-8915-f184b1ad8047 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:36.596705 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-223cf2e9-058e-4e04-8915-f184b1ad8047 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 22:26:36.596705 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:36.596705 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:36.596705 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:36.596705 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:36.596705 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:36.596705 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:36.596705 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:36.596705 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:36.596705 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:36.596705 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:36.596705 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:36.596705 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 22:26:36.596705 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 22:26:36.596705 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 22:26:36.597783 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 22:26:36.597783 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:36.597783 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:36.597783 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:36.597783 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:36.597783 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:36.597783 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:36.597783 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:36.597783 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:36.597783 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:36.597783 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:36.597783 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:36.597783 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:36.597783 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:36.597783 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:36.597783 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:36.597783 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:36.603624 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 22:26:36.603624 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 22:26:36.603624 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 22:26:36.603624 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 22:26:36.603624 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 22:26:36.603624 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 22:26:36.603624 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 22:26:36.603624 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:26:36.603624 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 373/755] 10.222.0.36 () {56 vars in 1111 bytes} [Fri Jun 24 22:26:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:36.603624 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223cf2e9-058e-4e04-8915-f184b1ad8047 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:36.665215 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfc6484-862a-44e9-93de-2adcb3d164bf None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:36.687853 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:36.702006 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe78c0a-6aa1-4340-8d10-64dd3bf7f792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:36.702804 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe78c0a-6aa1-4340-8d10-64dd3bf7f792 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:36.703101 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe78c0a-6aa1-4340-8d10-64dd3bf7f792 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:36.703408 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe78c0a-6aa1-4340-8d10-64dd3bf7f792 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:36.703916 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223cf2e9-058e-4e04-8915-f184b1ad8047 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:36.704041 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe78c0a-6aa1-4340-8d10-64dd3bf7f792 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:36.705571 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe78c0a-6aa1-4340-8d10-64dd3bf7f792 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:36.718246 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-8fe78c0a-6aa1-4340-8d10-64dd3bf7f792 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 24 22:26:36.718246 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:36.718246 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 22:26:36.718246 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 22:26:36.718246 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 22:26:36.718246 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 22:26:36.718246 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 22:26:36.718246 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 22:26:36.718246 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 24 22:26:36.718246 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:26:36.718246 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 22:26:36.718246 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:26:36.718246 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:36.718246 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:36.718246 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:36.718246 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:36.719503 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:36.719503 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:36.719503 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:36.719503 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:36.719503 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:36.719503 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:36.719503 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:36.719503 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 22:26:36.719503 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 22:26:36.719503 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 22:26:36.719503 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 22:26:36.719503 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:36.719503 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:36.719503 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:36.719503 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:36.719503 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:36.720486 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:36.720486 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:36.720486 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:36.720486 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:36.720486 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:36.720486 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:36.720486 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:36.720486 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:36.720486 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:36.720486 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:36.720486 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:36.720486 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 22:26:36.720486 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 22:26:36.720486 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 24 22:26:36.720486 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:26:36.720486 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 383/756] 10.222.0.36 () {56 vars in 1129 bytes} [Fri Jun 24 22:26:36 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:36.721511 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe78c0a-6aa1-4340-8d10-64dd3bf7f792 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:36.742667 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9404eeba-18d1-4e43-9b8d-8b2963e3f814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:36.743508 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9404eeba-18d1-4e43-9b8d-8b2963e3f814 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:36.743874 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9404eeba-18d1-4e43-9b8d-8b2963e3f814 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:36.744247 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9404eeba-18d1-4e43-9b8d-8b2963e3f814 None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:36.745067 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9404eeba-18d1-4e43-9b8d-8b2963e3f814 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:36.745467 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9404eeba-18d1-4e43-9b8d-8b2963e3f814 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:36.746925 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9404eeba-18d1-4e43-9b8d-8b2963e3f814 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:36.749602 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:36.763675 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 374/757] 10.222.0.36 () {56 vars in 1109 bytes} [Fri Jun 24 22:26:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:36.763675 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9404eeba-18d1-4e43-9b8d-8b2963e3f814 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:36.828342 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe78c0a-6aa1-4340-8d10-64dd3bf7f792 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:36.863946 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a09a32-f2dd-4e24-8bea-4dc6cf44b6b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:36.865772 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a09a32-f2dd-4e24-8bea-4dc6cf44b6b6 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:36.866825 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a09a32-f2dd-4e24-8bea-4dc6cf44b6b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:36.867787 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a09a32-f2dd-4e24-8bea-4dc6cf44b6b6 None admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:36.868719 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a09a32-f2dd-4e24-8bea-4dc6cf44b6b6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:36.869123 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a09a32-f2dd-4e24-8bea-4dc6cf44b6b6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:36.869753 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9404eeba-18d1-4e43-9b8d-8b2963e3f814 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:36.870751 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a09a32-f2dd-4e24-8bea-4dc6cf44b6b6 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:36.892767 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 384/758] 10.222.0.36 () {56 vars in 1149 bytes} [Fri Jun 24 22:26:36 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:36.892767 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a09a32-f2dd-4e24-8bea-4dc6cf44b6b6 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:36.908015 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620fb35c-d8ef-422e-b862-b72d66c28550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:36.908806 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620fb35c-d8ef-422e-b862-b72d66c28550 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:36.909188 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620fb35c-d8ef-422e-b862-b72d66c28550 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:36.909562 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620fb35c-d8ef-422e-b862-b72d66c28550 None admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:36.910446 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620fb35c-d8ef-422e-b862-b72d66c28550 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:36.910856 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620fb35c-d8ef-422e-b862-b72d66c28550 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:36.912461 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620fb35c-d8ef-422e-b862-b72d66c28550 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:36.925099 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 375/759] 10.222.0.36 () {56 vars in 1148 bytes} [Fri Jun 24 22:26:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:36.930734 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620fb35c-d8ef-422e-b862-b72d66c28550 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:36.940328 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:36.979306 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:36.995906 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a09a32-f2dd-4e24-8bea-4dc6cf44b6b6 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:37.032762 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91e25ea-bd25-4285-8b16-3e2d098f1476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:37.033454 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e25ea-bd25-4285-8b16-3e2d098f1476 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:37.033705 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e25ea-bd25-4285-8b16-3e2d098f1476 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:37.033973 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e25ea-bd25-4285-8b16-3e2d098f1476 None admin] PATH_INFO: `/v3/services` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:37.034673 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91e25ea-bd25-4285-8b16-3e2d098f1476 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:37.034977 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91e25ea-bd25-4285-8b16-3e2d098f1476 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:37.035613 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620fb35c-d8ef-422e-b862-b72d66c28550 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:37.036381 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91e25ea-bd25-4285-8b16-3e2d098f1476 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:37.041044 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 385/760] 10.222.0.36 () {56 vars in 1124 bytes} [Fri Jun 24 22:26:36 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:37.041921 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91e25ea-bd25-4285-8b16-3e2d098f1476 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:37.075357 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676db906-6277-4ba1-9081-44fecdbf95bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:37.076415 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676db906-6277-4ba1-9081-44fecdbf95bd None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:37.076701 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676db906-6277-4ba1-9081-44fecdbf95bd None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:37.076977 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676db906-6277-4ba1-9081-44fecdbf95bd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:37.083962 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676db906-6277-4ba1-9081-44fecdbf95bd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:37.085940 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676db906-6277-4ba1-9081-44fecdbf95bd None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:37.100933 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-676db906-6277-4ba1-9081-44fecdbf95bd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 22:26:37.100933 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:37.100933 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:37.100933 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:37.100933 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:37.100933 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:37.100933 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:37.100933 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:37.100933 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:37.100933 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:37.100933 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:37.100933 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:37.100933 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 22:26:37.100933 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 22:26:37.100933 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 22:26:37.102096 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 22:26:37.102096 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:37.102096 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:37.102096 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:37.102096 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:37.102096 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:37.102096 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:37.102096 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:37.102096 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:37.102096 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:37.102096 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:37.102096 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:37.102096 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:37.102096 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:37.102096 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:37.102096 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:37.102096 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:37.103230 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 22:26:37.103230 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 22:26:37.103230 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 22:26:37.103230 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 22:26:37.103230 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 22:26:37.103230 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 22:26:37.103230 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 22:26:37.103230 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:26:37.103697 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 376/761] 10.222.0.36 () {56 vars in 1111 bytes} [Fri Jun 24 22:26:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:37.104411 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676db906-6277-4ba1-9081-44fecdbf95bd None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:37.153354 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91e25ea-bd25-4285-8b16-3e2d098f1476 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:37.177908 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:37.191967 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e07a9a-c262-4a64-b947-37f8da73c38f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:37.192937 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e07a9a-c262-4a64-b947-37f8da73c38f None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:37.193229 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e07a9a-c262-4a64-b947-37f8da73c38f None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:37.193659 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e07a9a-c262-4a64-b947-37f8da73c38f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:37.214518 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:37.215109 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676db906-6277-4ba1-9081-44fecdbf95bd None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:37.250364 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4489aa19-b2e4-4bbc-bc5b-0043a72a1e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:37.251289 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4489aa19-b2e4-4bbc-bc5b-0043a72a1e5e None admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:37.251575 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4489aa19-b2e4-4bbc-bc5b-0043a72a1e5e None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:37.251855 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4489aa19-b2e4-4bbc-bc5b-0043a72a1e5e None admin] PATH_INFO: `/v3/projects/d189b31bbec0469381292d2cde3cb420/users/214d9071042c4bad886bf060a079b6e2/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:37.253800 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4489aa19-b2e4-4bbc-bc5b-0043a72a1e5e None admin] RBAC: Authorizing `identity:create_grant(project_id=d189b31bbec0469381292d2cde3cb420, user_id=214d9071042c4bad886bf060a079b6e2, role_id=1a1c43cc97a0407eb7a7c7a1333a9d4a)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:37.255242 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4489aa19-b2e4-4bbc-bc5b-0043a72a1e5e None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:37.268294 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e07a9a-c262-4a64-b947-37f8da73c38f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:37.269713 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e07a9a-c262-4a64-b947-37f8da73c38f None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:37.271740 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 377/762] 10.222.0.36 () {58 vars in 1439 bytes} [Fri Jun 24 22:26:37 2022] PUT /identity/v3/projects/d189b31bbec0469381292d2cde3cb420/users/214d9071042c4bad886bf060a079b6e2/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:26:37.273993 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4489aa19-b2e4-4bbc-bc5b-0043a72a1e5e None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:37.391422 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 386/763] 10.222.0.36 () {58 vars in 1282 bytes} [Fri Jun 24 22:26:37 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 22:26:37.392306 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e07a9a-c262-4a64-b947-37f8da73c38f None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:37.421211 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4489aa19-b2e4-4bbc-bc5b-0043a72a1e5e None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:37.445792 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:37.456049 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:37.469513 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61bde2c-4b1d-4d18-9a76-03afab434cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:37.470185 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61bde2c-4b1d-4d18-9a76-03afab434cb4 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:37.470462 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61bde2c-4b1d-4d18-9a76-03afab434cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:37.470741 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61bde2c-4b1d-4d18-9a76-03afab434cb4 None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:37.471551 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61bde2c-4b1d-4d18-9a76-03afab434cb4 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:37.471857 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61bde2c-4b1d-4d18-9a76-03afab434cb4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:37.473232 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61bde2c-4b1d-4d18-9a76-03afab434cb4 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:37.478404 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 378/764] 10.222.0.36 () {56 vars in 1124 bytes} [Fri Jun 24 22:26:37 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:37.479200 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61bde2c-4b1d-4d18-9a76-03afab434cb4 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:37.505255 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e07a9a-c262-4a64-b947-37f8da73c38f None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:37.543043 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66769d8-1ce3-47c3-9987-154cddb43d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:37.543742 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66769d8-1ce3-47c3-9987-154cddb43d54 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:37.544009 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66769d8-1ce3-47c3-9987-154cddb43d54 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:37.544295 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66769d8-1ce3-47c3-9987-154cddb43d54 None admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:37.545056 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66769d8-1ce3-47c3-9987-154cddb43d54 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:37.545366 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66769d8-1ce3-47c3-9987-154cddb43d54 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:37.546828 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66769d8-1ce3-47c3-9987-154cddb43d54 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:37.559436 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 387/765] 10.222.0.36 () {56 vars in 1148 bytes} [Fri Jun 24 22:26:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:37.560739 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e413f47-dcbe-4291-b83e-fb84daed1227 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:37.561024 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e413f47-dcbe-4291-b83e-fb84daed1227 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:37.561296 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e413f47-dcbe-4291-b83e-fb84daed1227 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:37.562665 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 388/766] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:26:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:26:37.567076 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e413f47-dcbe-4291-b83e-fb84daed1227 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:37.591441 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61bde2c-4b1d-4d18-9a76-03afab434cb4 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:37.628048 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f3f804-6a5f-4d5d-a3fa-105b3e3acd02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:37.628824 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f3f804-6a5f-4d5d-a3fa-105b3e3acd02 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:37.629110 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f3f804-6a5f-4d5d-a3fa-105b3e3acd02 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:37.629394 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f3f804-6a5f-4d5d-a3fa-105b3e3acd02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:37.641622 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f3f804-6a5f-4d5d-a3fa-105b3e3acd02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:37.643108 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f3f804-6a5f-4d5d-a3fa-105b3e3acd02 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:37.660751 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-f0f3f804-6a5f-4d5d-a3fa-105b3e3acd02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:37.660751 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:37.660751 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:37.660751 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:37.660751 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:37.660751 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:37.660751 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:37.660751 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:37.660751 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:37.660751 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:37.660751 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:37.660751 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:37.660751 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 22:26:37.660751 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 22:26:37.660751 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 22:26:37.661675 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 22:26:37.661675 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:37.661675 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:37.661675 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:37.661675 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:37.661675 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:37.661675 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:37.661675 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:37.661675 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:37.661675 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:37.661675 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:37.661675 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:37.661675 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:37.661675 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:37.661675 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:37.661675 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:37.661675 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:37.662623 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 22:26:37.662623 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 22:26:37.662623 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:37.662623 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:26:37.662623 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 379/767] 10.222.0.36 () {56 vars in 1108 bytes} [Fri Jun 24 22:26:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:37.663352 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f3f804-6a5f-4d5d-a3fa-105b3e3acd02 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:37.682666 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e413f47-dcbe-4291-b83e-fb84daed1227 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:37.693821 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:37.711111 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:37.721232 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180e20a1-c3a8-452e-814f-3353570e47d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:37.722329 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e20a1-c3a8-452e-814f-3353570e47d3 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:37.722614 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e20a1-c3a8-452e-814f-3353570e47d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:37.723035 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e20a1-c3a8-452e-814f-3353570e47d3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:37.723861 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180e20a1-c3a8-452e-814f-3353570e47d3 None admin] RBAC: Adding query filter params (interface=public, service_id=2e441a74dc3a4fbeb82e30dde0920eeb, region_id=RegionOne) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:37.724176 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180e20a1-c3a8-452e-814f-3353570e47d3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:37.725573 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180e20a1-c3a8-452e-814f-3353570e47d3 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:37.737795 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 389/768] 10.222.0.36 () {56 vars in 1251 bytes} [Fri Jun 24 22:26:37 2022] GET /identity/v3/endpoints?service_id=2e441a74dc3a4fbeb82e30dde0920eeb&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:37.737795 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1faa1-e24c-477a-8c55-b04fad46530a None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:37.737795 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1faa1-e24c-477a-8c55-b04fad46530a None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:37.737795 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1faa1-e24c-477a-8c55-b04fad46530a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:37.753898 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-04b1faa1-e24c-477a-8c55-b04fad46530a None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:26:37.755085 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-04b1faa1-e24c-477a-8c55-b04fad46530a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:26:37.777998 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f3f804-6a5f-4d5d-a3fa-105b3e3acd02 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:37.813168 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a0889a-0795-4185-ad0f-304bb84f2ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:37.813833 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a0889a-0795-4185-ad0f-304bb84f2ce1 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:37.814111 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a0889a-0795-4185-ad0f-304bb84f2ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:37.814377 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a0889a-0795-4185-ad0f-304bb84f2ce1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:37.815209 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a0889a-0795-4185-ad0f-304bb84f2ce1 None admin] RBAC: Adding query filter params (role.id=1a1c43cc97a0407eb7a7c7a1333a9d4a, scope.project.id=d189b31bbec0469381292d2cde3cb420, user.id=6b95846f7f2a453f85ddb41a5d3327f3) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:37.815679 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a0889a-0795-4185-ad0f-304bb84f2ce1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:37.817038 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a0889a-0795-4185-ad0f-304bb84f2ce1 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:37.831281 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 380/769] 10.222.0.36 () {56 vars in 1374 bytes} [Fri Jun 24 22:26:37 2022] GET /identity/v3/role_assignments?user.id=6b95846f7f2a453f85ddb41a5d3327f3&scope.project.id=d189b31bbec0469381292d2cde3cb420&role.id=1a1c43cc97a0407eb7a7c7a1333a9d4a => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:37.831281 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a0889a-0795-4185-ad0f-304bb84f2ce1 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:37.834528 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 390/770] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:26:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 22:26:37.835504 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b1faa1-e24c-477a-8c55-b04fad46530a None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:37.953108 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b1faa1-e24c-477a-8c55-b04fad46530a None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:37.984888 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a0889a-0795-4185-ad0f-304bb84f2ce1 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:37.986143 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:37.991300 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3993962-889b-4ad7-a93a-fb16dadfa65d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:37.992267 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:37.993477 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3993962-889b-4ad7-a93a-fb16dadfa65d None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:37.993811 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3993962-889b-4ad7-a93a-fb16dadfa65d None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:37.994410 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3993962-889b-4ad7-a93a-fb16dadfa65d None admin] PATH_INFO: `/v3/services` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:37.995317 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3993962-889b-4ad7-a93a-fb16dadfa65d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:37.997300 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3993962-889b-4ad7-a93a-fb16dadfa65d None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:38.004075 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 391/771] 10.222.0.36 () {56 vars in 1087 bytes} [Fri Jun 24 22:26:37 2022] GET /identity/v3/services => generated 772 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:38.005184 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3993962-889b-4ad7-a93a-fb16dadfa65d None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:38.032912 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba116c4-1f98-4a1b-8636-4ea4dc353318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:38.033894 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba116c4-1f98-4a1b-8636-4ea4dc353318 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:38.034274 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba116c4-1f98-4a1b-8636-4ea4dc353318 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:38.034650 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba116c4-1f98-4a1b-8636-4ea4dc353318 None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:38.035484 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba116c4-1f98-4a1b-8636-4ea4dc353318 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:38.036378 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba116c4-1f98-4a1b-8636-4ea4dc353318 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:38.037374 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba116c4-1f98-4a1b-8636-4ea4dc353318 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:38.050893 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 381/772] 10.222.0.36 () {56 vars in 1109 bytes} [Fri Jun 24 22:26:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:38.056575 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba116c4-1f98-4a1b-8636-4ea4dc353318 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:38.132054 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3993962-889b-4ad7-a93a-fb16dadfa65d None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:38.175802 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba116c4-1f98-4a1b-8636-4ea4dc353318 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:38.215319 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de85ce03-0cc6-47ac-9809-9cc1983b24aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:38.216905 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de85ce03-0cc6-47ac-9809-9cc1983b24aa None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:38.217808 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de85ce03-0cc6-47ac-9809-9cc1983b24aa None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:38.218283 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de85ce03-0cc6-47ac-9809-9cc1983b24aa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:38.226682 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de85ce03-0cc6-47ac-9809-9cc1983b24aa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:38.229247 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de85ce03-0cc6-47ac-9809-9cc1983b24aa None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:38.246759 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-de85ce03-0cc6-47ac-9809-9cc1983b24aa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 22:26:38.246759 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:38.246759 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:38.246759 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:38.246759 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:38.246759 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:38.246759 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:38.246759 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:38.246759 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:38.246759 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:38.246759 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:38.246759 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:38.246759 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 22:26:38.246759 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 22:26:38.246759 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 22:26:38.247727 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 22:26:38.247727 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:38.247727 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:38.247727 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:38.247727 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:38.247727 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:38.247727 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:38.247727 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:38.247727 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:38.247727 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:38.247727 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:38.247727 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:38.247727 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:38.247727 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:38.247727 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:38.247727 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:38.247727 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:38.248595 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 22:26:38.248595 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 22:26:38.248595 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 22:26:38.248595 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 22:26:38.248595 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 22:26:38.248595 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 22:26:38.248595 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 22:26:38.248595 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:26:38.251378 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eb0b73-8794-45ad-ac05-0ec6d8ce20c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:38.252696 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eb0b73-8794-45ad-ac05-0ec6d8ce20c6 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:38.253121 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eb0b73-8794-45ad-ac05-0ec6d8ce20c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:38.253541 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eb0b73-8794-45ad-ac05-0ec6d8ce20c6 None admin] PATH_INFO: `/v3/services/network` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:38.254348 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9eb0b73-8794-45ad-ac05-0ec6d8ce20c6 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:38.256247 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9eb0b73-8794-45ad-ac05-0ec6d8ce20c6 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:38.261107 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 382/773] 10.222.0.36 () {56 vars in 1111 bytes} [Fri Jun 24 22:26:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:38.267218 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de85ce03-0cc6-47ac-9809-9cc1983b24aa None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:38.269879 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-f9eb0b73-8794-45ad-ac05-0ec6d8ce20c6 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 24 22:26:38.269879 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:38.269879 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 22:26:38.269879 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 22:26:38.269879 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 22:26:38.269879 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 22:26:38.269879 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 22:26:38.269879 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 22:26:38.269879 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 24 22:26:38.269879 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:26:38.269879 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 22:26:38.269879 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:26:38.269879 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:38.269879 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:38.269879 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:38.269879 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:38.269879 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:38.271020 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:38.271020 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:38.271020 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:38.271020 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:38.271020 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:38.271020 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:38.271020 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 22:26:38.271020 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 22:26:38.271020 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 22:26:38.271020 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 22:26:38.271020 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:38.271020 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:38.271020 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:38.271020 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:38.271020 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:38.271020 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:38.272087 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:38.272087 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:38.272087 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:38.272087 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:38.272087 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:38.272087 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:38.272087 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:38.272087 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:38.272087 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:38.272087 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:38.272087 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 22:26:38.272087 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 22:26:38.272087 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 24 22:26:38.272087 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:26:38.279533 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 392/774] 10.222.0.36 () {56 vars in 1111 bytes} [Fri Jun 24 22:26:38 2022] GET /identity/v3/services/network => generated 88 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:38.287755 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eb0b73-8794-45ad-ac05-0ec6d8ce20c6 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:38.306652 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:38.333683 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:38.418238 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de85ce03-0cc6-47ac-9809-9cc1983b24aa None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:38.428411 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eb0b73-8794-45ad-ac05-0ec6d8ce20c6 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:38.486033 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3057856a-1272-4b69-84fa-3c5d325d84cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:38.486627 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3057856a-1272-4b69-84fa-3c5d325d84cc None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:38.486915 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3057856a-1272-4b69-84fa-3c5d325d84cc None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:38.487197 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3057856a-1272-4b69-84fa-3c5d325d84cc None admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:38.488024 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3057856a-1272-4b69-84fa-3c5d325d84cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:38.488337 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3057856a-1272-4b69-84fa-3c5d325d84cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:38.489796 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3057856a-1272-4b69-84fa-3c5d325d84cc None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:38.503669 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 383/775] 10.222.0.36 () {56 vars in 1148 bytes} [Fri Jun 24 22:26:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 22:26:38.513296 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0763c517-a33c-4a27-b1fc-fefee0fea171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:38.513984 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0763c517-a33c-4a27-b1fc-fefee0fea171 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:38.514264 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0763c517-a33c-4a27-b1fc-fefee0fea171 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:38.514537 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0763c517-a33c-4a27-b1fc-fefee0fea171 None admin] PATH_INFO: `/v3/services` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:38.514955 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3057856a-1272-4b69-84fa-3c5d325d84cc None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:38.515273 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0763c517-a33c-4a27-b1fc-fefee0fea171 None admin] RBAC: Adding query filter params (name=network) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:38.515699 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0763c517-a33c-4a27-b1fc-fefee0fea171 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:38.517218 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0763c517-a33c-4a27-b1fc-fefee0fea171 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:38.530702 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 393/776] 10.222.0.36 () {56 vars in 1112 bytes} [Fri Jun 24 22:26:38 2022] GET /identity/v3/services?name=network => generated 124 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:38.536118 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0763c517-a33c-4a27-b1fc-fefee0fea171 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:38.603920 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:38.620315 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3057856a-1272-4b69-84fa-3c5d325d84cc None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:38.661139 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53fe79d-04b1-4642-a560-9e190785cd52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:38.661807 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53fe79d-04b1-4642-a560-9e190785cd52 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:38.662091 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53fe79d-04b1-4642-a560-9e190785cd52 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:38.662368 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53fe79d-04b1-4642-a560-9e190785cd52 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:38.663201 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53fe79d-04b1-4642-a560-9e190785cd52 None admin] RBAC: Adding query filter params (role.id=3265c7c44fb144a0a56467ded2a39413, scope.project.id=d189b31bbec0469381292d2cde3cb420, user.id=542ea2e5a8114792836d0cdfd36b4c51) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:38.663537 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53fe79d-04b1-4642-a560-9e190785cd52 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:38.665011 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53fe79d-04b1-4642-a560-9e190785cd52 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:38.675809 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 384/777] 10.222.0.36 () {56 vars in 1374 bytes} [Fri Jun 24 22:26:38 2022] GET /identity/v3/role_assignments?user.id=542ea2e5a8114792836d0cdfd36b4c51&scope.project.id=d189b31bbec0469381292d2cde3cb420&role.id=3265c7c44fb144a0a56467ded2a39413 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:38.723826 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:38.731602 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0763c517-a33c-4a27-b1fc-fefee0fea171 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:38.780356 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dce1124-4ff4-4617-a496-b294d30d3764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:38.780952 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dce1124-4ff4-4617-a496-b294d30d3764 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:38.781234 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dce1124-4ff4-4617-a496-b294d30d3764 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:38.781509 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dce1124-4ff4-4617-a496-b294d30d3764 None admin] PATH_INFO: `/v3/services` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:38.782217 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dce1124-4ff4-4617-a496-b294d30d3764 None admin] RBAC: Adding query filter params (type=network) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:38.782549 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dce1124-4ff4-4617-a496-b294d30d3764 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:38.783928 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dce1124-4ff4-4617-a496-b294d30d3764 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:38.796321 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 394/778] 10.222.0.36 () {56 vars in 1112 bytes} [Fri Jun 24 22:26:38 2022] GET /identity/v3/services?type=network => generated 350 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 22:26:38.801939 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53fe79d-04b1-4642-a560-9e190785cd52 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:38.922815 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53fe79d-04b1-4642-a560-9e190785cd52 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:38.959348 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a0a20f-0190-4967-be8a-fe39bd16a5da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:38.960032 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a0a20f-0190-4967-be8a-fe39bd16a5da None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:38.960316 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a0a20f-0190-4967-be8a-fe39bd16a5da None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:38.960593 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a0a20f-0190-4967-be8a-fe39bd16a5da None admin] PATH_INFO: `/v3/endpoints` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:38.961532 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a0a20f-0190-4967-be8a-fe39bd16a5da None admin] RBAC: Adding query filter params (interface=public, service_id=ca5a88d4ded74173a142608e0816d77a, region_id=RegionOne) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:38.961849 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a0a20f-0190-4967-be8a-fe39bd16a5da None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:38.963311 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a0a20f-0190-4967-be8a-fe39bd16a5da None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:38.972416 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 385/779] 10.222.0.36 () {56 vars in 1251 bytes} [Fri Jun 24 22:26:38 2022] GET /identity/v3/endpoints?service_id=ca5a88d4ded74173a142608e0816d77a&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:38.980376 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dce1124-4ff4-4617-a496-b294d30d3764 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:39.117810 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dce1124-4ff4-4617-a496-b294d30d3764 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:39.167980 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2239c61-b5b9-4337-8707-9726f15a5954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:39.168665 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2239c61-b5b9-4337-8707-9726f15a5954 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:39.168954 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2239c61-b5b9-4337-8707-9726f15a5954 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:39.169227 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2239c61-b5b9-4337-8707-9726f15a5954 None admin] PATH_INFO: `/v3/services` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:39.169909 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2239c61-b5b9-4337-8707-9726f15a5954 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:39.171323 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2239c61-b5b9-4337-8707-9726f15a5954 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:39.177055 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 395/780] 10.222.0.36 () {56 vars in 1087 bytes} [Fri Jun 24 22:26:38 2022] GET /identity/v3/services => generated 772 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:39.447571 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723535f7-1106-4a0d-a1ff-dc53162c6ead None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:39.448071 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723535f7-1106-4a0d-a1ff-dc53162c6ead None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:39.448146 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723535f7-1106-4a0d-a1ff-dc53162c6ead None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:39.449821 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 386/781] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:26:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:26:39.455313 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d4060a-28ac-471a-a861-f33d85efe483 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:39.455711 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d4060a-28ac-471a-a861-f33d85efe483 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:39.455877 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d4060a-28ac-471a-a861-f33d85efe483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:39.474359 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-d7d4060a-28ac-471a-a861-f33d85efe483 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:26:39.475572 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-d7d4060a-28ac-471a-a861-f33d85efe483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:26:39.496058 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:39.565601 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 396/782] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:26:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 22:26:39.620659 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723535f7-1106-4a0d-a1ff-dc53162c6ead None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:39.656845 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:39.769032 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723535f7-1106-4a0d-a1ff-dc53162c6ead None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:39.812215 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2a6dce-568f-40cf-8f48-eaa39e34cc98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:39.813012 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a6dce-568f-40cf-8f48-eaa39e34cc98 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:39.813295 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a6dce-568f-40cf-8f48-eaa39e34cc98 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:39.813567 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a6dce-568f-40cf-8f48-eaa39e34cc98 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:39.836246 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2a6dce-568f-40cf-8f48-eaa39e34cc98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 22:26:39.843961 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-ca2a6dce-568f-40cf-8f48-eaa39e34cc98 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 22:26:39.843961 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:39.843961 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:39.843961 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:39.843961 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:39.843961 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:39.843961 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:39.843961 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:39.843961 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:39.843961 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:39.843961 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:39.843961 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:39.843961 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 22:26:39.843961 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 22:26:39.843961 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 22:26:39.843961 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 22:26:39.844859 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 22:26:39.844859 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 22:26:39.844859 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 22:26:39.844859 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 22:26:39.844859 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:39.844859 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:39.844859 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:39.844859 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:39.844859 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:39.844859 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:39.844859 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:39.844859 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:39.844859 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:39.844859 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:39.844859 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:39.844859 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:39.845681 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:39.845681 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:39.845681 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:39.845681 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:39.845681 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 22:26:39.845681 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 22:26:39.845681 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 22:26:39.845681 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 22:26:39.845681 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 22:26:39.845681 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 22:26:39.845681 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 22:26:39.845681 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:26:39.845681 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 387/783] 10.222.0.36 () {56 vars in 1096 bytes} [Fri Jun 24 22:26:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:39.851319 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d4060a-28ac-471a-a861-f33d85efe483 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:39.995406 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d4060a-28ac-471a-a861-f33d85efe483 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:40.041600 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0bab6b-e996-439e-a1bb-575f3565f7cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:40.042201 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0bab6b-e996-439e-a1bb-575f3565f7cb None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:40.042486 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0bab6b-e996-439e-a1bb-575f3565f7cb None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:40.042762 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0bab6b-e996-439e-a1bb-575f3565f7cb None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:40.043542 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0bab6b-e996-439e-a1bb-575f3565f7cb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:40.043852 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0bab6b-e996-439e-a1bb-575f3565f7cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:40.045238 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0bab6b-e996-439e-a1bb-575f3565f7cb None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:40.059029 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 397/784] 10.222.0.36 () {56 vars in 1099 bytes} [Fri Jun 24 22:26:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:40.064458 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2a6dce-568f-40cf-8f48-eaa39e34cc98 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:40.161987 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:40.197369 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2a6dce-568f-40cf-8f48-eaa39e34cc98 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:40.237844 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fc853d-e7de-4b5e-9a94-62f043368b26 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:40.238482 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fc853d-e7de-4b5e-9a94-62f043368b26 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:40.238963 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fc853d-e7de-4b5e-9a94-62f043368b26 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:40.240828 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 398/785] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:26:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:26:40.243889 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8914e02c-14aa-42af-bff3-e9b265da487d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:40.244700 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8914e02c-14aa-42af-bff3-e9b265da487d None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:40.244983 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8914e02c-14aa-42af-bff3-e9b265da487d None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:40.245261 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8914e02c-14aa-42af-bff3-e9b265da487d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:40.247219 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59842016-5ba2-4bd1-8bf5-f6f92f3acbf9 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:40.247746 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59842016-5ba2-4bd1-8bf5-f6f92f3acbf9 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:40.248239 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59842016-5ba2-4bd1-8bf5-f6f92f3acbf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:40.257810 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8914e02c-14aa-42af-bff3-e9b265da487d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:40.259659 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8914e02c-14aa-42af-bff3-e9b265da487d None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:40.266761 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-59842016-5ba2-4bd1-8bf5-f6f92f3acbf9 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:26:40.268249 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-59842016-5ba2-4bd1-8bf5-f6f92f3acbf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:26:40.280218 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:40.294994 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-8914e02c-14aa-42af-bff3-e9b265da487d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:40.294994 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:40.294994 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:40.294994 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:40.294994 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:40.294994 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:40.294994 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:40.294994 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:40.294994 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:40.294994 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:40.294994 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:40.294994 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:40.294994 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 22:26:40.294994 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 22:26:40.294994 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 22:26:40.295936 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 22:26:40.295936 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:40.295936 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:40.295936 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:40.295936 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:40.295936 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:40.295936 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:40.295936 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:40.295936 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:40.295936 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:40.295936 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:40.295936 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:40.295936 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:40.295936 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:40.295936 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:40.295936 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:40.295936 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:40.296816 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 22:26:40.296816 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 22:26:40.296816 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:40.296816 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:26:40.296816 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 388/786] 10.222.0.36 () {56 vars in 1108 bytes} [Fri Jun 24 22:26:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:40.300349 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8914e02c-14aa-42af-bff3-e9b265da487d None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:40.401650 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 399/787] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:26:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 22:26:40.440728 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59842016-5ba2-4bd1-8bf5-f6f92f3acbf9 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:40.441076 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8914e02c-14aa-42af-bff3-e9b265da487d None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:40.467999 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:40.483483 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8849e3cf-d669-4a76-9a22-43bb44f9ef9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:40.484209 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8849e3cf-d669-4a76-9a22-43bb44f9ef9f None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:40.484496 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8849e3cf-d669-4a76-9a22-43bb44f9ef9f None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:40.484771 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8849e3cf-d669-4a76-9a22-43bb44f9ef9f None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:40.485503 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8849e3cf-d669-4a76-9a22-43bb44f9ef9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:40.485809 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8849e3cf-d669-4a76-9a22-43bb44f9ef9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:40.487304 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8849e3cf-d669-4a76-9a22-43bb44f9ef9f None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:40.515274 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 389/788] 10.222.0.36 () {56 vars in 1109 bytes} [Fri Jun 24 22:26:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 22:26:40.518057 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8849e3cf-d669-4a76-9a22-43bb44f9ef9f None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:40.585042 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59842016-5ba2-4bd1-8bf5-f6f92f3acbf9 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:40.647198 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6004b8fe-037f-455a-ac3b-005a7bc666f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:40.648506 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6004b8fe-037f-455a-ac3b-005a7bc666f7 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:40.650279 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6004b8fe-037f-455a-ac3b-005a7bc666f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:40.650859 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6004b8fe-037f-455a-ac3b-005a7bc666f7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:40.670505 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6004b8fe-037f-455a-ac3b-005a7bc666f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 22:26:40.687300 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-6004b8fe-037f-455a-ac3b-005a7bc666f7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 22:26:40.687300 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:40.687300 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:40.687300 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:40.687300 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:40.687300 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:40.687300 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:40.687300 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:40.687300 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:40.687300 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:40.687300 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:40.687300 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:40.687300 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 22:26:40.687300 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 22:26:40.687300 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 22:26:40.687300 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 22:26:40.688442 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 22:26:40.688442 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 22:26:40.688442 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 22:26:40.688442 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 22:26:40.688442 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:40.688442 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:40.688442 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:40.688442 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:40.688442 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:40.688442 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:40.688442 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:40.688442 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:40.688442 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:40.688442 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:40.688442 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:40.688442 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:40.689266 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:40.689266 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:40.689266 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:40.689266 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:40.689266 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 22:26:40.689266 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 22:26:40.689266 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 22:26:40.689266 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 22:26:40.689266 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 22:26:40.689266 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 22:26:40.689266 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 22:26:40.689266 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:26:40.689266 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 400/789] 10.222.0.36 () {56 vars in 1096 bytes} [Fri Jun 24 22:26:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:40.689266 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2374e8-c6c0-4c3e-9c11-45637d9a9fef None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:40.690016 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2374e8-c6c0-4c3e-9c11-45637d9a9fef None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:40.690016 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2374e8-c6c0-4c3e-9c11-45637d9a9fef None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:40.690016 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 401/790] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:26:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:26:40.690016 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2374e8-c6c0-4c3e-9c11-45637d9a9fef None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:40.698263 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8849e3cf-d669-4a76-9a22-43bb44f9ef9f None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:40.700236 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:40.734433 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836e445b-9883-42b0-8db6-92f895e55174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:40.735278 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e445b-9883-42b0-8db6-92f895e55174 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:40.735557 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e445b-9883-42b0-8db6-92f895e55174 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:40.735831 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e445b-9883-42b0-8db6-92f895e55174 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:40.744041 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836e445b-9883-42b0-8db6-92f895e55174 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:40.745546 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836e445b-9883-42b0-8db6-92f895e55174 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:40.761207 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-836e445b-9883-42b0-8db6-92f895e55174 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 24 22:26:40.761207 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:40.761207 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:40.761207 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:40.761207 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:40.761207 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:40.761207 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:40.761207 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:40.761207 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:40.761207 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:40.761207 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:40.761207 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:40.761207 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 22:26:40.761207 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 22:26:40.761207 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 22:26:40.761207 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 22:26:40.763349 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:40.763349 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:40.763349 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 22:26:40.763349 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 22:26:40.763349 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 22:26:40.763349 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 22:26:40.763349 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:40.763349 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:40.763349 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:40.763349 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:40.763349 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:40.763349 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:40.763349 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:40.763349 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:40.763349 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:40.763349 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:40.763349 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:40.763349 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:40.765570 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:40.765570 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:40.765570 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 22:26:40.765570 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 22:26:40.765570 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 22:26:40.765570 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 22:26:40.765570 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 22:26:40.765570 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 22:26:40.765570 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 24 22:26:40.765570 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:26:40.765570 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 390/791] 10.222.0.36 () {56 vars in 1093 bytes} [Fri Jun 24 22:26:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 22:26:40.765570 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0826fd-c9a8-40c7-812d-d96c8e7e1cec None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:40.765570 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0826fd-c9a8-40c7-812d-d96c8e7e1cec None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:40.767468 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0826fd-c9a8-40c7-812d-d96c8e7e1cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:40.793603 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-2d0826fd-c9a8-40c7-812d-d96c8e7e1cec None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:26:40.795275 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-2d0826fd-c9a8-40c7-812d-d96c8e7e1cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:26:40.797599 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2374e8-c6c0-4c3e-9c11-45637d9a9fef None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:40.832122 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530c4bc3-2caa-43dd-a7b3-3a8edf0d61dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:40.832796 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c4bc3-2caa-43dd-a7b3-3a8edf0d61dd None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:40.833093 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c4bc3-2caa-43dd-a7b3-3a8edf0d61dd None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:40.833353 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c4bc3-2caa-43dd-a7b3-3a8edf0d61dd None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:40.834108 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530c4bc3-2caa-43dd-a7b3-3a8edf0d61dd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:40.834416 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530c4bc3-2caa-43dd-a7b3-3a8edf0d61dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:40.836020 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530c4bc3-2caa-43dd-a7b3-3a8edf0d61dd None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:40.844368 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:40.845597 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 402/792] 10.222.0.36 () {56 vars in 1099 bytes} [Fri Jun 24 22:26:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:40.846173 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530c4bc3-2caa-43dd-a7b3-3a8edf0d61dd None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:40.872941 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 391/793] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:26:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 22:26:40.884298 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0826fd-c9a8-40c7-812d-d96c8e7e1cec None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:40.914020 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:40.948860 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530c4bc3-2caa-43dd-a7b3-3a8edf0d61dd None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:40.984428 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabd0fdd-688d-4dd2-978b-e48bbf39e4c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:40.985128 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabd0fdd-688d-4dd2-978b-e48bbf39e4c9 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:40.985414 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabd0fdd-688d-4dd2-978b-e48bbf39e4c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:40.985696 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabd0fdd-688d-4dd2-978b-e48bbf39e4c9 None admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:40.986548 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabd0fdd-688d-4dd2-978b-e48bbf39e4c9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:40.986862 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabd0fdd-688d-4dd2-978b-e48bbf39e4c9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:40.988418 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabd0fdd-688d-4dd2-978b-e48bbf39e4c9 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:40.996919 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0826fd-c9a8-40c7-812d-d96c8e7e1cec None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:41.011271 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 403/794] 10.222.0.36 () {56 vars in 1133 bytes} [Fri Jun 24 22:26:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:41.011271 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabd0fdd-688d-4dd2-978b-e48bbf39e4c9 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:41.038172 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e208792-3dcd-4648-9d4c-8a0df5b1673e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:41.039688 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e208792-3dcd-4648-9d4c-8a0df5b1673e None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:41.040198 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e208792-3dcd-4648-9d4c-8a0df5b1673e None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:41.040677 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e208792-3dcd-4648-9d4c-8a0df5b1673e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:41.051691 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e208792-3dcd-4648-9d4c-8a0df5b1673e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:41.053483 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e208792-3dcd-4648-9d4c-8a0df5b1673e None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:41.072942 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-9e208792-3dcd-4648-9d4c-8a0df5b1673e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:41.072942 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:41.072942 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:41.072942 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:41.072942 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:41.072942 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:41.072942 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:41.072942 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:41.072942 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:41.072942 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:41.072942 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:41.072942 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:41.072942 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 22:26:41.072942 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 22:26:41.072942 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 22:26:41.073857 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 22:26:41.073857 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:41.073857 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:41.073857 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:41.073857 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:41.073857 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:41.073857 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:41.073857 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:41.073857 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:41.073857 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:41.073857 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:41.073857 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:41.073857 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:41.073857 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:41.073857 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:41.073857 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:41.073857 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:41.074714 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 22:26:41.074714 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 22:26:41.074714 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:41.074714 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:26:41.077027 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 392/795] 10.222.0.36 () {56 vars in 1108 bytes} [Fri Jun 24 22:26:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:41.078198 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e208792-3dcd-4648-9d4c-8a0df5b1673e None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:41.113448 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabd0fdd-688d-4dd2-978b-e48bbf39e4c9 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:41.139711 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:41.140909 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:41.150653 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf16f3d0-f1b7-4161-b97f-4576b4d69c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:41.151758 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf16f3d0-f1b7-4161-b97f-4576b4d69c5d None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:41.152095 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf16f3d0-f1b7-4161-b97f-4576b4d69c5d None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:41.152378 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf16f3d0-f1b7-4161-b97f-4576b4d69c5d None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:41.153037 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf16f3d0-f1b7-4161-b97f-4576b4d69c5d None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:41.154637 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf16f3d0-f1b7-4161-b97f-4576b4d69c5d None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:41.168244 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-cf16f3d0-f1b7-4161-b97f-4576b4d69c5d None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 24 22:26:41.168244 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:41.168244 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 22:26:41.168244 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 22:26:41.168244 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 22:26:41.168244 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 22:26:41.168244 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 22:26:41.168244 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 22:26:41.168244 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 24 22:26:41.168244 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:26:41.168244 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 22:26:41.168244 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:26:41.168244 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:41.168244 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:41.168244 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:41.168244 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:41.169233 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:41.169233 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:41.169233 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:41.169233 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:41.169233 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:41.169233 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:41.169233 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:41.169233 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 22:26:41.169233 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 22:26:41.169233 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 22:26:41.169233 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 22:26:41.169233 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:41.169233 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:41.169233 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:41.169233 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:41.169233 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:41.170062 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:41.170062 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:41.170062 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:41.170062 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:41.170062 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:41.170062 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:41.170062 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:41.170062 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:41.170062 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:41.170062 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:41.170062 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:41.170062 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 22:26:41.170062 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 22:26:41.170062 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 24 22:26:41.170062 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:26:41.170062 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 404/796] 10.222.0.36 () {56 vars in 1129 bytes} [Fri Jun 24 22:26:41 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:41.170895 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf16f3d0-f1b7-4161-b97f-4576b4d69c5d None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:41.192478 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e208792-3dcd-4648-9d4c-8a0df5b1673e None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:41.229622 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76dc48c-8c6f-43b9-aaee-8520cd0ecb09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:41.230633 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76dc48c-8c6f-43b9-aaee-8520cd0ecb09 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:41.231062 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76dc48c-8c6f-43b9-aaee-8520cd0ecb09 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:41.231518 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76dc48c-8c6f-43b9-aaee-8520cd0ecb09 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:41.277348 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf16f3d0-f1b7-4161-b97f-4576b4d69c5d None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:41.308317 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76dc48c-8c6f-43b9-aaee-8520cd0ecb09 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:41.310324 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76dc48c-8c6f-43b9-aaee-8520cd0ecb09 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:41.313276 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1757c101-e964-42cf-a807-5018dde73f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:41.314593 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1757c101-e964-42cf-a807-5018dde73f9f None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:41.314593 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1757c101-e964-42cf-a807-5018dde73f9f None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:41.314785 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1757c101-e964-42cf-a807-5018dde73f9f None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:41.315605 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1757c101-e964-42cf-a807-5018dde73f9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:41.315982 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1757c101-e964-42cf-a807-5018dde73f9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:41.317447 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1757c101-e964-42cf-a807-5018dde73f9f None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:41.331028 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 405/797] 10.222.0.36 () {56 vars in 1109 bytes} [Fri Jun 24 22:26:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:41.331850 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1757c101-e964-42cf-a807-5018dde73f9f None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:41.383779 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:41.385558 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:41.421512 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 393/798] 10.222.0.36 () {58 vars in 1282 bytes} [Fri Jun 24 22:26:41 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 22:26:41.422371 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76dc48c-8c6f-43b9-aaee-8520cd0ecb09 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:41.444920 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1757c101-e964-42cf-a807-5018dde73f9f None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:41.484714 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356bff9f-47d5-4592-8123-95883b1348e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:41.485701 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356bff9f-47d5-4592-8123-95883b1348e5 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:41.486125 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356bff9f-47d5-4592-8123-95883b1348e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:41.486410 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356bff9f-47d5-4592-8123-95883b1348e5 None admin] PATH_INFO: `/v3/services` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:41.487123 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356bff9f-47d5-4592-8123-95883b1348e5 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:41.487461 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356bff9f-47d5-4592-8123-95883b1348e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:41.488897 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356bff9f-47d5-4592-8123-95883b1348e5 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:41.494191 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 406/799] 10.222.0.36 () {56 vars in 1124 bytes} [Fri Jun 24 22:26:41 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:41.494944 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf37933-e833-4213-bd71-e3df1a00df04 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:41.495231 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf37933-e833-4213-bd71-e3df1a00df04 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:41.495541 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf37933-e833-4213-bd71-e3df1a00df04 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:41.500857 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 407/800] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:26:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:26:41.500857 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf37933-e833-4213-bd71-e3df1a00df04 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:41.531067 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76dc48c-8c6f-43b9-aaee-8520cd0ecb09 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:41.559754 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:41.568997 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f73c28-de75-47cc-89b6-ffdb84eaec58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:41.569805 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f73c28-de75-47cc-89b6-ffdb84eaec58 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:41.570199 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f73c28-de75-47cc-89b6-ffdb84eaec58 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:41.570534 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f73c28-de75-47cc-89b6-ffdb84eaec58 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:41.578286 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f73c28-de75-47cc-89b6-ffdb84eaec58 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:41.580025 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f73c28-de75-47cc-89b6-ffdb84eaec58 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:41.596063 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-b0f73c28-de75-47cc-89b6-ffdb84eaec58 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 24 22:26:41.596063 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:41.596063 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:41.596063 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:41.596063 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:41.596063 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:41.596063 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:41.596063 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:41.596063 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:41.596063 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:41.596063 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:41.596063 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:41.596063 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 22:26:41.596063 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 22:26:41.596063 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 22:26:41.596063 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 22:26:41.597107 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:41.597107 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:41.597107 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 22:26:41.597107 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 22:26:41.597107 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 22:26:41.597107 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 22:26:41.597107 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:41.597107 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:41.597107 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:41.597107 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:41.597107 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:41.597107 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:41.597107 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:41.597107 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:41.597107 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:41.597107 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:41.597107 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:41.597107 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:41.598018 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:41.598018 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:41.598018 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 22:26:41.598018 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 22:26:41.598018 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 22:26:41.598018 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 22:26:41.598018 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 22:26:41.598018 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 22:26:41.598018 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 24 22:26:41.598018 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:26:41.598018 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 394/801] 10.222.0.36 () {56 vars in 1096 bytes} [Fri Jun 24 22:26:41 2022] GET /identity/v3/users/swift => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:41.598597 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f73c28-de75-47cc-89b6-ffdb84eaec58 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:41.612145 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf37933-e833-4213-bd71-e3df1a00df04 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:41.627295 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:41.652786 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad7720d-a554-4813-9447-5f1f95696813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:41.653452 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7720d-a554-4813-9447-5f1f95696813 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:41.653790 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7720d-a554-4813-9447-5f1f95696813 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:41.654058 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7720d-a554-4813-9447-5f1f95696813 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:41.665669 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad7720d-a554-4813-9447-5f1f95696813 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:41.667275 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad7720d-a554-4813-9447-5f1f95696813 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:41.686569 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-fad7720d-a554-4813-9447-5f1f95696813 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:41.686569 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:41.686569 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:41.686569 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:41.686569 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:41.686569 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:41.686569 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:41.686569 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:41.686569 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:41.686569 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:41.686569 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:41.686569 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:41.686569 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 22:26:41.686569 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 22:26:41.686569 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 22:26:41.687816 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 22:26:41.687816 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:41.687816 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:41.687816 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:41.687816 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:41.687816 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:41.687816 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:41.687816 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:41.687816 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:41.687816 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:41.687816 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:41.687816 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:41.687816 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:41.687816 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:41.687816 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:41.687816 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:41.687816 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:41.688715 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 22:26:41.688715 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 22:26:41.688715 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:41.688715 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:26:41.688715 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 408/802] 10.222.0.36 () {56 vars in 1108 bytes} [Fri Jun 24 22:26:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:41.689274 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb556b8-a132-44da-802d-289e5baa9246 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:41.689370 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb556b8-a132-44da-802d-289e5baa9246 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:41.689646 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb556b8-a132-44da-802d-289e5baa9246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:41.706943 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-1bb556b8-a132-44da-802d-289e5baa9246 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:26:41.708179 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-1bb556b8-a132-44da-802d-289e5baa9246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:26:41.708303 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f73c28-de75-47cc-89b6-ffdb84eaec58 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:41.743842 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dff1cba-4dd8-4ee2-9370-5e34db0ef365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:41.744506 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dff1cba-4dd8-4ee2-9370-5e34db0ef365 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:41.744769 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dff1cba-4dd8-4ee2-9370-5e34db0ef365 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:41.745043 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dff1cba-4dd8-4ee2-9370-5e34db0ef365 None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:41.745751 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dff1cba-4dd8-4ee2-9370-5e34db0ef365 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:41.746053 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dff1cba-4dd8-4ee2-9370-5e34db0ef365 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:41.747482 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dff1cba-4dd8-4ee2-9370-5e34db0ef365 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:41.752342 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 395/803] 10.222.0.36 () {56 vars in 1124 bytes} [Fri Jun 24 22:26:41 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:41.753123 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dff1cba-4dd8-4ee2-9370-5e34db0ef365 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:41.777460 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 409/804] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:26:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 22:26:41.778392 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb556b8-a132-44da-802d-289e5baa9246 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:41.820836 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:41.867143 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dff1cba-4dd8-4ee2-9370-5e34db0ef365 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:41.871989 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:41.878499 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb556b8-a132-44da-802d-289e5baa9246 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:41.901372 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a94d4b-5ad1-422d-8eea-059c03463259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:41.902104 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a94d4b-5ad1-422d-8eea-059c03463259 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:41.902390 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a94d4b-5ad1-422d-8eea-059c03463259 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:41.902694 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a94d4b-5ad1-422d-8eea-059c03463259 None admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:41.903621 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a94d4b-5ad1-422d-8eea-059c03463259 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:41.903865 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a94d4b-5ad1-422d-8eea-059c03463259 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:41.905305 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a94d4b-5ad1-422d-8eea-059c03463259 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:41.914038 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834bc621-7f8c-442d-a608-0a03cd0f9baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:41.914991 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834bc621-7f8c-442d-a608-0a03cd0f9baf None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:41.915275 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834bc621-7f8c-442d-a608-0a03cd0f9baf None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:41.915562 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834bc621-7f8c-442d-a608-0a03cd0f9baf None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:41.916285 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834bc621-7f8c-442d-a608-0a03cd0f9baf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:41.916590 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834bc621-7f8c-442d-a608-0a03cd0f9baf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:41.917987 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834bc621-7f8c-442d-a608-0a03cd0f9baf None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:41.922456 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 396/805] 10.222.0.36 () {56 vars in 1135 bytes} [Fri Jun 24 22:26:41 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:41.923748 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cf6b25-c0de-4735-9733-e7cbdd06019c None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:41.924036 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cf6b25-c0de-4735-9733-e7cbdd06019c None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:41.924303 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cf6b25-c0de-4735-9733-e7cbdd06019c None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:41.925533 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 397/806] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:26:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:26:41.926228 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cf6b25-c0de-4735-9733-e7cbdd06019c None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:41.933450 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 410/807] 10.222.0.36 () {56 vars in 1109 bytes} [Fri Jun 24 22:26:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:41.934276 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834bc621-7f8c-442d-a608-0a03cd0f9baf None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:42.028234 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cf6b25-c0de-4735-9733-e7cbdd06019c None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:42.038689 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:42.039849 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834bc621-7f8c-442d-a608-0a03cd0f9baf None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:42.062020 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69248c62-576b-4ddd-979c-f1309a8143a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:42.062677 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69248c62-576b-4ddd-979c-f1309a8143a3 None admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:42.062956 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69248c62-576b-4ddd-979c-f1309a8143a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:42.063226 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69248c62-576b-4ddd-979c-f1309a8143a3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:42.063994 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69248c62-576b-4ddd-979c-f1309a8143a3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:42.065400 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69248c62-576b-4ddd-979c-f1309a8143a3 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:42.073297 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413493b2-017a-49af-bc39-2c4bf1da6513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:42.074089 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413493b2-017a-49af-bc39-2c4bf1da6513 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:42.074367 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413493b2-017a-49af-bc39-2c4bf1da6513 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:42.074640 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413493b2-017a-49af-bc39-2c4bf1da6513 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:42.085648 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413493b2-017a-49af-bc39-2c4bf1da6513 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 22:26:42.088522 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 398/808] 10.222.0.36 () {60 vars in 1144 bytes} [Fri Jun 24 22:26:41 2022] POST /identity/v3/endpoints => generated 346 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:26:42.089333 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69248c62-576b-4ddd-979c-f1309a8143a3 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:42.093439 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-413493b2-017a-49af-bc39-2c4bf1da6513 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 22:26:42.093439 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:42.093439 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:42.093439 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:42.093439 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:42.093439 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:42.093439 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:42.093439 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:42.093439 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:42.093439 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:42.093439 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:42.093439 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:42.093439 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 22:26:42.093439 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 22:26:42.093439 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 22:26:42.093439 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 22:26:42.094462 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 22:26:42.094462 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 22:26:42.094462 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 22:26:42.094462 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 22:26:42.094462 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:42.094462 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:42.094462 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:42.094462 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:42.094462 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:42.094462 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:42.094462 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:42.094462 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:42.094462 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:42.094462 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:42.094462 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:42.094462 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:42.095322 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:42.095322 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:42.095322 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:42.095322 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:42.095322 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 22:26:42.095322 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 22:26:42.095322 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 22:26:42.095322 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 22:26:42.095322 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 22:26:42.095322 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 22:26:42.095322 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 22:26:42.095322 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:26:42.095322 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 411/809] 10.222.0.36 () {56 vars in 1102 bytes} [Fri Jun 24 22:26:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:42.096506 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7535f6-4ad3-453b-841f-1e98eb7f7e45 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:42.096796 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7535f6-4ad3-453b-841f-1e98eb7f7e45 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:42.097119 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7535f6-4ad3-453b-841f-1e98eb7f7e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:42.116466 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-7f7535f6-4ad3-453b-841f-1e98eb7f7e45 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:26:42.117849 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-7f7535f6-4ad3-453b-841f-1e98eb7f7e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:26:42.130246 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:42.203998 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 412/810] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:26:42 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 22:26:42.203998 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7535f6-4ad3-453b-841f-1e98eb7f7e45 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:42.238653 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69248c62-576b-4ddd-979c-f1309a8143a3 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:42.280355 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f386086f-2f1e-4f88-af18-ce29da3a3309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:42.281168 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f386086f-2f1e-4f88-af18-ce29da3a3309 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:42.281450 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f386086f-2f1e-4f88-af18-ce29da3a3309 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:42.281724 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f386086f-2f1e-4f88-af18-ce29da3a3309 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:42.293948 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f386086f-2f1e-4f88-af18-ce29da3a3309 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:42.295487 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f386086f-2f1e-4f88-af18-ce29da3a3309 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:42.313158 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-f386086f-2f1e-4f88-af18-ce29da3a3309 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:42.313158 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:42.313158 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:42.313158 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:42.313158 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:42.313158 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:42.313158 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:42.313158 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:42.313158 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:42.313158 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:42.313158 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:42.313158 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:42.313158 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 22:26:42.313158 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 22:26:42.313158 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 22:26:42.314235 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 22:26:42.314235 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:42.314235 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:42.314235 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:42.314235 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:42.314235 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:42.314235 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:42.314235 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:42.314235 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:42.314235 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:42.314235 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:42.314235 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:42.314235 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:42.314235 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:42.314235 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:42.314235 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:42.314235 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:42.315273 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 22:26:42.315273 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 22:26:42.315273 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:42.315273 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:26:42.315273 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 399/811] 10.222.0.36 () {56 vars in 1108 bytes} [Fri Jun 24 22:26:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:42.315576 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f386086f-2f1e-4f88-af18-ce29da3a3309 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:42.331849 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7535f6-4ad3-453b-841f-1e98eb7f7e45 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:42.339586 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:42.368635 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f69cb6-0359-4c56-996b-4f1d87e10601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:42.369544 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f69cb6-0359-4c56-996b-4f1d87e10601 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:42.369895 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f69cb6-0359-4c56-996b-4f1d87e10601 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:42.370254 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f69cb6-0359-4c56-996b-4f1d87e10601 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:42.377812 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f69cb6-0359-4c56-996b-4f1d87e10601 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:42.379438 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f69cb6-0359-4c56-996b-4f1d87e10601 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:42.396930 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-b6f69cb6-0359-4c56-996b-4f1d87e10601 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 22:26:42.396930 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:42.396930 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:42.396930 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:42.396930 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:42.396930 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:42.396930 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:42.396930 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:42.396930 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:42.396930 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:42.396930 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:42.396930 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:42.396930 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 22:26:42.396930 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 22:26:42.396930 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 22:26:42.398021 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 22:26:42.398021 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:42.398021 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:42.398021 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:42.398021 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:42.398021 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:42.398021 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:42.398021 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:42.398021 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:42.398021 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:42.398021 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:42.398021 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:42.398021 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:42.398021 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:42.398021 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:42.398021 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:42.398021 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:42.399297 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 22:26:42.399297 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 22:26:42.399297 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 22:26:42.399297 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 22:26:42.399297 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 22:26:42.399297 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 22:26:42.399297 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 22:26:42.399297 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:26:42.403410 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 413/812] 10.222.0.36 () {56 vars in 1111 bytes} [Fri Jun 24 22:26:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:42.404256 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f69cb6-0359-4c56-996b-4f1d87e10601 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:42.407320 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:42.444569 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f386086f-2f1e-4f88-af18-ce29da3a3309 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:42.480516 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd9a1a9-e8c9-4fef-b53f-e73a75375480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:42.481288 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd9a1a9-e8c9-4fef-b53f-e73a75375480 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:42.481399 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd9a1a9-e8c9-4fef-b53f-e73a75375480 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:42.481632 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd9a1a9-e8c9-4fef-b53f-e73a75375480 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:42.482376 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd9a1a9-e8c9-4fef-b53f-e73a75375480 None admin] RBAC: Adding query filter params (name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:42.482680 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd9a1a9-e8c9-4fef-b53f-e73a75375480 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:42.484121 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd9a1a9-e8c9-4fef-b53f-e73a75375480 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:42.497294 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 400/813] 10.222.0.36 () {56 vars in 1103 bytes} [Fri Jun 24 22:26:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:42.498163 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd9a1a9-e8c9-4fef-b53f-e73a75375480 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:42.516728 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f69cb6-0359-4c56-996b-4f1d87e10601 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:42.550358 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcccb597-e984-47c7-aef9-17faec27d1b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:42.551164 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcccb597-e984-47c7-aef9-17faec27d1b7 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:42.551479 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcccb597-e984-47c7-aef9-17faec27d1b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:42.551753 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcccb597-e984-47c7-aef9-17faec27d1b7 None admin] PATH_INFO: `/v3/services/network` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:42.552415 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcccb597-e984-47c7-aef9-17faec27d1b7 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:42.553792 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcccb597-e984-47c7-aef9-17faec27d1b7 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:42.566396 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-dcccb597-e984-47c7-aef9-17faec27d1b7 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 24 22:26:42.566396 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:42.566396 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 22:26:42.566396 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 22:26:42.566396 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 22:26:42.566396 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 22:26:42.566396 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 22:26:42.566396 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 22:26:42.566396 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 24 22:26:42.566396 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:26:42.566396 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 22:26:42.566396 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:26:42.566396 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:42.566396 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:42.566396 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:42.566396 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:42.566396 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:42.567448 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:42.567448 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:42.567448 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:42.567448 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:42.567448 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:42.567448 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:42.567448 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 22:26:42.567448 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 22:26:42.567448 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 22:26:42.567448 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 22:26:42.567448 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:42.567448 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:42.567448 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:42.567448 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:42.567448 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:42.567448 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:42.568281 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:42.568281 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:42.568281 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:42.568281 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:42.568281 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:42.568281 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:42.568281 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:42.568281 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:42.568281 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:42.568281 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:42.568281 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 22:26:42.568281 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 22:26:42.568281 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 24 22:26:42.568281 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:26:42.568281 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 414/814] 10.222.0.36 () {56 vars in 1111 bytes} [Fri Jun 24 22:26:42 2022] GET /identity/v3/services/network => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:42.569052 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcccb597-e984-47c7-aef9-17faec27d1b7 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:42.598435 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:42.619899 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd9a1a9-e8c9-4fef-b53f-e73a75375480 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:42.636079 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:42.656102 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534afb05-46cc-4903-a16a-fdda301c23ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:42.656763 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534afb05-46cc-4903-a16a-fdda301c23ee None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:42.657043 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534afb05-46cc-4903-a16a-fdda301c23ee None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:42.657312 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534afb05-46cc-4903-a16a-fdda301c23ee None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:42.658019 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534afb05-46cc-4903-a16a-fdda301c23ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:42.658320 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534afb05-46cc-4903-a16a-fdda301c23ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:42.659727 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534afb05-46cc-4903-a16a-fdda301c23ee None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:42.676199 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 401/815] 10.222.0.36 () {56 vars in 1109 bytes} [Fri Jun 24 22:26:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:42.676400 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcccb597-e984-47c7-aef9-17faec27d1b7 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:42.676496 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534afb05-46cc-4903-a16a-fdda301c23ee None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:42.713290 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948f7631-d755-40fd-8638-1cbe3f7ee961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:42.713931 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948f7631-d755-40fd-8638-1cbe3f7ee961 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:42.714210 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948f7631-d755-40fd-8638-1cbe3f7ee961 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:42.714490 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948f7631-d755-40fd-8638-1cbe3f7ee961 None admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:42.715289 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948f7631-d755-40fd-8638-1cbe3f7ee961 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:42.715599 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948f7631-d755-40fd-8638-1cbe3f7ee961 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:42.717036 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948f7631-d755-40fd-8638-1cbe3f7ee961 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:42.729736 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 415/816] 10.222.0.36 () {56 vars in 1148 bytes} [Fri Jun 24 22:26:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:42.732195 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948f7631-d755-40fd-8638-1cbe3f7ee961 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:42.783936 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534afb05-46cc-4903-a16a-fdda301c23ee None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:42.818957 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ad7e84-3863-4152-8854-417fd8c4a10b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:42.819774 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ad7e84-3863-4152-8854-417fd8c4a10b None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:42.820052 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ad7e84-3863-4152-8854-417fd8c4a10b None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:42.820326 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ad7e84-3863-4152-8854-417fd8c4a10b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:42.829353 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:42.832402 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ad7e84-3863-4152-8854-417fd8c4a10b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:42.833669 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ad7e84-3863-4152-8854-417fd8c4a10b None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:42.837429 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948f7631-d755-40fd-8638-1cbe3f7ee961 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:42.852437 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-44ad7e84-3863-4152-8854-417fd8c4a10b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:42.852437 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:42.852437 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:42.852437 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:42.852437 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:42.852437 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:42.852437 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:42.852437 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:42.852437 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:42.852437 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:42.852437 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:42.852437 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:42.852437 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 22:26:42.852437 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 22:26:42.852437 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 22:26:42.853531 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 22:26:42.853531 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:42.853531 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:42.853531 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:42.853531 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:42.853531 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:42.853531 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:42.853531 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:42.853531 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:42.853531 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:42.853531 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:42.853531 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:42.853531 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:42.853531 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:42.853531 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:42.853531 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:42.853531 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:42.854614 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 22:26:42.854614 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 22:26:42.854614 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:42.854614 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:26:42.858243 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 402/817] 10.222.0.36 () {56 vars in 1108 bytes} [Fri Jun 24 22:26:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:42.859078 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ad7e84-3863-4152-8854-417fd8c4a10b None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:42.866388 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:42.876562 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdf56a2-fa34-4c35-9ec4-abcb8256a142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:42.877354 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf56a2-fa34-4c35-9ec4-abcb8256a142 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:42.877778 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf56a2-fa34-4c35-9ec4-abcb8256a142 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:42.878056 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf56a2-fa34-4c35-9ec4-abcb8256a142 None admin] PATH_INFO: `/v3/services` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:42.880371 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdf56a2-fa34-4c35-9ec4-abcb8256a142 None admin] RBAC: Adding query filter params (name=network) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:42.880371 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdf56a2-fa34-4c35-9ec4-abcb8256a142 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:42.881323 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdf56a2-fa34-4c35-9ec4-abcb8256a142 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:42.887226 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 416/818] 10.222.0.36 () {56 vars in 1112 bytes} [Fri Jun 24 22:26:42 2022] GET /identity/v3/services?name=network => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:42.888587 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdf56a2-fa34-4c35-9ec4-abcb8256a142 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:42.965844 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ad7e84-3863-4152-8854-417fd8c4a10b None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:42.995603 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdf56a2-fa34-4c35-9ec4-abcb8256a142 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:43.000334 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5e70a1-5aa3-4a54-b9f3-86a0ba60b6fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:43.001227 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5e70a1-5aa3-4a54-b9f3-86a0ba60b6fa None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:43.001603 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5e70a1-5aa3-4a54-b9f3-86a0ba60b6fa None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:43.001968 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5e70a1-5aa3-4a54-b9f3-86a0ba60b6fa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:43.009472 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5e70a1-5aa3-4a54-b9f3-86a0ba60b6fa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:43.011043 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5e70a1-5aa3-4a54-b9f3-86a0ba60b6fa None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:43.024861 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-3a5e70a1-5aa3-4a54-b9f3-86a0ba60b6fa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 22:26:43.024861 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:43.024861 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:43.024861 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:43.024861 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:43.024861 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:43.024861 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:43.024861 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:43.024861 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:43.024861 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:43.024861 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:43.024861 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:43.024861 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 22:26:43.024861 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 22:26:43.024861 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 22:26:43.025864 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 22:26:43.025864 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:43.025864 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:43.025864 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:43.025864 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:43.025864 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:43.025864 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:43.025864 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:43.025864 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:43.025864 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:43.025864 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:43.025864 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:43.025864 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:43.025864 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:43.025864 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:43.025864 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:43.025864 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:43.026891 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 22:26:43.026891 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 22:26:43.026891 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 22:26:43.026891 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 22:26:43.026891 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 22:26:43.026891 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 22:26:43.026891 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 22:26:43.026891 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:26:43.030781 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 403/819] 10.222.0.36 () {56 vars in 1111 bytes} [Fri Jun 24 22:26:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:43.031643 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5e70a1-5aa3-4a54-b9f3-86a0ba60b6fa None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:43.037718 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d67fc1-d68d-4dbe-a220-272b1e985272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:43.038574 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d67fc1-d68d-4dbe-a220-272b1e985272 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:43.039001 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d67fc1-d68d-4dbe-a220-272b1e985272 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:43.039548 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d67fc1-d68d-4dbe-a220-272b1e985272 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:43.041068 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d67fc1-d68d-4dbe-a220-272b1e985272 None admin] RBAC: Adding query filter params (role.id=1a1c43cc97a0407eb7a7c7a1333a9d4a, scope.project.id=d189b31bbec0469381292d2cde3cb420, user.id=214d9071042c4bad886bf060a079b6e2) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:43.041532 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d67fc1-d68d-4dbe-a220-272b1e985272 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:43.043592 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d67fc1-d68d-4dbe-a220-272b1e985272 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:43.051893 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 417/820] 10.222.0.36 () {56 vars in 1374 bytes} [Fri Jun 24 22:26:42 2022] GET /identity/v3/role_assignments?user.id=214d9071042c4bad886bf060a079b6e2&scope.project.id=d189b31bbec0469381292d2cde3cb420&role.id=1a1c43cc97a0407eb7a7c7a1333a9d4a => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:43.052824 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d67fc1-d68d-4dbe-a220-272b1e985272 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:43.088358 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:43.123940 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:43.151640 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5e70a1-5aa3-4a54-b9f3-86a0ba60b6fa None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:43.184948 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d67fc1-d68d-4dbe-a220-272b1e985272 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:43.194002 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f487c8d-2174-4706-a9c1-2cb06436f521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:43.194994 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f487c8d-2174-4706-a9c1-2cb06436f521 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:43.195484 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f487c8d-2174-4706-a9c1-2cb06436f521 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:43.196702 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f487c8d-2174-4706-a9c1-2cb06436f521 None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:43.197529 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f487c8d-2174-4706-a9c1-2cb06436f521 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:43.197845 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f487c8d-2174-4706-a9c1-2cb06436f521 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:43.199435 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f487c8d-2174-4706-a9c1-2cb06436f521 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:43.219590 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 404/821] 10.222.0.36 () {56 vars in 1109 bytes} [Fri Jun 24 22:26:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:43.219590 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f487c8d-2174-4706-a9c1-2cb06436f521 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:43.235511 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb9004c-da26-4f33-8ed1-6ffe976f178c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:43.236962 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb9004c-da26-4f33-8ed1-6ffe976f178c None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:43.237528 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb9004c-da26-4f33-8ed1-6ffe976f178c None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:43.238043 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb9004c-da26-4f33-8ed1-6ffe976f178c None admin] PATH_INFO: `/v3/services` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:43.239156 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb9004c-da26-4f33-8ed1-6ffe976f178c None admin] RBAC: Adding query filter params (type=network) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:43.239627 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb9004c-da26-4f33-8ed1-6ffe976f178c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:43.241558 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb9004c-da26-4f33-8ed1-6ffe976f178c None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:43.250358 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 418/822] 10.222.0.36 () {56 vars in 1112 bytes} [Fri Jun 24 22:26:43 2022] GET /identity/v3/services?type=network => generated 350 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:43.251234 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb9004c-da26-4f33-8ed1-6ffe976f178c None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:43.337159 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f487c8d-2174-4706-a9c1-2cb06436f521 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:43.350682 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:43.374423 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1185a561-c2bf-45d6-acb9-086978a82fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:43.375082 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1185a561-c2bf-45d6-acb9-086978a82fd9 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:43.375417 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1185a561-c2bf-45d6-acb9-086978a82fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:43.375669 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1185a561-c2bf-45d6-acb9-086978a82fd9 None admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:43.376466 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1185a561-c2bf-45d6-acb9-086978a82fd9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:43.376779 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1185a561-c2bf-45d6-acb9-086978a82fd9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:43.378190 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1185a561-c2bf-45d6-acb9-086978a82fd9 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:43.382861 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb9004c-da26-4f33-8ed1-6ffe976f178c None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:43.391210 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 405/823] 10.222.0.36 () {56 vars in 1148 bytes} [Fri Jun 24 22:26:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:43.392035 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1185a561-c2bf-45d6-acb9-086978a82fd9 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:43.404553 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:43.431563 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94144531-cdcb-48a8-882f-ca057d0eaa13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:43.432972 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94144531-cdcb-48a8-882f-ca057d0eaa13 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:43.434391 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94144531-cdcb-48a8-882f-ca057d0eaa13 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:43.434871 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94144531-cdcb-48a8-882f-ca057d0eaa13 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:43.447706 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94144531-cdcb-48a8-882f-ca057d0eaa13 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:43.450265 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94144531-cdcb-48a8-882f-ca057d0eaa13 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:43.471516 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-94144531-cdcb-48a8-882f-ca057d0eaa13 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 22:26:43.471516 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:43.471516 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:43.471516 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:43.471516 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:43.471516 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:43.471516 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:43.471516 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:43.471516 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:43.471516 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:43.471516 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:43.471516 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:43.471516 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 22:26:43.471516 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 22:26:43.471516 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 22:26:43.471516 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 22:26:43.472484 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:43.472484 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:43.472484 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 22:26:43.472484 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 22:26:43.472484 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 22:26:43.472484 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 22:26:43.472484 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:43.472484 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:43.472484 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:43.472484 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:43.472484 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:43.472484 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:43.472484 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:43.472484 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:43.472484 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:43.472484 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:43.472484 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:43.472484 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:43.473421 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:43.473421 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:43.473421 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 22:26:43.473421 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 22:26:43.473421 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 22:26:43.473421 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 22:26:43.473421 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 22:26:43.473421 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 22:26:43.473421 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 22:26:43.473421 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:26:43.477170 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 419/824] 10.222.0.36 () {56 vars in 1117 bytes} [Fri Jun 24 22:26:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:43.478137 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94144531-cdcb-48a8-882f-ca057d0eaa13 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:43.591754 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94144531-cdcb-48a8-882f-ca057d0eaa13 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:43.627272 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c278738-2883-4954-9c62-f3c0833759e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:43.628295 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c278738-2883-4954-9c62-f3c0833759e1 None admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:43.628576 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c278738-2883-4954-9c62-f3c0833759e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:43.628958 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c278738-2883-4954-9c62-f3c0833759e1 None admin] PATH_INFO: `/v3/projects/d189b31bbec0469381292d2cde3cb420/users/6b95846f7f2a453f85ddb41a5d3327f3/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:43.631222 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c278738-2883-4954-9c62-f3c0833759e1 None admin] RBAC: Authorizing `identity:create_grant(project_id=d189b31bbec0469381292d2cde3cb420, user_id=6b95846f7f2a453f85ddb41a5d3327f3, role_id=1a1c43cc97a0407eb7a7c7a1333a9d4a)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:43.632459 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1185a561-c2bf-45d6-acb9-086978a82fd9 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:43.632975 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c278738-2883-4954-9c62-f3c0833759e1 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:43.655438 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 420/825] 10.222.0.36 () {58 vars in 1439 bytes} [Fri Jun 24 22:26:43 2022] PUT /identity/v3/projects/d189b31bbec0469381292d2cde3cb420/users/6b95846f7f2a453f85ddb41a5d3327f3/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:26:43.656623 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c278738-2883-4954-9c62-f3c0833759e1 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:43.710326 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6095b9-e0f2-41e9-9721-ea3d7d0b7275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:43.711059 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6095b9-e0f2-41e9-9721-ea3d7d0b7275 None admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:43.712131 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6095b9-e0f2-41e9-9721-ea3d7d0b7275 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:43.712401 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6095b9-e0f2-41e9-9721-ea3d7d0b7275 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:43.713196 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6095b9-e0f2-41e9-9721-ea3d7d0b7275 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:43.714694 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6095b9-e0f2-41e9-9721-ea3d7d0b7275 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:43.727460 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:43.762748 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 406/826] 10.222.0.36 () {60 vars in 1144 bytes} [Fri Jun 24 22:26:43 2022] POST /identity/v3/endpoints => generated 327 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:26:43.825749 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c278738-2883-4954-9c62-f3c0833759e1 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:43.876227 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f115aae2-d8e7-4df3-aee9-29b614331916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:43.877312 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f115aae2-d8e7-4df3-aee9-29b614331916 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:43.877795 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f115aae2-d8e7-4df3-aee9-29b614331916 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:43.878336 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f115aae2-d8e7-4df3-aee9-29b614331916 None admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:43.879416 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f115aae2-d8e7-4df3-aee9-29b614331916 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:43.879933 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f115aae2-d8e7-4df3-aee9-29b614331916 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:43.881938 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f115aae2-d8e7-4df3-aee9-29b614331916 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:43.902214 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 421/827] 10.222.0.36 () {56 vars in 1149 bytes} [Fri Jun 24 22:26:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:43.908220 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6095b9-e0f2-41e9-9721-ea3d7d0b7275 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:43.948589 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:44.028073 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6095b9-e0f2-41e9-9721-ea3d7d0b7275 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:44.065472 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7016f1-3cf5-4fb9-a996-ff24f38678f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:44.066278 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7016f1-3cf5-4fb9-a996-ff24f38678f6 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:44.066555 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7016f1-3cf5-4fb9-a996-ff24f38678f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:44.066831 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7016f1-3cf5-4fb9-a996-ff24f38678f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:44.077788 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7016f1-3cf5-4fb9-a996-ff24f38678f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:44.079274 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7016f1-3cf5-4fb9-a996-ff24f38678f6 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:44.097920 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-0c7016f1-3cf5-4fb9-a996-ff24f38678f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:44.097920 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:44.097920 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:44.097920 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:44.097920 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:44.097920 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:44.097920 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:44.097920 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:44.097920 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:44.097920 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:44.097920 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:44.097920 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:44.097920 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 22:26:44.097920 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 22:26:44.097920 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 22:26:44.098858 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 22:26:44.098858 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:44.098858 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:44.098858 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:44.098858 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:44.098858 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:44.098858 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:44.098858 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:44.098858 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:44.098858 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:44.098858 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:44.098858 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:44.098858 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:44.098858 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:44.098858 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:44.098858 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:44.098858 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:44.099743 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 22:26:44.099743 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 22:26:44.099743 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:44.099743 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:26:44.099743 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 407/828] 10.222.0.36 () {56 vars in 1108 bytes} [Fri Jun 24 22:26:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:44.105743 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f115aae2-d8e7-4df3-aee9-29b614331916 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:44.215059 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3061606-33c5-41f2-8218-9381c161937a None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:44.215287 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3061606-33c5-41f2-8218-9381c161937a None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:44.215577 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3061606-33c5-41f2-8218-9381c161937a None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:44.217225 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 408/829] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:26:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:26:44.218399 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:44.222948 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4144b697-be75-405e-95ad-721d89baf05e None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:44.223241 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4144b697-be75-405e-95ad-721d89baf05e None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:44.223546 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4144b697-be75-405e-95ad-721d89baf05e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:44.230556 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f115aae2-d8e7-4df3-aee9-29b614331916 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:44.248232 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-4144b697-be75-405e-95ad-721d89baf05e None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:26:44.249788 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-4144b697-be75-405e-95ad-721d89baf05e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:26:44.270785 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325205aa-cef4-4abe-8c3f-4328a512c1f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:44.271892 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325205aa-cef4-4abe-8c3f-4328a512c1f0 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:44.272174 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325205aa-cef4-4abe-8c3f-4328a512c1f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:44.272444 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325205aa-cef4-4abe-8c3f-4328a512c1f0 None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:44.273309 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325205aa-cef4-4abe-8c3f-4328a512c1f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:44.274036 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325205aa-cef4-4abe-8c3f-4328a512c1f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:44.275624 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325205aa-cef4-4abe-8c3f-4328a512c1f0 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:44.294985 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 422/830] 10.222.0.36 () {56 vars in 1109 bytes} [Fri Jun 24 22:26:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:44.296318 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325205aa-cef4-4abe-8c3f-4328a512c1f0 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:44.331449 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 409/831] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:26:44 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 22:26:44.345947 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4144b697-be75-405e-95ad-721d89baf05e None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:44.360770 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:44.420371 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325205aa-cef4-4abe-8c3f-4328a512c1f0 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:44.466276 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4144b697-be75-405e-95ad-721d89baf05e None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:44.470019 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba559df-6791-4189-8c4d-b0a2b1c4b013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:44.471010 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba559df-6791-4189-8c4d-b0a2b1c4b013 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:44.471430 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba559df-6791-4189-8c4d-b0a2b1c4b013 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:44.471805 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba559df-6791-4189-8c4d-b0a2b1c4b013 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:44.480400 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba559df-6791-4189-8c4d-b0a2b1c4b013 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:44.482054 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba559df-6791-4189-8c4d-b0a2b1c4b013 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:44.497449 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-2ba559df-6791-4189-8c4d-b0a2b1c4b013 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 22:26:44.497449 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:44.497449 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:44.497449 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:44.497449 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:44.497449 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:44.497449 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:44.497449 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:44.497449 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:44.497449 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:44.497449 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:44.497449 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:44.497449 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 22:26:44.497449 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 22:26:44.497449 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 22:26:44.498513 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 22:26:44.498513 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:44.498513 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:44.498513 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:44.498513 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:44.498513 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:44.498513 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:44.498513 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:44.498513 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:44.498513 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:44.498513 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:44.498513 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:44.498513 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:44.498513 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:44.498513 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:44.498513 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:44.498513 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:44.499423 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 22:26:44.499423 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 22:26:44.499423 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 22:26:44.499423 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 22:26:44.499423 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 22:26:44.499423 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 22:26:44.499423 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 22:26:44.499423 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:26:44.499845 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 423/832] 10.222.0.36 () {56 vars in 1111 bytes} [Fri Jun 24 22:26:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:44.505877 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba559df-6791-4189-8c4d-b0a2b1c4b013 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:44.511549 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2765d32-821e-4b69-a926-03e840234618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:44.512174 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2765d32-821e-4b69-a926-03e840234618 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:44.512454 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2765d32-821e-4b69-a926-03e840234618 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:44.512726 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2765d32-821e-4b69-a926-03e840234618 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:44.513429 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2765d32-821e-4b69-a926-03e840234618 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:44.514800 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2765d32-821e-4b69-a926-03e840234618 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:44.524899 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:44.527703 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-e2765d32-821e-4b69-a926-03e840234618 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 24 22:26:44.527703 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:44.527703 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 22:26:44.527703 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 22:26:44.527703 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 22:26:44.527703 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 22:26:44.527703 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 22:26:44.527703 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 22:26:44.527703 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 24 22:26:44.527703 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:26:44.527703 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 22:26:44.527703 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:26:44.527703 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:44.527703 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:44.527703 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:44.527703 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:44.527703 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:44.529007 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:44.529007 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:44.529007 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:44.529007 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:44.529007 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:44.529007 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:44.529007 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 22:26:44.529007 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 22:26:44.529007 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 22:26:44.529007 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 22:26:44.529007 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:44.529007 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:44.529007 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:44.529007 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:44.529007 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:44.529007 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:44.529835 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:44.529835 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:44.529835 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:44.529835 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:44.529835 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:44.529835 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:44.529835 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:44.529835 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:44.529835 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:44.529835 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:44.529835 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 22:26:44.529835 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 22:26:44.529835 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 24 22:26:44.529835 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:26:44.534045 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 410/833] 10.222.0.36 () {56 vars in 1114 bytes} [Fri Jun 24 22:26:44 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 22:26:44.534982 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2765d32-821e-4b69-a926-03e840234618 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:44.617418 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:44.644367 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2765d32-821e-4b69-a926-03e840234618 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:44.646222 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba559df-6791-4189-8c4d-b0a2b1c4b013 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:44.678532 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1ee7f8-4368-4513-b394-056c9ad0db98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:44.679261 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1ee7f8-4368-4513-b394-056c9ad0db98 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:44.679557 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1ee7f8-4368-4513-b394-056c9ad0db98 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:44.680051 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1ee7f8-4368-4513-b394-056c9ad0db98 None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:44.680781 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1ee7f8-4368-4513-b394-056c9ad0db98 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:44.681061 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1ee7f8-4368-4513-b394-056c9ad0db98 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:44.682439 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1ee7f8-4368-4513-b394-056c9ad0db98 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:44.690645 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd6d1f2-bbeb-4bd7-b779-2247392aa464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:44.691644 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 411/834] 10.222.0.36 () {56 vars in 1114 bytes} [Fri Jun 24 22:26:44 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:44.692265 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd6d1f2-bbeb-4bd7-b779-2247392aa464 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:44.692473 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1ee7f8-4368-4513-b394-056c9ad0db98 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:44.692922 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd6d1f2-bbeb-4bd7-b779-2247392aa464 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:44.693382 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd6d1f2-bbeb-4bd7-b779-2247392aa464 None admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:44.694349 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd6d1f2-bbeb-4bd7-b779-2247392aa464 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:44.695125 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd6d1f2-bbeb-4bd7-b779-2247392aa464 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:44.697734 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd6d1f2-bbeb-4bd7-b779-2247392aa464 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:44.718059 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 424/835] 10.222.0.36 () {56 vars in 1148 bytes} [Fri Jun 24 22:26:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:44.720123 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd6d1f2-bbeb-4bd7-b779-2247392aa464 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:44.799453 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1ee7f8-4368-4513-b394-056c9ad0db98 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:44.814747 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:44.841175 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd62959-c5db-4bd5-9213-8777bfc81546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:44.842787 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd62959-c5db-4bd5-9213-8777bfc81546 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:44.843354 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd62959-c5db-4bd5-9213-8777bfc81546 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:44.844062 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd62959-c5db-4bd5-9213-8777bfc81546 None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:44.845622 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd62959-c5db-4bd5-9213-8777bfc81546 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:44.846123 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd62959-c5db-4bd5-9213-8777bfc81546 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:44.847366 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd6d1f2-bbeb-4bd7-b779-2247392aa464 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:44.847943 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd62959-c5db-4bd5-9213-8777bfc81546 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:44.854636 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 412/836] 10.222.0.36 () {56 vars in 1114 bytes} [Fri Jun 24 22:26:44 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:44.891267 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2b7f2c-4edc-4d24-9280-d91205c27d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:44.892557 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2b7f2c-4edc-4d24-9280-d91205c27d95 None admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:44.893034 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2b7f2c-4edc-4d24-9280-d91205c27d95 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:44.893500 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2b7f2c-4edc-4d24-9280-d91205c27d95 None admin] PATH_INFO: `/v3/projects/d189b31bbec0469381292d2cde3cb420/users/542ea2e5a8114792836d0cdfd36b4c51/roles/3265c7c44fb144a0a56467ded2a39413` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:44.911826 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2b7f2c-4edc-4d24-9280-d91205c27d95 None admin] RBAC: Authorizing `identity:create_grant(project_id=d189b31bbec0469381292d2cde3cb420, user_id=542ea2e5a8114792836d0cdfd36b4c51, role_id=3265c7c44fb144a0a56467ded2a39413)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:44.913712 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2b7f2c-4edc-4d24-9280-d91205c27d95 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:44.935503 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 425/837] 10.222.0.36 () {58 vars in 1439 bytes} [Fri Jun 24 22:26:44 2022] PUT /identity/v3/projects/d189b31bbec0469381292d2cde3cb420/users/542ea2e5a8114792836d0cdfd36b4c51/roles/3265c7c44fb144a0a56467ded2a39413 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:26:45.408985 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a466723-a701-428b-96bb-f62a84195f8c None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:45.409378 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a466723-a701-428b-96bb-f62a84195f8c None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:45.409557 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a466723-a701-428b-96bb-f62a84195f8c None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:45.411238 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 413/838] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:26:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:26:45.417014 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7987c749-6497-4df4-adfc-bd90961605dc None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:45.417313 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7987c749-6497-4df4-adfc-bd90961605dc None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:45.417597 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7987c749-6497-4df4-adfc-bd90961605dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:45.436037 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-7987c749-6497-4df4-adfc-bd90961605dc None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:26:45.437257 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-7987c749-6497-4df4-adfc-bd90961605dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:26:45.519088 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 426/839] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:26:45 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 22:26:45.542864 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a466723-a701-428b-96bb-f62a84195f8c None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:45.546157 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:45.669739 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a466723-a701-428b-96bb-f62a84195f8c None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:45.709859 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8596463-0312-407f-930d-bef48c2d2b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:45.710946 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8596463-0312-407f-930d-bef48c2d2b22 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:45.711060 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8596463-0312-407f-930d-bef48c2d2b22 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:45.711363 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8596463-0312-407f-930d-bef48c2d2b22 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:45.712031 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8596463-0312-407f-930d-bef48c2d2b22 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:45.713417 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8596463-0312-407f-930d-bef48c2d2b22 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:45.727290 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-c8596463-0312-407f-930d-bef48c2d2b22 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 24 22:26:45.727290 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:45.727290 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 22:26:45.727290 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 22:26:45.727290 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 22:26:45.727290 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 22:26:45.727290 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 22:26:45.727290 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 22:26:45.727290 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 24 22:26:45.727290 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:26:45.727290 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 22:26:45.727290 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:26:45.727290 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:45.727290 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:45.727290 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:45.727290 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:45.728282 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:45.728282 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:45.728282 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:45.728282 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:45.728282 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:45.728282 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:45.728282 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:45.728282 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 22:26:45.728282 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 22:26:45.728282 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 22:26:45.728282 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 22:26:45.728282 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:45.728282 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:45.728282 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:45.728282 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:45.728282 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:45.729511 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:45.729511 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:45.729511 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:45.729511 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:45.729511 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:45.729511 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:45.729511 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:45.729511 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:45.729511 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:45.729511 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:45.729511 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:45.729511 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 22:26:45.729511 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 22:26:45.729511 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 24 22:26:45.729511 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:26:45.729511 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 414/840] 10.222.0.36 () {56 vars in 1132 bytes} [Fri Jun 24 22:26:45 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:45.734744 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7987c749-6497-4df4-adfc-bd90961605dc None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:45.799749 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:45.849276 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7987c749-6497-4df4-adfc-bd90961605dc None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:45.888059 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265bb5cd-03f3-426c-9ad0-79010ea3be3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:45.889713 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265bb5cd-03f3-426c-9ad0-79010ea3be3b None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:45.889713 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265bb5cd-03f3-426c-9ad0-79010ea3be3b None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:45.889713 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265bb5cd-03f3-426c-9ad0-79010ea3be3b None admin] PATH_INFO: `/v3/services` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:45.890049 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265bb5cd-03f3-426c-9ad0-79010ea3be3b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:45.890292 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265bb5cd-03f3-426c-9ad0-79010ea3be3b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:45.891729 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265bb5cd-03f3-426c-9ad0-79010ea3be3b None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:45.897077 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 427/841] 10.222.0.36 () {56 vars in 1126 bytes} [Fri Jun 24 22:26:45 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:45.903080 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8596463-0312-407f-930d-bef48c2d2b22 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:45.931236 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7fb9f-ec3b-406b-9299-e90b9f735ba6 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:45.931723 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7fb9f-ec3b-406b-9299-e90b9f735ba6 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:45.932009 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7fb9f-ec3b-406b-9299-e90b9f735ba6 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:45.934123 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 428/842] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:26:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:26:45.940525 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a302bd-1b77-495a-8b27-3d284017a8f5 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:45.941618 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a302bd-1b77-495a-8b27-3d284017a8f5 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:45.942093 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a302bd-1b77-495a-8b27-3d284017a8f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:45.966705 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-21a302bd-1b77-495a-8b27-3d284017a8f5 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:26:45.968270 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-21a302bd-1b77-495a-8b27-3d284017a8f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:26:45.989284 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:46.032488 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8596463-0312-407f-930d-bef48c2d2b22 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:46.068189 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 429/843] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:26:45 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 22:26:46.083930 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcac872b-b855-433f-a97a-fb5f207cce23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:46.084637 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcac872b-b855-433f-a97a-fb5f207cce23 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:46.084918 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcac872b-b855-433f-a97a-fb5f207cce23 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:46.085198 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcac872b-b855-433f-a97a-fb5f207cce23 None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:46.085988 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcac872b-b855-433f-a97a-fb5f207cce23 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:46.086299 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcac872b-b855-433f-a97a-fb5f207cce23 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:46.087976 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcac872b-b855-433f-a97a-fb5f207cce23 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:46.093933 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 415/844] 10.222.0.36 () {56 vars in 1126 bytes} [Fri Jun 24 22:26:45 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:46.095155 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a302bd-1b77-495a-8b27-3d284017a8f5 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:46.168065 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:46.241856 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a302bd-1b77-495a-8b27-3d284017a8f5 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:46.282141 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea65fb02-2318-4b18-9d63-56f06e50b2ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:46.282951 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea65fb02-2318-4b18-9d63-56f06e50b2ce None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:46.283235 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea65fb02-2318-4b18-9d63-56f06e50b2ce None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:46.283535 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea65fb02-2318-4b18-9d63-56f06e50b2ce None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:46.294395 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea65fb02-2318-4b18-9d63-56f06e50b2ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 22:26:46.302118 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-ea65fb02-2318-4b18-9d63-56f06e50b2ce None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 22:26:46.302118 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:46.302118 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:46.302118 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:46.302118 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:46.302118 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:46.302118 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:46.302118 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:46.302118 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:46.302118 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:46.302118 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:46.302118 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:46.302118 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 22:26:46.302118 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 22:26:46.302118 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 22:26:46.302118 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 22:26:46.303029 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 22:26:46.303029 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 22:26:46.303029 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 22:26:46.303029 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 22:26:46.303029 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:46.303029 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:46.303029 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:46.303029 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:46.303029 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:46.303029 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:46.303029 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:46.303029 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:46.303029 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:46.303029 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:46.303029 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:46.303029 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:46.303892 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:46.303892 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:46.303892 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:46.303892 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:46.303892 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 22:26:46.303892 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 22:26:46.303892 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 22:26:46.303892 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 22:26:46.303892 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 22:26:46.303892 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 22:26:46.303892 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 22:26:46.303892 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:26:46.303892 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 430/845] 10.222.0.36 () {56 vars in 1096 bytes} [Fri Jun 24 22:26:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:46.311074 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcac872b-b855-433f-a97a-fb5f207cce23 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:46.417381 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcac872b-b855-433f-a97a-fb5f207cce23 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:46.447701 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:46.452184 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf80989-1763-4666-98b2-dc78ac57087a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:46.452873 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf80989-1763-4666-98b2-dc78ac57087a None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:46.453437 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf80989-1763-4666-98b2-dc78ac57087a None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:46.453721 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf80989-1763-4666-98b2-dc78ac57087a None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:46.454482 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf80989-1763-4666-98b2-dc78ac57087a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:46.454792 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf80989-1763-4666-98b2-dc78ac57087a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:46.456376 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf80989-1763-4666-98b2-dc78ac57087a None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:46.466423 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 416/846] 10.222.0.36 () {56 vars in 1099 bytes} [Fri Jun 24 22:26:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 22:26:46.471896 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea65fb02-2318-4b18-9d63-56f06e50b2ce None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:46.575925 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea65fb02-2318-4b18-9d63-56f06e50b2ce None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:46.583358 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:46.611336 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6ff528-dd13-43f1-acd1-6899afae58cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:46.612522 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6ff528-dd13-43f1-acd1-6899afae58cf None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:46.612995 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6ff528-dd13-43f1-acd1-6899afae58cf None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:46.613458 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6ff528-dd13-43f1-acd1-6899afae58cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:46.625310 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6ff528-dd13-43f1-acd1-6899afae58cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:46.627099 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6ff528-dd13-43f1-acd1-6899afae58cf None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:46.645609 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-4c6ff528-dd13-43f1-acd1-6899afae58cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:46.645609 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:46.645609 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:46.645609 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:46.645609 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:46.645609 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:46.645609 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:46.645609 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:46.645609 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:46.645609 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:46.645609 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:46.645609 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:46.645609 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 22:26:46.645609 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 22:26:46.645609 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 22:26:46.646551 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 22:26:46.646551 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:46.646551 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:46.646551 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:46.646551 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:46.646551 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:46.646551 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:46.646551 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:46.646551 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:46.646551 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:46.646551 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:46.646551 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:46.646551 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:46.646551 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:46.646551 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:46.646551 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:46.646551 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:46.647446 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 22:26:46.647446 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 22:26:46.647446 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:46.647446 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:26:46.649728 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 431/847] 10.222.0.36 () {56 vars in 1108 bytes} [Fri Jun 24 22:26:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:46.655721 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf80989-1763-4666-98b2-dc78ac57087a None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:46.754464 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf80989-1763-4666-98b2-dc78ac57087a None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:46.794789 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944fbeaa-f0c5-4cca-a36d-1054aeacfeb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:46.795479 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944fbeaa-f0c5-4cca-a36d-1054aeacfeb1 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:46.795763 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944fbeaa-f0c5-4cca-a36d-1054aeacfeb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:46.796037 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944fbeaa-f0c5-4cca-a36d-1054aeacfeb1 None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:46.796761 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944fbeaa-f0c5-4cca-a36d-1054aeacfeb1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:46.797064 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944fbeaa-f0c5-4cca-a36d-1054aeacfeb1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:46.798438 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944fbeaa-f0c5-4cca-a36d-1054aeacfeb1 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:46.810943 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 417/848] 10.222.0.36 () {56 vars in 1109 bytes} [Fri Jun 24 22:26:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:46.816392 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6ff528-dd13-43f1-acd1-6899afae58cf None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:46.923716 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6ff528-dd13-43f1-acd1-6899afae58cf None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:46.957464 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16bc692-fc19-42fe-8a17-c05f0db16b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:46.958295 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16bc692-fc19-42fe-8a17-c05f0db16b93 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:46.958577 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16bc692-fc19-42fe-8a17-c05f0db16b93 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:46.958861 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16bc692-fc19-42fe-8a17-c05f0db16b93 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:46.966949 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16bc692-fc19-42fe-8a17-c05f0db16b93 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:46.968463 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16bc692-fc19-42fe-8a17-c05f0db16b93 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:46.982885 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-b16bc692-fc19-42fe-8a17-c05f0db16b93 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 24 22:26:46.982885 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:46.982885 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:46.982885 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:46.982885 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:46.982885 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:46.982885 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:46.982885 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:46.982885 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:46.982885 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:46.982885 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:46.982885 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:46.982885 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 22:26:46.982885 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 22:26:46.982885 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 22:26:46.982885 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 22:26:46.983824 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:46.983824 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:46.983824 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 22:26:46.983824 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 22:26:46.983824 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 22:26:46.983824 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 22:26:46.983824 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:46.983824 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:46.983824 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:46.983824 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:46.983824 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:46.983824 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:46.983824 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:46.983824 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:46.983824 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:46.983824 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:46.983824 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:46.983824 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:46.984741 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:46.984741 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:46.984741 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 22:26:46.984741 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 22:26:46.984741 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 22:26:46.984741 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 22:26:46.984741 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 22:26:46.984741 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 22:26:46.984741 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 24 22:26:46.984741 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:26:46.984741 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 432/849] 10.222.0.36 () {56 vars in 1096 bytes} [Fri Jun 24 22:26:46 2022] GET /identity/v3/users/swift => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:46.992652 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944fbeaa-f0c5-4cca-a36d-1054aeacfeb1 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:47.048027 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:47.096582 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944fbeaa-f0c5-4cca-a36d-1054aeacfeb1 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:47.130939 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e46d6ae-0938-419b-9f12-b8b4ec963e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:47.131648 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e46d6ae-0938-419b-9f12-b8b4ec963e66 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:47.131927 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e46d6ae-0938-419b-9f12-b8b4ec963e66 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:47.132197 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e46d6ae-0938-419b-9f12-b8b4ec963e66 None admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:47.133059 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e46d6ae-0938-419b-9f12-b8b4ec963e66 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:47.133365 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e46d6ae-0938-419b-9f12-b8b4ec963e66 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:47.134795 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e46d6ae-0938-419b-9f12-b8b4ec963e66 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:47.152684 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 418/850] 10.222.0.36 () {56 vars in 1135 bytes} [Fri Jun 24 22:26:46 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:47.158432 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16bc692-fc19-42fe-8a17-c05f0db16b93 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:47.158910 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7822f6a4-0e96-4ba6-8ae7-09ff574037e5 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:47.159197 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7822f6a4-0e96-4ba6-8ae7-09ff574037e5 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:47.159506 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7822f6a4-0e96-4ba6-8ae7-09ff574037e5 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:47.161117 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 419/851] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:26:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:26:47.168598 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacabb6e-b01e-4ee2-9b55-eec37ecc6e82 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:47.168876 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacabb6e-b01e-4ee2-9b55-eec37ecc6e82 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:47.169148 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacabb6e-b01e-4ee2-9b55-eec37ecc6e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:47.185292 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:47.187044 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-cacabb6e-b01e-4ee2-9b55-eec37ecc6e82 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:26:47.188276 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-cacabb6e-b01e-4ee2-9b55-eec37ecc6e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:26:47.267970 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 420/852] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:26:47 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 22:26:47.267970 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f79bf-f07f-4342-be91-2465ddfddf5e None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:47.267970 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f79bf-f07f-4342-be91-2465ddfddf5e None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:47.267970 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f79bf-f07f-4342-be91-2465ddfddf5e None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:47.267970 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 421/853] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:26:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:26:47.271226 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e259a60a-a6ef-4fcc-988a-7394dead9329 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:47.271536 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e259a60a-a6ef-4fcc-988a-7394dead9329 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:47.271814 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e259a60a-a6ef-4fcc-988a-7394dead9329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:47.283665 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16bc692-fc19-42fe-8a17-c05f0db16b93 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:47.292496 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-e259a60a-a6ef-4fcc-988a-7394dead9329 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:26:47.293868 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-e259a60a-a6ef-4fcc-988a-7394dead9329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:26:47.318889 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb664f38-a898-4831-a4a8-100ac68c9da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:47.319590 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb664f38-a898-4831-a4a8-100ac68c9da5 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:47.319871 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb664f38-a898-4831-a4a8-100ac68c9da5 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:47.320150 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb664f38-a898-4831-a4a8-100ac68c9da5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:47.330556 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:47.365238 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 422/854] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:26:47 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 22:26:47.366434 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e259a60a-a6ef-4fcc-988a-7394dead9329 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:47.392067 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb664f38-a898-4831-a4a8-100ac68c9da5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:47.393542 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb664f38-a898-4831-a4a8-100ac68c9da5 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:47.411274 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:47.479694 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e259a60a-a6ef-4fcc-988a-7394dead9329 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:47.502244 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 433/855] 10.222.0.36 () {58 vars in 1282 bytes} [Fri Jun 24 22:26:47 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 22:26:47.503151 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb664f38-a898-4831-a4a8-100ac68c9da5 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:47.519573 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b782ed9-95ec-49e0-86ac-bfc30419f2d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:47.520234 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b782ed9-95ec-49e0-86ac-bfc30419f2d7 None admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:47.520512 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b782ed9-95ec-49e0-86ac-bfc30419f2d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:47.520782 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b782ed9-95ec-49e0-86ac-bfc30419f2d7 None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:47.521502 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b782ed9-95ec-49e0-86ac-bfc30419f2d7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:47.522872 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b782ed9-95ec-49e0-86ac-bfc30419f2d7 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:47.547278 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 423/856] 10.222.0.36 () {60 vars in 1141 bytes} [Fri Jun 24 22:26:47 2022] POST /identity/v3/services => generated 251 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:26:47.547278 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b782ed9-95ec-49e0-86ac-bfc30419f2d7 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:47.591732 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:47.609376 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb664f38-a898-4831-a4a8-100ac68c9da5 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:47.632081 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:47.659584 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4270c39-5ea6-4722-b97a-b44f203a599a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:47.660410 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4270c39-5ea6-4722-b97a-b44f203a599a None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:47.660685 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4270c39-5ea6-4722-b97a-b44f203a599a None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:47.660951 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4270c39-5ea6-4722-b97a-b44f203a599a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:47.672736 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4270c39-5ea6-4722-b97a-b44f203a599a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 22:26:47.680959 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-e4270c39-5ea6-4722-b97a-b44f203a599a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 22:26:47.680959 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:47.680959 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:47.680959 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:47.680959 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:47.680959 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:47.680959 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:47.680959 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:47.680959 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:47.680959 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:47.680959 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:47.680959 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:47.680959 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 22:26:47.680959 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 22:26:47.680959 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 22:26:47.680959 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 22:26:47.681960 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 22:26:47.681960 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 22:26:47.681960 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 22:26:47.681960 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 22:26:47.681960 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:47.681960 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:47.681960 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:47.681960 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:47.681960 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:47.681960 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:47.681960 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:47.681960 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:47.681960 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:47.681960 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:47.681960 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:47.681960 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:47.682763 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:47.682763 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:47.682763 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:47.682763 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:47.682763 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 22:26:47.682763 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 22:26:47.682763 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 22:26:47.682763 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 22:26:47.682763 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 22:26:47.682763 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 22:26:47.682763 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 22:26:47.682763 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:26:47.687283 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 434/857] 10.222.0.36 () {56 vars in 1102 bytes} [Fri Jun 24 22:26:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:47.688472 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4270c39-5ea6-4722-b97a-b44f203a599a None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:47.695555 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b782ed9-95ec-49e0-86ac-bfc30419f2d7 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:47.752497 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc292ad-c966-4b56-9e38-408e3d84f006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:47.753539 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc292ad-c966-4b56-9e38-408e3d84f006 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:47.753819 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc292ad-c966-4b56-9e38-408e3d84f006 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:47.754252 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc292ad-c966-4b56-9e38-408e3d84f006 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:47.766887 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc292ad-c966-4b56-9e38-408e3d84f006 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:47.768428 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc292ad-c966-4b56-9e38-408e3d84f006 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:47.789524 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-4fc292ad-c966-4b56-9e38-408e3d84f006 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:47.789524 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:47.789524 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:47.789524 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:47.789524 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:47.789524 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:47.789524 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:47.789524 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:47.789524 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:47.789524 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:47.789524 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:47.789524 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:47.789524 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 22:26:47.789524 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 22:26:47.789524 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 22:26:47.790605 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 22:26:47.790605 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:47.790605 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:47.790605 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:47.790605 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:47.790605 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:47.790605 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:47.790605 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:47.790605 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:47.790605 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:47.790605 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:47.790605 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:47.790605 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:47.790605 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:47.790605 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:47.790605 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:47.790605 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:47.791540 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 22:26:47.791540 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 22:26:47.791540 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:47.791540 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:26:47.791540 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 424/858] 10.222.0.36 () {56 vars in 1108 bytes} [Fri Jun 24 22:26:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:47.796328 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc292ad-c966-4b56-9e38-408e3d84f006 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:47.828494 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4270c39-5ea6-4722-b97a-b44f203a599a None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:47.864247 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789119f4-ac07-4b86-8592-eaae82f27902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:47.865265 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789119f4-ac07-4b86-8592-eaae82f27902 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:47.865721 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789119f4-ac07-4b86-8592-eaae82f27902 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:47.866160 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789119f4-ac07-4b86-8592-eaae82f27902 None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:47.867222 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789119f4-ac07-4b86-8592-eaae82f27902 None admin] RBAC: Adding query filter params (name=service) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:47.867721 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789119f4-ac07-4b86-8592-eaae82f27902 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:47.869376 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789119f4-ac07-4b86-8592-eaae82f27902 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:47.886645 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 435/859] 10.222.0.36 () {56 vars in 1103 bytes} [Fri Jun 24 22:26:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:47.888287 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789119f4-ac07-4b86-8592-eaae82f27902 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:47.901620 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:47.927489 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc292ad-c966-4b56-9e38-408e3d84f006 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:47.927676 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:47.968676 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfb6a9b-3597-4bb8-8f22-ccec576aef1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:47.969730 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfb6a9b-3597-4bb8-8f22-ccec576aef1c None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:47.970203 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfb6a9b-3597-4bb8-8f22-ccec576aef1c None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:47.970666 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfb6a9b-3597-4bb8-8f22-ccec576aef1c None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:47.971627 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfb6a9b-3597-4bb8-8f22-ccec576aef1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:47.972146 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfb6a9b-3597-4bb8-8f22-ccec576aef1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:47.973809 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfb6a9b-3597-4bb8-8f22-ccec576aef1c None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:47.987728 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 425/860] 10.222.0.36 () {56 vars in 1109 bytes} [Fri Jun 24 22:26:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 22:26:47.992859 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfb6a9b-3597-4bb8-8f22-ccec576aef1c None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:48.011638 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789119f4-ac07-4b86-8592-eaae82f27902 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:48.047952 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fc2f0c-16e7-4e30-9c76-48b3fb405862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:48.048781 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fc2f0c-16e7-4e30-9c76-48b3fb405862 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:48.049062 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fc2f0c-16e7-4e30-9c76-48b3fb405862 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:48.049336 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fc2f0c-16e7-4e30-9c76-48b3fb405862 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:48.062023 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fc2f0c-16e7-4e30-9c76-48b3fb405862 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:48.063618 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fc2f0c-16e7-4e30-9c76-48b3fb405862 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:48.081801 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-45fc2f0c-16e7-4e30-9c76-48b3fb405862 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:48.081801 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:48.081801 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:48.081801 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:48.081801 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:48.081801 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:48.081801 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:48.081801 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:48.081801 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:48.081801 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:48.081801 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:48.081801 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:48.081801 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 22:26:48.081801 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 22:26:48.081801 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 22:26:48.082734 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 22:26:48.082734 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:48.082734 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:48.082734 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:48.082734 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:48.082734 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:48.082734 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:48.082734 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:48.082734 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:48.082734 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:48.082734 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:48.082734 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:48.082734 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:48.082734 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:48.082734 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:48.082734 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:48.082734 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:48.083629 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 22:26:48.083629 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 22:26:48.083629 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:48.083629 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:26:48.087526 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 436/861] 10.222.0.36 () {56 vars in 1108 bytes} [Fri Jun 24 22:26:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:48.089148 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fc2f0c-16e7-4e30-9c76-48b3fb405862 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:48.131535 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfb6a9b-3597-4bb8-8f22-ccec576aef1c None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:48.179455 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83842b1-fc3a-4144-b12a-9c60d591e1a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:48.181307 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83842b1-fc3a-4144-b12a-9c60d591e1a5 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:48.181806 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83842b1-fc3a-4144-b12a-9c60d591e1a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:48.182330 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83842b1-fc3a-4144-b12a-9c60d591e1a5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:48.189792 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:48.191785 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83842b1-fc3a-4144-b12a-9c60d591e1a5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:48.194087 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83842b1-fc3a-4144-b12a-9c60d591e1a5 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:48.203971 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fc2f0c-16e7-4e30-9c76-48b3fb405862 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:48.212209 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-c83842b1-fc3a-4144-b12a-9c60d591e1a5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 22:26:48.212209 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:48.212209 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:48.212209 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:48.212209 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:48.212209 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:48.212209 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:48.212209 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:48.212209 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:48.212209 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:48.212209 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:48.212209 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:48.212209 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 22:26:48.212209 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 22:26:48.212209 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 22:26:48.213225 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 22:26:48.213225 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:48.213225 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:48.213225 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:48.213225 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:48.213225 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:48.213225 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:48.213225 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:48.213225 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:48.213225 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:48.213225 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:48.213225 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:48.213225 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:48.213225 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:48.213225 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:48.213225 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:48.213225 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:48.214287 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 22:26:48.214287 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 22:26:48.214287 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 22:26:48.214287 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 22:26:48.214287 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 22:26:48.214287 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 22:26:48.214287 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 22:26:48.214287 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:26:48.217197 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 426/862] 10.222.0.36 () {56 vars in 1111 bytes} [Fri Jun 24 22:26:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:48.218743 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc47dcf-eab0-40d1-9ccb-225e5dc06edf None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:48.219341 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc47dcf-eab0-40d1-9ccb-225e5dc06edf None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:48.219759 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc47dcf-eab0-40d1-9ccb-225e5dc06edf None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:48.222096 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 427/863] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:26:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:26:48.223137 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc47dcf-eab0-40d1-9ccb-225e5dc06edf None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:48.228043 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:48.240947 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f93a6b-0d56-4722-812e-06de0703b2ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:48.241626 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f93a6b-0d56-4722-812e-06de0703b2ba None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:48.241923 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f93a6b-0d56-4722-812e-06de0703b2ba None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:48.242281 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f93a6b-0d56-4722-812e-06de0703b2ba None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:48.243346 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f93a6b-0d56-4722-812e-06de0703b2ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:48.243346 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f93a6b-0d56-4722-812e-06de0703b2ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:48.244731 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f93a6b-0d56-4722-812e-06de0703b2ba None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:48.262623 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 437/864] 10.222.0.36 () {56 vars in 1109 bytes} [Fri Jun 24 22:26:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:48.262623 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf8baed-fdfa-406f-a1a3-ec932cc77292 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:48.262623 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf8baed-fdfa-406f-a1a3-ec932cc77292 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:48.262623 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf8baed-fdfa-406f-a1a3-ec932cc77292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:48.275744 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-caf8baed-fdfa-406f-a1a3-ec932cc77292 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:26:48.276942 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-caf8baed-fdfa-406f-a1a3-ec932cc77292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:26:48.342513 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc47dcf-eab0-40d1-9ccb-225e5dc06edf None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:48.383184 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f108ad5e-8998-4c3c-b533-b1ce37cec4d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:48.383920 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f108ad5e-8998-4c3c-b533-b1ce37cec4d4 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:48.384207 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f108ad5e-8998-4c3c-b533-b1ce37cec4d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:48.384481 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f108ad5e-8998-4c3c-b533-b1ce37cec4d4 None admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:48.385303 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f108ad5e-8998-4c3c-b533-b1ce37cec4d4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:48.385619 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f108ad5e-8998-4c3c-b533-b1ce37cec4d4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:48.387127 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f108ad5e-8998-4c3c-b533-b1ce37cec4d4 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:48.405981 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 428/865] 10.222.0.36 () {56 vars in 1148 bytes} [Fri Jun 24 22:26:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:48.405981 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f108ad5e-8998-4c3c-b533-b1ce37cec4d4 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:48.478201 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 438/866] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:26:48 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 22:26:48.479200 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf8baed-fdfa-406f-a1a3-ec932cc77292 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:48.489690 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:48.533903 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f108ad5e-8998-4c3c-b533-b1ce37cec4d4 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:48.569021 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5e5547-b905-4439-b43d-954b44c4f1bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:48.569298 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:48.570265 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e5547-b905-4439-b43d-954b44c4f1bb None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:48.571211 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e5547-b905-4439-b43d-954b44c4f1bb None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:48.571569 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e5547-b905-4439-b43d-954b44c4f1bb None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:48.579205 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5e5547-b905-4439-b43d-954b44c4f1bb None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:48.580698 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5e5547-b905-4439-b43d-954b44c4f1bb None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:48.591659 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf8baed-fdfa-406f-a1a3-ec932cc77292 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:48.597110 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-ed5e5547-b905-4439-b43d-954b44c4f1bb None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 22:26:48.597110 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:48.597110 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:48.597110 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:48.597110 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:48.597110 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:48.597110 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:48.597110 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:48.597110 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:48.597110 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:48.597110 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:48.597110 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:48.597110 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 22:26:48.597110 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 22:26:48.597110 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 22:26:48.597110 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 22:26:48.598045 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:48.598045 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:48.598045 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 22:26:48.598045 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 22:26:48.598045 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 22:26:48.598045 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 22:26:48.598045 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:48.598045 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:48.598045 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:48.598045 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:48.598045 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:48.598045 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:48.598045 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:48.598045 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:48.598045 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:48.598045 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:48.598045 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:48.598045 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:48.598964 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:48.598964 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:48.598964 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 22:26:48.598964 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 22:26:48.598964 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 22:26:48.598964 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 22:26:48.598964 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 22:26:48.598964 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 22:26:48.598964 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 22:26:48.598964 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:26:48.598964 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 429/867] 10.222.0.36 () {56 vars in 1117 bytes} [Fri Jun 24 22:26:48 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:48.600114 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5e5547-b905-4439-b43d-954b44c4f1bb None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:48.633053 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5642cb01-ab0b-427c-b3ba-53c38acdcf17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:48.634287 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5642cb01-ab0b-427c-b3ba-53c38acdcf17 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:48.634568 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5642cb01-ab0b-427c-b3ba-53c38acdcf17 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:48.635193 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5642cb01-ab0b-427c-b3ba-53c38acdcf17 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:48.636220 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5642cb01-ab0b-427c-b3ba-53c38acdcf17 None admin] RBAC: Adding query filter params (role.id=1a1c43cc97a0407eb7a7c7a1333a9d4a, scope.project.id=d189b31bbec0469381292d2cde3cb420, user.id=6b95846f7f2a453f85ddb41a5d3327f3) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:48.636562 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5642cb01-ab0b-427c-b3ba-53c38acdcf17 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:48.638836 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5642cb01-ab0b-427c-b3ba-53c38acdcf17 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:48.645118 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 439/868] 10.222.0.36 () {56 vars in 1374 bytes} [Fri Jun 24 22:26:48 2022] GET /identity/v3/role_assignments?user.id=6b95846f7f2a453f85ddb41a5d3327f3&scope.project.id=d189b31bbec0469381292d2cde3cb420&role.id=1a1c43cc97a0407eb7a7c7a1333a9d4a => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:48.645924 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5642cb01-ab0b-427c-b3ba-53c38acdcf17 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:48.721649 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5e5547-b905-4439-b43d-954b44c4f1bb None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:48.749276 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:48.767320 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d60745-4b25-49fb-a5ea-c8395059e954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:48.768751 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d60745-4b25-49fb-a5ea-c8395059e954 None admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:48.769190 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d60745-4b25-49fb-a5ea-c8395059e954 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:48.769614 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d60745-4b25-49fb-a5ea-c8395059e954 None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:48.770541 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d60745-4b25-49fb-a5ea-c8395059e954 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:48.772327 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d60745-4b25-49fb-a5ea-c8395059e954 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:48.777250 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5642cb01-ab0b-427c-b3ba-53c38acdcf17 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:48.795859 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 430/869] 10.222.0.36 () {60 vars in 1141 bytes} [Fri Jun 24 22:26:48 2022] POST /identity/v3/services => generated 269 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:26:48.824428 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7182b009-73e0-49bd-adb7-d8550d56eb02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:48.825158 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7182b009-73e0-49bd-adb7-d8550d56eb02 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:48.825438 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7182b009-73e0-49bd-adb7-d8550d56eb02 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:48.825710 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7182b009-73e0-49bd-adb7-d8550d56eb02 None admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:48.826621 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7182b009-73e0-49bd-adb7-d8550d56eb02 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:48.826941 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7182b009-73e0-49bd-adb7-d8550d56eb02 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:48.828562 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7182b009-73e0-49bd-adb7-d8550d56eb02 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:48.839268 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:48.850321 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 440/870] 10.222.0.36 () {56 vars in 1149 bytes} [Fri Jun 24 22:26:48 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:48.856139 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d60745-4b25-49fb-a5ea-c8395059e954 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:48.981372 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d60745-4b25-49fb-a5ea-c8395059e954 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:49.016791 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3e0781-4451-4569-9810-a91382e96d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:49.017449 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3e0781-4451-4569-9810-a91382e96d9f None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:49.017731 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3e0781-4451-4569-9810-a91382e96d9f None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:49.018004 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3e0781-4451-4569-9810-a91382e96d9f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:49.075645 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:49.096364 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3e0781-4451-4569-9810-a91382e96d9f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:49.102733 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3e0781-4451-4569-9810-a91382e96d9f None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:49.206664 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 431/871] 10.222.0.36 () {58 vars in 1282 bytes} [Fri Jun 24 22:26:48 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 22:26:49.212438 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7182b009-73e0-49bd-adb7-d8550d56eb02 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:49.313556 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7182b009-73e0-49bd-adb7-d8550d56eb02 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:49.348750 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeb74d8-e08e-44bf-91d3-b80a40eed3d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:49.349475 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeb74d8-e08e-44bf-91d3-b80a40eed3d1 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:49.349759 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeb74d8-e08e-44bf-91d3-b80a40eed3d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:49.350033 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeb74d8-e08e-44bf-91d3-b80a40eed3d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:49.360682 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeb74d8-e08e-44bf-91d3-b80a40eed3d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:49.362169 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeb74d8-e08e-44bf-91d3-b80a40eed3d1 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:49.382479 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-4aeb74d8-e08e-44bf-91d3-b80a40eed3d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:49.382479 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:49.382479 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:49.382479 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:49.382479 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:49.382479 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:49.382479 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:49.382479 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:49.382479 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:49.382479 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:49.382479 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:49.382479 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:49.382479 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 22:26:49.382479 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 22:26:49.382479 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 22:26:49.383624 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 22:26:49.383624 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:49.383624 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:49.383624 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:49.383624 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:49.383624 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:49.383624 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:49.383624 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:49.383624 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:49.383624 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:49.383624 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:49.383624 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:49.383624 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:49.383624 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:49.383624 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:49.383624 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:49.383624 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:49.384502 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 22:26:49.384502 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 22:26:49.384502 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:49.384502 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:26:49.384502 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 441/872] 10.222.0.36 () {56 vars in 1108 bytes} [Fri Jun 24 22:26:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 22:26:49.390970 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3e0781-4451-4569-9810-a91382e96d9f None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:49.487689 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:49.500284 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3e0781-4451-4569-9810-a91382e96d9f None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:49.535828 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0a5f1b-5d39-4b18-97d2-7dbdccdef211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:49.536497 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0a5f1b-5d39-4b18-97d2-7dbdccdef211 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:49.536835 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0a5f1b-5d39-4b18-97d2-7dbdccdef211 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:49.537114 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0a5f1b-5d39-4b18-97d2-7dbdccdef211 None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:49.537886 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0a5f1b-5d39-4b18-97d2-7dbdccdef211 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:49.538196 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0a5f1b-5d39-4b18-97d2-7dbdccdef211 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:49.539979 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0a5f1b-5d39-4b18-97d2-7dbdccdef211 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:49.552002 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 432/873] 10.222.0.36 () {56 vars in 1109 bytes} [Fri Jun 24 22:26:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:49.560591 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeb74d8-e08e-44bf-91d3-b80a40eed3d1 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:49.609735 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:49.660732 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeb74d8-e08e-44bf-91d3-b80a40eed3d1 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:49.693641 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2907fc-3363-4253-8ec5-f24a54bba1a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:49.694766 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2907fc-3363-4253-8ec5-f24a54bba1a3 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:49.695413 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2907fc-3363-4253-8ec5-f24a54bba1a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:49.695963 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2907fc-3363-4253-8ec5-f24a54bba1a3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:49.702775 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2907fc-3363-4253-8ec5-f24a54bba1a3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:49.704472 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2907fc-3363-4253-8ec5-f24a54bba1a3 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:49.719494 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-ac2907fc-3363-4253-8ec5-f24a54bba1a3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 22:26:49.719494 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:49.719494 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:49.719494 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:49.719494 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:49.719494 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:49.719494 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:49.719494 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:49.719494 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:49.719494 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:49.719494 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:49.719494 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:49.719494 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 22:26:49.719494 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 22:26:49.719494 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 22:26:49.720434 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 22:26:49.720434 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:49.720434 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:49.720434 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:49.720434 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:49.720434 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:49.720434 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:49.720434 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:49.720434 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:49.720434 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:49.720434 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:49.720434 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:49.720434 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:49.720434 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:49.720434 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:49.720434 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:49.720434 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:49.721344 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 22:26:49.721344 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 22:26:49.721344 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 22:26:49.721344 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 22:26:49.721344 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 22:26:49.721344 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 22:26:49.721344 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 22:26:49.721344 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:26:49.723858 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 442/874] 10.222.0.36 () {56 vars in 1111 bytes} [Fri Jun 24 22:26:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:49.730106 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0a5f1b-5d39-4b18-97d2-7dbdccdef211 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:49.752819 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f70e585-7893-45b0-bdc4-9cca7b76d004 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:49.753403 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f70e585-7893-45b0-bdc4-9cca7b76d004 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:49.753874 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f70e585-7893-45b0-bdc4-9cca7b76d004 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:49.756373 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 443/875] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:26:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:26:49.765290 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdf6ec3-ac49-4d8d-b5a5-0f2cc09575cb None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:49.766069 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdf6ec3-ac49-4d8d-b5a5-0f2cc09575cb None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:49.766536 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdf6ec3-ac49-4d8d-b5a5-0f2cc09575cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:49.787112 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-7bdf6ec3-ac49-4d8d-b5a5-0f2cc09575cb None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:26:49.789239 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-7bdf6ec3-ac49-4d8d-b5a5-0f2cc09575cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:26:49.846738 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0a5f1b-5d39-4b18-97d2-7dbdccdef211 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:49.871399 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 444/876] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:26:49 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 22:26:49.889357 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdf6ec3-ac49-4d8d-b5a5-0f2cc09575cb None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:49.893482 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a068028-f408-4171-a253-96c69247bb02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:49.894431 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a068028-f408-4171-a253-96c69247bb02 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:49.894925 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a068028-f408-4171-a253-96c69247bb02 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:49.895465 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a068028-f408-4171-a253-96c69247bb02 None admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:49.896445 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a068028-f408-4171-a253-96c69247bb02 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:49.896939 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a068028-f408-4171-a253-96c69247bb02 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:49.898627 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a068028-f408-4171-a253-96c69247bb02 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:49.917298 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 433/877] 10.222.0.36 () {56 vars in 1148 bytes} [Fri Jun 24 22:26:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:49.918612 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a068028-f408-4171-a253-96c69247bb02 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:49.921998 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:49.940893 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:50.004818 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdf6ec3-ac49-4d8d-b5a5-0f2cc09575cb None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:50.034999 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a068028-f408-4171-a253-96c69247bb02 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:50.041902 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d357919a-f94b-4203-99fb-567df0623dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:50.042743 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d357919a-f94b-4203-99fb-567df0623dfc None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:50.043020 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d357919a-f94b-4203-99fb-567df0623dfc None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:50.043330 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d357919a-f94b-4203-99fb-567df0623dfc None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:50.043994 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d357919a-f94b-4203-99fb-567df0623dfc None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:50.045917 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d357919a-f94b-4203-99fb-567df0623dfc None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:50.058275 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-d357919a-f94b-4203-99fb-567df0623dfc None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 24 22:26:50.058275 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:50.058275 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 22:26:50.058275 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 22:26:50.058275 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 22:26:50.058275 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 22:26:50.058275 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 22:26:50.058275 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 22:26:50.058275 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 24 22:26:50.058275 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:26:50.058275 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 22:26:50.058275 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:26:50.058275 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:50.058275 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:50.058275 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:50.058275 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:50.058275 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:50.059275 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:50.059275 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:50.059275 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:50.059275 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:50.059275 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:50.059275 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:50.059275 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 22:26:50.059275 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 22:26:50.059275 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 22:26:50.059275 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 22:26:50.059275 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:50.059275 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:50.059275 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:50.059275 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:50.059275 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:50.059275 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:50.060093 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:50.060093 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:50.060093 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:50.060093 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:50.060093 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:50.060093 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:50.060093 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:50.060093 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:50.060093 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:50.060093 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:50.060093 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 22:26:50.060093 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 22:26:50.060093 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 24 22:26:50.060093 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:26:50.060093 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 445/878] 10.222.0.36 () {56 vars in 1114 bytes} [Fri Jun 24 22:26:49 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 22:26:50.066696 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d357919a-f94b-4203-99fb-567df0623dfc None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:50.080324 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f259ca5-e9f4-48fd-83ba-00e597701e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:50.081203 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f259ca5-e9f4-48fd-83ba-00e597701e4d None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:50.081624 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f259ca5-e9f4-48fd-83ba-00e597701e4d None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:50.082054 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f259ca5-e9f4-48fd-83ba-00e597701e4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:50.083080 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f259ca5-e9f4-48fd-83ba-00e597701e4d None admin] RBAC: Adding query filter params (role.id=3265c7c44fb144a0a56467ded2a39413, scope.project.id=d189b31bbec0469381292d2cde3cb420, user.id=542ea2e5a8114792836d0cdfd36b4c51) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:50.083647 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f259ca5-e9f4-48fd-83ba-00e597701e4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:50.085297 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f259ca5-e9f4-48fd-83ba-00e597701e4d None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:50.099651 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 434/879] 10.222.0.36 () {56 vars in 1374 bytes} [Fri Jun 24 22:26:49 2022] GET /identity/v3/role_assignments?user.id=542ea2e5a8114792836d0cdfd36b4c51&scope.project.id=d189b31bbec0469381292d2cde3cb420&role.id=3265c7c44fb144a0a56467ded2a39413 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:50.180792 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d357919a-f94b-4203-99fb-567df0623dfc None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:50.182379 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:50.218853 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab49107c-0379-4350-ac22-da197e0bc9d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:50.219809 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab49107c-0379-4350-ac22-da197e0bc9d9 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:50.220098 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab49107c-0379-4350-ac22-da197e0bc9d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:50.220376 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab49107c-0379-4350-ac22-da197e0bc9d9 None admin] PATH_INFO: `/v3/services` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:50.221101 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab49107c-0379-4350-ac22-da197e0bc9d9 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:50.221409 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab49107c-0379-4350-ac22-da197e0bc9d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:50.222817 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab49107c-0379-4350-ac22-da197e0bc9d9 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:50.228578 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 446/880] 10.222.0.36 () {56 vars in 1114 bytes} [Fri Jun 24 22:26:50 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 22:26:50.234192 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f259ca5-e9f4-48fd-83ba-00e597701e4d None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:50.306320 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:50.339091 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f259ca5-e9f4-48fd-83ba-00e597701e4d None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:50.374625 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cd405c-a311-4d9f-b6b6-e4486b34673c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:50.375321 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cd405c-a311-4d9f-b6b6-e4486b34673c None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:50.375610 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cd405c-a311-4d9f-b6b6-e4486b34673c None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:50.375886 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cd405c-a311-4d9f-b6b6-e4486b34673c None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:50.376602 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cd405c-a311-4d9f-b6b6-e4486b34673c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:50.376908 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cd405c-a311-4d9f-b6b6-e4486b34673c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:50.378303 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cd405c-a311-4d9f-b6b6-e4486b34673c None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:50.384549 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 435/881] 10.222.0.36 () {56 vars in 1114 bytes} [Fri Jun 24 22:26:50 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 22:26:50.390262 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab49107c-0379-4350-ac22-da197e0bc9d9 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:50.495046 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab49107c-0379-4350-ac22-da197e0bc9d9 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:50.530048 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408be310-e3e7-4921-adb5-5bdf864f984a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:50.530723 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408be310-e3e7-4921-adb5-5bdf864f984a None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:50.531006 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408be310-e3e7-4921-adb5-5bdf864f984a None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:50.531311 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408be310-e3e7-4921-adb5-5bdf864f984a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:50.532106 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408be310-e3e7-4921-adb5-5bdf864f984a None admin] RBAC: Adding query filter params (interface=public, service_id=5e0267f167ec44fda7502f8ea3e97484, region_id=RegionOne) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:50.532424 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408be310-e3e7-4921-adb5-5bdf864f984a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:50.533972 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408be310-e3e7-4921-adb5-5bdf864f984a None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:50.539854 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 447/882] 10.222.0.36 () {56 vars in 1251 bytes} [Fri Jun 24 22:26:50 2022] GET /identity/v3/endpoints?service_id=5e0267f167ec44fda7502f8ea3e97484&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 22:26:50.545362 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cd405c-a311-4d9f-b6b6-e4486b34673c None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:50.653722 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cd405c-a311-4d9f-b6b6-e4486b34673c None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:50.685261 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:50.691375 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dcb929-d9df-4d32-bc58-a3ed5adf9ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:50.692250 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dcb929-d9df-4d32-bc58-a3ed5adf9ac0 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:50.692712 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dcb929-d9df-4d32-bc58-a3ed5adf9ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:50.693184 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dcb929-d9df-4d32-bc58-a3ed5adf9ac0 None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:50.693875 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dcb929-d9df-4d32-bc58-a3ed5adf9ac0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:50.695310 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dcb929-d9df-4d32-bc58-a3ed5adf9ac0 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:50.701431 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 436/883] 10.222.0.36 () {56 vars in 1087 bytes} [Fri Jun 24 22:26:50 2022] GET /identity/v3/services => generated 1268 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:26:50.917637 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c3fd5c-7d03-455e-842f-ad1b37ad8d96 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:50.918208 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c3fd5c-7d03-455e-842f-ad1b37ad8d96 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:50.918208 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c3fd5c-7d03-455e-842f-ad1b37ad8d96 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:50.919957 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 448/884] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:26:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:26:50.925468 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27dc742-ffe3-4c69-95ad-effcd1cc8c0f None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:50.926352 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27dc742-ffe3-4c69-95ad-effcd1cc8c0f None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:50.926858 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27dc742-ffe3-4c69-95ad-effcd1cc8c0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:50.946199 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-c27dc742-ffe3-4c69-95ad-effcd1cc8c0f None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:26:50.947807 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-c27dc742-ffe3-4c69-95ad-effcd1cc8c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:26:50.952391 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e4706b-9f75-4020-b5a0-7e7362e48081 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:50.952991 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e4706b-9f75-4020-b5a0-7e7362e48081 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:50.953472 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e4706b-9f75-4020-b5a0-7e7362e48081 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:50.955392 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 449/885] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:26:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 22:26:50.961225 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba0132a-1b4b-4f5b-a8c2-b99c6146f141 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:50.961978 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba0132a-1b4b-4f5b-a8c2-b99c6146f141 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:50.962479 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba0132a-1b4b-4f5b-a8c2-b99c6146f141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:50.980742 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-dba0132a-1b4b-4f5b-a8c2-b99c6146f141 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:26:50.982466 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-dba0132a-1b4b-4f5b-a8c2-b99c6146f141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:26:51.008547 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:51.031225 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 437/886] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:26:50 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 22:26:51.059894 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27dc742-ffe3-4c69-95ad-effcd1cc8c0f None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:51.063308 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 450/887] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:26:50 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 22:26:51.085314 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba0132a-1b4b-4f5b-a8c2-b99c6146f141 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:51.169434 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27dc742-ffe3-4c69-95ad-effcd1cc8c0f None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:51.192593 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba0132a-1b4b-4f5b-a8c2-b99c6146f141 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:51.193833 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:51.205212 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bb061b-9187-4bea-a4c6-56e4e7f3d4dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:51.206350 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bb061b-9187-4bea-a4c6-56e4e7f3d4dd None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:51.206797 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bb061b-9187-4bea-a4c6-56e4e7f3d4dd None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:51.207234 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bb061b-9187-4bea-a4c6-56e4e7f3d4dd None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:51.208082 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bb061b-9187-4bea-a4c6-56e4e7f3d4dd None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:51.209653 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bb061b-9187-4bea-a4c6-56e4e7f3d4dd None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:51.222215 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-93bb061b-9187-4bea-a4c6-56e4e7f3d4dd None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 24 22:26:51.222215 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:51.222215 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 22:26:51.222215 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 22:26:51.222215 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 22:26:51.222215 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 22:26:51.222215 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 22:26:51.222215 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 22:26:51.222215 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 24 22:26:51.222215 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:26:51.222215 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 22:26:51.222215 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:26:51.222215 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:51.222215 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:51.222215 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:51.222215 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:51.223156 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:51.223156 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:51.223156 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:51.223156 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:51.223156 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:51.223156 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:51.223156 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:51.223156 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 22:26:51.223156 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 22:26:51.223156 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 22:26:51.223156 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 22:26:51.223156 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:51.223156 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:51.223156 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:51.223156 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:51.223156 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:51.224025 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:51.224025 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:51.224025 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:51.224025 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:51.224025 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:51.224025 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:51.224025 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:51.224025 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:51.224025 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:51.224025 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:51.224025 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:51.224025 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 22:26:51.224025 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 22:26:51.224025 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 24 22:26:51.224025 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:26:51.227005 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 438/888] 10.222.0.36 () {56 vars in 1132 bytes} [Fri Jun 24 22:26:51 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 22:26:51.233680 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bb061b-9187-4bea-a4c6-56e4e7f3d4dd None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:51.240090 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2138ec4-7ab7-4f93-912c-e65f19d9755f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:51.241182 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2138ec4-7ab7-4f93-912c-e65f19d9755f None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:51.241673 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2138ec4-7ab7-4f93-912c-e65f19d9755f None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:51.242192 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2138ec4-7ab7-4f93-912c-e65f19d9755f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:51.243075 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2138ec4-7ab7-4f93-912c-e65f19d9755f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:51.244786 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2138ec4-7ab7-4f93-912c-e65f19d9755f None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:51.258396 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-e2138ec4-7ab7-4f93-912c-e65f19d9755f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 22:26:51.258396 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:51.258396 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 22:26:51.258396 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 22:26:51.258396 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 22:26:51.258396 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 22:26:51.258396 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 22:26:51.258396 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 22:26:51.258396 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 22:26:51.258396 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:26:51.258396 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 22:26:51.258396 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:26:51.258396 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:51.258396 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:51.258396 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:51.258396 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:51.258396 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:51.259416 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:51.259416 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:51.259416 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:51.259416 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:51.259416 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:51.259416 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:51.259416 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 22:26:51.259416 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 22:26:51.259416 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 22:26:51.259416 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 22:26:51.259416 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:51.259416 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:51.259416 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:51.259416 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:51.259416 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:51.259416 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:51.260241 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:51.260241 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:51.260241 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:51.260241 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:51.260241 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:51.260241 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:51.260241 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:51.260241 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:51.260241 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:51.260241 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:51.260241 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 22:26:51.260241 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 22:26:51.260241 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 22:26:51.260241 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:26:51.268030 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 451/889] 10.222.0.36 () {56 vars in 1126 bytes} [Fri Jun 24 22:26:51 2022] GET /identity/v3/services/object-store => generated 93 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 22:26:51.269547 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2138ec4-7ab7-4f93-912c-e65f19d9755f None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:51.296323 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:51.354186 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bb061b-9187-4bea-a4c6-56e4e7f3d4dd None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:51.376759 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2138ec4-7ab7-4f93-912c-e65f19d9755f None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:51.396701 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcab79a-6fd7-4a07-9441-482af1bf4fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:51.397374 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcab79a-6fd7-4a07-9441-482af1bf4fc8 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:51.397652 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcab79a-6fd7-4a07-9441-482af1bf4fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:51.397926 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcab79a-6fd7-4a07-9441-482af1bf4fc8 None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:51.398887 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcab79a-6fd7-4a07-9441-482af1bf4fc8 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:51.400590 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcab79a-6fd7-4a07-9441-482af1bf4fc8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:51.402273 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcab79a-6fd7-4a07-9441-482af1bf4fc8 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:51.409632 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 439/890] 10.222.0.36 () {56 vars in 1126 bytes} [Fri Jun 24 22:26:51 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:51.414892 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcab79a-6fd7-4a07-9441-482af1bf4fc8 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:51.418721 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6517916d-6099-4517-951a-b6b31795bf89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:51.419623 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6517916d-6099-4517-951a-b6b31795bf89 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:51.420049 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6517916d-6099-4517-951a-b6b31795bf89 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:51.420513 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6517916d-6099-4517-951a-b6b31795bf89 None admin] PATH_INFO: `/v3/services` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:51.421424 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6517916d-6099-4517-951a-b6b31795bf89 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:51.421933 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6517916d-6099-4517-951a-b6b31795bf89 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:51.423540 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6517916d-6099-4517-951a-b6b31795bf89 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:51.433715 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 452/891] 10.222.0.36 () {56 vars in 1122 bytes} [Fri Jun 24 22:26:51 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 22:26:51.434650 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6517916d-6099-4517-951a-b6b31795bf89 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:51.493269 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:51.528948 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:51.543127 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6517916d-6099-4517-951a-b6b31795bf89 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:51.564179 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcab79a-6fd7-4a07-9441-482af1bf4fc8 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:51.586559 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4762f2b1-5b52-4d34-9167-e54b9aca3148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:51.587235 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4762f2b1-5b52-4d34-9167-e54b9aca3148 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:51.587544 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4762f2b1-5b52-4d34-9167-e54b9aca3148 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:51.587820 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4762f2b1-5b52-4d34-9167-e54b9aca3148 None admin] PATH_INFO: `/v3/services` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:51.589024 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4762f2b1-5b52-4d34-9167-e54b9aca3148 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:51.589337 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4762f2b1-5b52-4d34-9167-e54b9aca3148 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:51.591262 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4762f2b1-5b52-4d34-9167-e54b9aca3148 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:51.599397 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 453/892] 10.222.0.36 () {56 vars in 1122 bytes} [Fri Jun 24 22:26:51 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:51.609635 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b3a766-a454-409f-bd10-44e0c4e76a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:51.610326 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b3a766-a454-409f-bd10-44e0c4e76a90 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:51.610683 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b3a766-a454-409f-bd10-44e0c4e76a90 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:51.610995 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b3a766-a454-409f-bd10-44e0c4e76a90 None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:51.611829 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b3a766-a454-409f-bd10-44e0c4e76a90 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:51.612135 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b3a766-a454-409f-bd10-44e0c4e76a90 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:51.613561 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b3a766-a454-409f-bd10-44e0c4e76a90 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:51.619533 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 440/893] 10.222.0.36 () {56 vars in 1126 bytes} [Fri Jun 24 22:26:51 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 22:26:51.626007 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4762f2b1-5b52-4d34-9167-e54b9aca3148 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:51.738255 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4762f2b1-5b52-4d34-9167-e54b9aca3148 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:51.775956 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c4e58b-ec77-4cb0-a05c-4992b0959056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:51.776542 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c4e58b-ec77-4cb0-a05c-4992b0959056 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:51.776822 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c4e58b-ec77-4cb0-a05c-4992b0959056 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:51.777093 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c4e58b-ec77-4cb0-a05c-4992b0959056 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:51.777902 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c4e58b-ec77-4cb0-a05c-4992b0959056 None admin] RBAC: Adding query filter params (interface=public, service_id=5c337f4b0e454107bf8fc44cbaeff72c, region_id=RegionOne) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:51.778211 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c4e58b-ec77-4cb0-a05c-4992b0959056 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:51.779622 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c4e58b-ec77-4cb0-a05c-4992b0959056 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:51.785061 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 454/894] 10.222.0.36 () {56 vars in 1251 bytes} [Fri Jun 24 22:26:51 2022] GET /identity/v3/endpoints?service_id=5c337f4b0e454107bf8fc44cbaeff72c&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:51.790570 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b3a766-a454-409f-bd10-44e0c4e76a90 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:51.898921 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b3a766-a454-409f-bd10-44e0c4e76a90 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:51.915771 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:51.935412 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9058152b-4742-4c8f-9aeb-6e537ac30b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:51.936203 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058152b-4742-4c8f-9aeb-6e537ac30b3e None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:51.936370 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058152b-4742-4c8f-9aeb-6e537ac30b3e None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:51.936624 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058152b-4742-4c8f-9aeb-6e537ac30b3e None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:51.937303 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9058152b-4742-4c8f-9aeb-6e537ac30b3e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:51.938751 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9058152b-4742-4c8f-9aeb-6e537ac30b3e None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:51.945157 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 441/895] 10.222.0.36 () {56 vars in 1087 bytes} [Fri Jun 24 22:26:51 2022] GET /identity/v3/services => generated 1268 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:26:52.313659 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a75881-9e67-4f05-8e49-c31d5cd2e4a6 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:52.314195 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a75881-9e67-4f05-8e49-c31d5cd2e4a6 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:52.314195 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a75881-9e67-4f05-8e49-c31d5cd2e4a6 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:52.316002 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 455/896] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:26:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:26:52.321499 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cd7fc7-ca36-4d58-baa1-cb42f4c2ae88 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:52.321783 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cd7fc7-ca36-4d58-baa1-cb42f4c2ae88 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:52.322056 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cd7fc7-ca36-4d58-baa1-cb42f4c2ae88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:52.338963 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-92cd7fc7-ca36-4d58-baa1-cb42f4c2ae88 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:26:52.340241 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-92cd7fc7-ca36-4d58-baa1-cb42f4c2ae88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:26:52.412144 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 442/897] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:26:52 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 22:26:52.447069 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a75881-9e67-4f05-8e49-c31d5cd2e4a6 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:52.466477 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:52.552123 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a75881-9e67-4f05-8e49-c31d5cd2e4a6 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:52.587832 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d8316f-5c10-463c-a74c-bad2288ba206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:52.588546 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d8316f-5c10-463c-a74c-bad2288ba206 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:52.588819 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d8316f-5c10-463c-a74c-bad2288ba206 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:52.589096 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d8316f-5c10-463c-a74c-bad2288ba206 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:52.600674 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d8316f-5c10-463c-a74c-bad2288ba206 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 22:26:52.608881 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-42d8316f-5c10-463c-a74c-bad2288ba206 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 22:26:52.608881 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:52.608881 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:52.608881 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:52.608881 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:52.608881 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:52.608881 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:52.608881 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:52.608881 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:52.608881 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:52.608881 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:52.608881 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:52.608881 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 22:26:52.608881 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 22:26:52.608881 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 22:26:52.608881 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 22:26:52.609792 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 22:26:52.609792 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 22:26:52.609792 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 22:26:52.609792 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 22:26:52.609792 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:52.609792 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:52.609792 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:52.609792 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:52.609792 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:52.609792 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:52.609792 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:52.609792 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:52.609792 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:52.609792 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:52.609792 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:52.609792 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:52.611060 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:52.611060 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:52.611060 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:52.611060 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:52.611060 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 22:26:52.611060 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 22:26:52.611060 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 22:26:52.611060 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 22:26:52.611060 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 22:26:52.611060 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 22:26:52.611060 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 22:26:52.611060 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:26:52.611060 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 456/898] 10.222.0.36 () {56 vars in 1120 bytes} [Fri Jun 24 22:26:52 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:52.618413 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cd7fc7-ca36-4d58-baa1-cb42f4c2ae88 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:52.721744 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cd7fc7-ca36-4d58-baa1-cb42f4c2ae88 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:52.733046 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:52.759297 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e800d59d-0736-4a40-99db-91261449dbd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:52.759987 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e800d59d-0736-4a40-99db-91261449dbd9 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:52.760268 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e800d59d-0736-4a40-99db-91261449dbd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:52.760543 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e800d59d-0736-4a40-99db-91261449dbd9 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:52.761301 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e800d59d-0736-4a40-99db-91261449dbd9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:52.761609 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e800d59d-0736-4a40-99db-91261449dbd9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:52.762999 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e800d59d-0736-4a40-99db-91261449dbd9 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:52.771790 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 443/899] 10.222.0.36 () {56 vars in 1115 bytes} [Fri Jun 24 22:26:52 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:52.780537 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d8316f-5c10-463c-a74c-bad2288ba206 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:52.793412 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa415d28-6148-48cf-9df8-4777f600dc52 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:52.793708 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa415d28-6148-48cf-9df8-4777f600dc52 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:52.793992 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa415d28-6148-48cf-9df8-4777f600dc52 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:52.795632 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 444/900] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:26:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:26:52.800410 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c52fae-152e-4aa9-8feb-a64e8755b758 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:52.800702 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c52fae-152e-4aa9-8feb-a64e8755b758 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:52.800986 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c52fae-152e-4aa9-8feb-a64e8755b758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:52.818819 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-27c52fae-152e-4aa9-8feb-a64e8755b758 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:26:52.820336 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-27c52fae-152e-4aa9-8feb-a64e8755b758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:26:52.864369 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:52.892738 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d8316f-5c10-463c-a74c-bad2288ba206 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:52.911283 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 445/901] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:26:52 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 22:26:52.928936 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c52fae-152e-4aa9-8feb-a64e8755b758 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:52.938153 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea088e0-ed1b-43c2-997c-e9f64b36a983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:52.939383 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea088e0-ed1b-43c2-997c-e9f64b36a983 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:52.939918 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea088e0-ed1b-43c2-997c-e9f64b36a983 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:52.940408 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea088e0-ed1b-43c2-997c-e9f64b36a983 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:52.952762 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea088e0-ed1b-43c2-997c-e9f64b36a983 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:52.955547 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea088e0-ed1b-43c2-997c-e9f64b36a983 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:52.977619 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-bea088e0-ed1b-43c2-997c-e9f64b36a983 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:52.977619 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:52.977619 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:52.977619 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:52.977619 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:52.977619 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:52.977619 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:52.977619 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:52.977619 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:52.977619 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:52.977619 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:52.977619 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:52.977619 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 22:26:52.977619 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 22:26:52.977619 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 22:26:52.978557 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 22:26:52.978557 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:52.978557 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:52.978557 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:52.978557 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:52.978557 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:52.978557 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:52.978557 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:52.978557 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:52.978557 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:52.978557 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:52.978557 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:52.978557 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:52.978557 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:52.978557 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:52.978557 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:52.978557 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:52.979535 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 22:26:52.979535 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 22:26:52.979535 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:52.979535 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:26:52.981873 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 457/902] 10.222.0.36 () {56 vars in 1108 bytes} [Fri Jun 24 22:26:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:52.996598 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea088e0-ed1b-43c2-997c-e9f64b36a983 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:53.042358 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c52fae-152e-4aa9-8feb-a64e8755b758 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:53.063706 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:53.087271 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b0cb08-96cc-40c2-8f09-eb4e4b892f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:53.088216 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b0cb08-96cc-40c2-8f09-eb4e4b892f6a None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:53.088565 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b0cb08-96cc-40c2-8f09-eb4e4b892f6a None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:53.088906 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b0cb08-96cc-40c2-8f09-eb4e4b892f6a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:53.090027 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b0cb08-96cc-40c2-8f09-eb4e4b892f6a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:53.091889 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b0cb08-96cc-40c2-8f09-eb4e4b892f6a None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:53.106810 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-91b0cb08-96cc-40c2-8f09-eb4e4b892f6a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 24 22:26:53.106810 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:53.106810 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 22:26:53.106810 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 22:26:53.106810 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 22:26:53.106810 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 22:26:53.106810 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 22:26:53.106810 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 22:26:53.106810 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 24 22:26:53.106810 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:26:53.106810 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 22:26:53.106810 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:26:53.106810 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:53.106810 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:53.106810 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:53.106810 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:53.106810 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:53.107844 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:53.107844 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:53.107844 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:53.107844 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:53.107844 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:53.107844 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:53.107844 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 22:26:53.107844 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 22:26:53.107844 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 22:26:53.107844 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 22:26:53.107844 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:53.107844 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:53.107844 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:53.107844 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:53.107844 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:53.107844 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:53.108654 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:53.108654 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:53.108654 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:53.108654 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:53.108654 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:53.108654 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:53.108654 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:53.108654 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:53.108654 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:53.108654 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:53.108654 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 22:26:53.108654 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 22:26:53.108654 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 24 22:26:53.108654 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:26:53.109390 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 446/903] 10.222.0.36 () {56 vars in 1114 bytes} [Fri Jun 24 22:26:52 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:53.115364 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b0cb08-96cc-40c2-8f09-eb4e4b892f6a None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:53.119369 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea088e0-ed1b-43c2-997c-e9f64b36a983 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:53.148684 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:53.159215 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e45e18-7205-4245-b448-690a6b26b18c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:53.160459 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e45e18-7205-4245-b448-690a6b26b18c None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:53.160948 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e45e18-7205-4245-b448-690a6b26b18c None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:53.161421 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e45e18-7205-4245-b448-690a6b26b18c None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:53.162407 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e45e18-7205-4245-b448-690a6b26b18c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:53.162910 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e45e18-7205-4245-b448-690a6b26b18c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:53.164747 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e45e18-7205-4245-b448-690a6b26b18c None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:53.177348 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 458/904] 10.222.0.36 () {56 vars in 1109 bytes} [Fri Jun 24 22:26:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:53.184051 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e45e18-7205-4245-b448-690a6b26b18c None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:53.249174 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b0cb08-96cc-40c2-8f09-eb4e4b892f6a None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:53.287634 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea127a0-f1dc-4ae6-a12c-02be0276543c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:53.288808 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea127a0-f1dc-4ae6-a12c-02be0276543c None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:53.289601 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea127a0-f1dc-4ae6-a12c-02be0276543c None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:53.290088 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea127a0-f1dc-4ae6-a12c-02be0276543c None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:53.290997 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea127a0-f1dc-4ae6-a12c-02be0276543c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:53.291599 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea127a0-f1dc-4ae6-a12c-02be0276543c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:53.293304 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea127a0-f1dc-4ae6-a12c-02be0276543c None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:53.298605 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e45e18-7205-4245-b448-690a6b26b18c None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:53.298946 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 447/905] 10.222.0.36 () {56 vars in 1114 bytes} [Fri Jun 24 22:26:53 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 22:26:53.304968 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea127a0-f1dc-4ae6-a12c-02be0276543c None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:53.339003 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:53.341970 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df935b9d-978e-42ac-ad7a-7529c310393d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:53.342845 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df935b9d-978e-42ac-ad7a-7529c310393d None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:53.343126 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df935b9d-978e-42ac-ad7a-7529c310393d None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:53.343580 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df935b9d-978e-42ac-ad7a-7529c310393d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:53.358279 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df935b9d-978e-42ac-ad7a-7529c310393d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:53.360487 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df935b9d-978e-42ac-ad7a-7529c310393d None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:53.379962 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-df935b9d-978e-42ac-ad7a-7529c310393d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 22:26:53.379962 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:53.379962 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:53.379962 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:53.379962 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:53.379962 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:53.379962 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:53.379962 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:53.379962 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:53.379962 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:53.379962 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:53.379962 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:53.379962 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 22:26:53.379962 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 22:26:53.379962 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 22:26:53.379962 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 22:26:53.381219 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:53.381219 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:53.381219 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 22:26:53.381219 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 22:26:53.381219 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 22:26:53.381219 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 22:26:53.381219 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:53.381219 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:53.381219 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:53.381219 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:53.381219 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:53.381219 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:53.381219 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:53.381219 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:53.381219 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:53.381219 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:53.381219 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:53.381219 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:53.382173 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:53.382173 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:53.382173 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 22:26:53.382173 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 22:26:53.382173 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 22:26:53.382173 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 22:26:53.382173 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 22:26:53.382173 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 22:26:53.382173 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 22:26:53.382173 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:26:53.382173 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 459/906] 10.222.0.36 () {56 vars in 1117 bytes} [Fri Jun 24 22:26:53 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 22:26:53.389645 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df935b9d-978e-42ac-ad7a-7529c310393d None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:53.441104 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea127a0-f1dc-4ae6-a12c-02be0276543c None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:53.442359 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:53.481029 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d090a373-bfb2-4fae-82c4-8dde6cbd2192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:53.482051 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d090a373-bfb2-4fae-82c4-8dde6cbd2192 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:53.482498 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d090a373-bfb2-4fae-82c4-8dde6cbd2192 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:53.482932 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d090a373-bfb2-4fae-82c4-8dde6cbd2192 None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:53.483813 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d090a373-bfb2-4fae-82c4-8dde6cbd2192 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:53.484258 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d090a373-bfb2-4fae-82c4-8dde6cbd2192 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:53.485870 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d090a373-bfb2-4fae-82c4-8dde6cbd2192 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:53.491983 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 448/907] 10.222.0.36 () {56 vars in 1114 bytes} [Fri Jun 24 22:26:53 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 22:26:53.497496 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d090a373-bfb2-4fae-82c4-8dde6cbd2192 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:53.504688 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df935b9d-978e-42ac-ad7a-7529c310393d None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:53.548702 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f72e06-426b-481d-8a15-f11d08a1c6bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:53.549414 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f72e06-426b-481d-8a15-f11d08a1c6bf None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:53.549695 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f72e06-426b-481d-8a15-f11d08a1c6bf None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:53.549969 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f72e06-426b-481d-8a15-f11d08a1c6bf None admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:53.550815 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f72e06-426b-481d-8a15-f11d08a1c6bf None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:53.551126 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f72e06-426b-481d-8a15-f11d08a1c6bf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:53.553627 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f72e06-426b-481d-8a15-f11d08a1c6bf None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:53.581978 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 460/908] 10.222.0.36 () {56 vars in 1149 bytes} [Fri Jun 24 22:26:53 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:53.583567 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f72e06-426b-481d-8a15-f11d08a1c6bf None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:53.612521 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:53.621223 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d090a373-bfb2-4fae-82c4-8dde6cbd2192 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:53.659058 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdcf30b-5569-4131-b857-c0b82f7fceac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:53.659681 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdcf30b-5569-4131-b857-c0b82f7fceac None admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:53.659961 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdcf30b-5569-4131-b857-c0b82f7fceac None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:53.660238 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdcf30b-5569-4131-b857-c0b82f7fceac None admin] PATH_INFO: `/v3/endpoints` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:53.660986 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdcf30b-5569-4131-b857-c0b82f7fceac None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:53.662415 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdcf30b-5569-4131-b857-c0b82f7fceac None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:53.687298 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 449/909] 10.222.0.36 () {60 vars in 1144 bytes} [Fri Jun 24 22:26:53 2022] POST /identity/v3/endpoints => generated 346 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 22:26:53.704245 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f72e06-426b-481d-8a15-f11d08a1c6bf None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:53.713683 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:53.752974 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61581672-ede1-42f3-a340-63c60f2a3036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:53.753693 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61581672-ede1-42f3-a340-63c60f2a3036 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:53.753992 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61581672-ede1-42f3-a340-63c60f2a3036 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:53.754269 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61581672-ede1-42f3-a340-63c60f2a3036 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:53.830926 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e461690b-5caa-4e6e-8c86-ca11517d795c None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:53.831239 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e461690b-5caa-4e6e-8c86-ca11517d795c None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:53.831515 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e461690b-5caa-4e6e-8c86-ca11517d795c None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:53.832943 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61581672-ede1-42f3-a340-63c60f2a3036 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:53.833215 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 450/910] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:26:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:26:53.834539 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61581672-ede1-42f3-a340-63c60f2a3036 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:53.838893 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3800558-2747-434e-9b28-7156c4177ca2 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:53.839204 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3800558-2747-434e-9b28-7156c4177ca2 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:53.839496 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3800558-2747-434e-9b28-7156c4177ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:53.857711 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-e3800558-2747-434e-9b28-7156c4177ca2 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:26:53.858951 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-e3800558-2747-434e-9b28-7156c4177ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:26:53.936863 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 451/911] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:26:53 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 22:26:53.949781 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 461/912] 10.222.0.36 () {58 vars in 1282 bytes} [Fri Jun 24 22:26:53 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 24 22:26:53.955555 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3800558-2747-434e-9b28-7156c4177ca2 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:53.960366 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61581672-ede1-42f3-a340-63c60f2a3036 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:53.963012 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:54.052067 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:54.072997 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3800558-2747-434e-9b28-7156c4177ca2 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:54.073335 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61581672-ede1-42f3-a340-63c60f2a3036 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:54.109801 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b35b31-befd-47dc-8aae-3171a4f381c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:54.110451 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df953b72-9f67-43d0-b6de-a6d3533dc432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:54.110613 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b35b31-befd-47dc-8aae-3171a4f381c7 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:54.110907 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b35b31-befd-47dc-8aae-3171a4f381c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:54.111144 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df953b72-9f67-43d0-b6de-a6d3533dc432 None admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:54.111292 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b35b31-befd-47dc-8aae-3171a4f381c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:54.111500 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df953b72-9f67-43d0-b6de-a6d3533dc432 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:54.111768 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df953b72-9f67-43d0-b6de-a6d3533dc432 None admin] PATH_INFO: `/v3/services` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:54.112506 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df953b72-9f67-43d0-b6de-a6d3533dc432 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:54.113888 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df953b72-9f67-43d0-b6de-a6d3533dc432 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:54.122696 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b35b31-befd-47dc-8aae-3171a4f381c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:54.124199 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b35b31-befd-47dc-8aae-3171a4f381c7 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:54.130036 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 462/913] 10.222.0.36 () {60 vars in 1141 bytes} [Fri Jun 24 22:26:53 2022] POST /identity/v3/services => generated 241 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 22:26:54.132440 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3a2b9f-2728-4f13-b6f0-53781ac9940e None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:54.133064 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3a2b9f-2728-4f13-b6f0-53781ac9940e None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:54.134160 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3a2b9f-2728-4f13-b6f0-53781ac9940e None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:54.140606 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 463/914] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:26:54 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:26:54.142436 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf4bb99-33c0-4525-96ac-9b89ed735b6e None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:54.142954 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf4bb99-33c0-4525-96ac-9b89ed735b6e None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:54.143425 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-06b35b31-befd-47dc-8aae-3171a4f381c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:54.143425 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:54.143425 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:54.143425 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:54.143425 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:54.143425 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:54.143425 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:54.143425 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:54.143425 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:54.143425 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:54.143425 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:54.143425 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:54.143425 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 22:26:54.143425 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 22:26:54.143425 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 22:26:54.144366 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 22:26:54.144366 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:54.144366 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:54.144366 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:54.144366 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:54.144366 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:54.144366 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:54.144366 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:54.144366 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:54.144366 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:54.144366 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:54.144366 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:54.144366 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:54.144366 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:54.144366 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:54.144366 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:54.144366 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:54.145323 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 22:26:54.145323 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 22:26:54.145323 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:54.145323 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:26:54.146085 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf4bb99-33c0-4525-96ac-9b89ed735b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:54.149609 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 452/915] 10.222.0.36 () {56 vars in 1108 bytes} [Fri Jun 24 22:26:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 22:26:54.150860 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b35b31-befd-47dc-8aae-3171a4f381c7 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:54.172967 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-aaf4bb99-33c0-4525-96ac-9b89ed735b6e None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:26:54.175158 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-aaf4bb99-33c0-4525-96ac-9b89ed735b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:26:54.260728 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:54.280039 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b35b31-befd-47dc-8aae-3171a4f381c7 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:54.287539 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 464/916] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:26:54 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 22:26:54.306439 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf4bb99-33c0-4525-96ac-9b89ed735b6e None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:54.325118 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:54.330657 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5257f6b6-47fe-4cb7-ab26-7aa9e8dd3736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:54.332093 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5257f6b6-47fe-4cb7-ab26-7aa9e8dd3736 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:54.332093 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5257f6b6-47fe-4cb7-ab26-7aa9e8dd3736 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:54.332093 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5257f6b6-47fe-4cb7-ab26-7aa9e8dd3736 None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:54.332618 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5257f6b6-47fe-4cb7-ab26-7aa9e8dd3736 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:54.332929 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5257f6b6-47fe-4cb7-ab26-7aa9e8dd3736 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:54.335039 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5257f6b6-47fe-4cb7-ab26-7aa9e8dd3736 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:54.351354 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 453/917] 10.222.0.36 () {56 vars in 1109 bytes} [Fri Jun 24 22:26:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:54.353951 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5257f6b6-47fe-4cb7-ab26-7aa9e8dd3736 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:54.422859 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf4bb99-33c0-4525-96ac-9b89ed735b6e None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:54.465585 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1700739-5ea0-4b02-bbac-947ec14bfa6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:54.466412 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1700739-5ea0-4b02-bbac-947ec14bfa6c None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:54.466692 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1700739-5ea0-4b02-bbac-947ec14bfa6c None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:54.466998 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1700739-5ea0-4b02-bbac-947ec14bfa6c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:54.467664 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1700739-5ea0-4b02-bbac-947ec14bfa6c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:54.469057 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1700739-5ea0-4b02-bbac-947ec14bfa6c None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:54.476045 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5257f6b6-47fe-4cb7-ab26-7aa9e8dd3736 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:54.481758 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-e1700739-5ea0-4b02-bbac-947ec14bfa6c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 24 22:26:54.481758 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:54.481758 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 22:26:54.481758 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 22:26:54.481758 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 22:26:54.481758 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 22:26:54.481758 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 22:26:54.481758 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 22:26:54.481758 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 24 22:26:54.481758 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:26:54.481758 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 22:26:54.481758 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:26:54.481758 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:54.481758 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:54.481758 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:54.481758 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:54.482769 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:54.482769 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:54.482769 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:54.482769 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:54.482769 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:54.482769 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:54.482769 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:54.482769 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 22:26:54.482769 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 22:26:54.482769 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 22:26:54.482769 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 22:26:54.482769 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:54.482769 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:54.482769 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:54.482769 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:54.482769 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:54.483617 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:54.483617 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:54.483617 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:54.483617 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:54.483617 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:54.483617 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:54.483617 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:54.483617 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:54.483617 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:54.483617 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:54.483617 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:54.483617 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 22:26:54.483617 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 22:26:54.483617 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 24 22:26:54.483617 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:26:54.483617 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 465/918] 10.222.0.36 () {56 vars in 1132 bytes} [Fri Jun 24 22:26:54 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 22:26:54.490450 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1700739-5ea0-4b02-bbac-947ec14bfa6c None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:54.521031 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fda316c-54e8-4bdc-a0d8-0793b43fb06c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:54.521765 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fda316c-54e8-4bdc-a0d8-0793b43fb06c None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:54.522048 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fda316c-54e8-4bdc-a0d8-0793b43fb06c None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:54.522335 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fda316c-54e8-4bdc-a0d8-0793b43fb06c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:54.529916 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fda316c-54e8-4bdc-a0d8-0793b43fb06c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:54.531418 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fda316c-54e8-4bdc-a0d8-0793b43fb06c None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:54.546931 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-2fda316c-54e8-4bdc-a0d8-0793b43fb06c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 22:26:54.546931 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:54.546931 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:54.546931 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:54.546931 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:54.546931 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:54.546931 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:54.546931 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:54.546931 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:54.546931 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:54.546931 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:54.546931 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:54.546931 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 22:26:54.546931 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 22:26:54.546931 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 22:26:54.547924 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 22:26:54.547924 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:54.547924 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:54.547924 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:54.547924 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:54.547924 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:54.547924 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:54.547924 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:54.547924 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:54.547924 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:54.547924 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:54.547924 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:54.547924 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:54.547924 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:54.547924 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:54.547924 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:54.547924 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:54.548780 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 22:26:54.548780 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 22:26:54.548780 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 22:26:54.548780 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 22:26:54.548780 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 22:26:54.548780 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 22:26:54.548780 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 22:26:54.548780 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:26:54.548780 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 454/919] 10.222.0.36 () {56 vars in 1111 bytes} [Fri Jun 24 22:26:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:54.550441 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:54.556340 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fda316c-54e8-4bdc-a0d8-0793b43fb06c None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:54.601718 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1700739-5ea0-4b02-bbac-947ec14bfa6c None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:54.625673 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:54.643969 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a6a801-4dfd-4f75-9449-dca8495a88a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:54.644687 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a6a801-4dfd-4f75-9449-dca8495a88a8 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:54.644964 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a6a801-4dfd-4f75-9449-dca8495a88a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:54.645237 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a6a801-4dfd-4f75-9449-dca8495a88a8 None admin] PATH_INFO: `/v3/services` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:54.645944 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a6a801-4dfd-4f75-9449-dca8495a88a8 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:54.646250 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a6a801-4dfd-4f75-9449-dca8495a88a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:54.647677 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a6a801-4dfd-4f75-9449-dca8495a88a8 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:54.653244 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 466/920] 10.222.0.36 () {56 vars in 1126 bytes} [Fri Jun 24 22:26:54 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:54.659042 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a6a801-4dfd-4f75-9449-dca8495a88a8 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:54.683568 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fda316c-54e8-4bdc-a0d8-0793b43fb06c None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:54.728064 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaeaaaf-38c4-4b3c-a166-8526ee229826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:54.728840 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaeaaaf-38c4-4b3c-a166-8526ee229826 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:54.729446 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaeaaaf-38c4-4b3c-a166-8526ee229826 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:54.729811 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaeaaaf-38c4-4b3c-a166-8526ee229826 None admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:54.731333 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaeaaaf-38c4-4b3c-a166-8526ee229826 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:54.731710 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaeaaaf-38c4-4b3c-a166-8526ee229826 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:54.733468 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaeaaaf-38c4-4b3c-a166-8526ee229826 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:54.754278 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 455/921] 10.222.0.36 () {56 vars in 1148 bytes} [Fri Jun 24 22:26:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 22:26:54.755968 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaeaaaf-38c4-4b3c-a166-8526ee229826 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:54.783830 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a6a801-4dfd-4f75-9449-dca8495a88a8 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:54.803759 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:54.826430 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99437e9-5cd3-4e8f-ae1c-85620aa37545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:54.827298 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99437e9-5cd3-4e8f-ae1c-85620aa37545 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:54.827674 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99437e9-5cd3-4e8f-ae1c-85620aa37545 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:54.828225 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99437e9-5cd3-4e8f-ae1c-85620aa37545 None admin] PATH_INFO: `/v3/services` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:54.829506 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99437e9-5cd3-4e8f-ae1c-85620aa37545 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:54.830053 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99437e9-5cd3-4e8f-ae1c-85620aa37545 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:54.831873 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99437e9-5cd3-4e8f-ae1c-85620aa37545 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:54.843475 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 467/922] 10.222.0.36 () {56 vars in 1126 bytes} [Fri Jun 24 22:26:54 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 22:26:54.844471 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99437e9-5cd3-4e8f-ae1c-85620aa37545 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:54.887628 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaeaaaf-38c4-4b3c-a166-8526ee229826 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:54.906739 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:54.937694 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537b8055-c629-47f7-9cac-3d1ed15aa172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:54.938892 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537b8055-c629-47f7-9cac-3d1ed15aa172 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:54.939175 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537b8055-c629-47f7-9cac-3d1ed15aa172 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:54.939473 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537b8055-c629-47f7-9cac-3d1ed15aa172 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:54.940306 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537b8055-c629-47f7-9cac-3d1ed15aa172 None admin] RBAC: Adding query filter params (role.id=89095043d87040e39cf7bd2875c789f2, scope.project.id=d189b31bbec0469381292d2cde3cb420, user.id=542ea2e5a8114792836d0cdfd36b4c51) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:54.941045 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537b8055-c629-47f7-9cac-3d1ed15aa172 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:54.942967 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537b8055-c629-47f7-9cac-3d1ed15aa172 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:54.955386 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 456/923] 10.222.0.36 () {56 vars in 1374 bytes} [Fri Jun 24 22:26:54 2022] GET /identity/v3/role_assignments?user.id=542ea2e5a8114792836d0cdfd36b4c51&scope.project.id=d189b31bbec0469381292d2cde3cb420&role.id=89095043d87040e39cf7bd2875c789f2 => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 22:26:54.973467 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99437e9-5cd3-4e8f-ae1c-85620aa37545 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:55.013252 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219603f9-9878-4eac-b669-f398e3749f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:55.013996 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219603f9-9878-4eac-b669-f398e3749f0f None admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:55.014276 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219603f9-9878-4eac-b669-f398e3749f0f None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:55.014546 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219603f9-9878-4eac-b669-f398e3749f0f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:55.015391 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219603f9-9878-4eac-b669-f398e3749f0f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:55.016857 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219603f9-9878-4eac-b669-f398e3749f0f None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:55.042780 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 468/924] 10.222.0.36 () {60 vars in 1144 bytes} [Fri Jun 24 22:26:54 2022] POST /identity/v3/endpoints => generated 347 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:26:55.826714 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b80386-2ba9-4231-ad8e-214ea500d2f7 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:55.827479 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b80386-2ba9-4231-ad8e-214ea500d2f7 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:55.827479 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b80386-2ba9-4231-ad8e-214ea500d2f7 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:55.828837 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 457/925] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:26:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:26:55.834335 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2301531-1d3e-49d8-8708-57b8e25a4375 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:55.834816 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2301531-1d3e-49d8-8708-57b8e25a4375 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:55.834985 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2301531-1d3e-49d8-8708-57b8e25a4375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:55.851939 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-f2301531-1d3e-49d8-8708-57b8e25a4375 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:26:55.853126 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-f2301531-1d3e-49d8-8708-57b8e25a4375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:26:55.881672 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:55.929236 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 469/926] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:26:55 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 22:26:55.952163 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b80386-2ba9-4231-ad8e-214ea500d2f7 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:56.054904 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b80386-2ba9-4231-ad8e-214ea500d2f7 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:56.089457 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f0e235-3f49-40db-82c7-bd4b00b96b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:56.090056 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f0e235-3f49-40db-82c7-bd4b00b96b63 None admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:56.090336 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f0e235-3f49-40db-82c7-bd4b00b96b63 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:56.090607 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f0e235-3f49-40db-82c7-bd4b00b96b63 None admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:56.091367 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f0e235-3f49-40db-82c7-bd4b00b96b63 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:56.092852 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f0e235-3f49-40db-82c7-bd4b00b96b63 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:56.094283 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: WARNING keystone.server.flask.common [None req-b6f0e235-3f49-40db-82c7-bd4b00b96b63 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 24 22:26:56.115113 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.sql.core [None req-b6f0e235-3f49-40db-82c7-bd4b00b96b63 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 24 22:26:56.115113 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 24 22:26:56.115113 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [parameters: {'id': 'bf199fb59ea241b6976829acdef17eb5', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 24 22:26:56.115113 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80214) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 24 22:26:56.123432 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-b6f0e235-3f49-40db-82c7-bd4b00b96b63 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id bf199fb59ea241b6976829acdef17eb5.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id bf199fb59ea241b6976829acdef17eb5. Jun 24 22:26:56.123432 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:56.123432 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 24 22:26:56.123432 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 24 22:26:56.123432 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 24 22:26:56.123432 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 24 22:26:56.123432 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 24 22:26:56.123432 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application result = self._query(query) Jun 24 22:26:56.123432 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 24 22:26:56.123432 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application conn.query(q) Jun 24 22:26:56.123432 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 24 22:26:56.123432 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 24 22:26:56.123432 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 24 22:26:56.124251 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application result.read() Jun 24 22:26:56.124251 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 24 22:26:56.124251 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 24 22:26:56.124251 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 24 22:26:56.124251 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 24 22:26:56.124251 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 24 22:26:56.124251 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 24 22:26:56.124251 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 24 22:26:56.124251 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 24 22:26:56.124251 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 24 22:26:56.124251 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:26:56.124251 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 24 22:26:56.124251 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:26:56.124251 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:56.124251 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 24 22:26:56.124251 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 24 22:26:56.124251 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 24 22:26:56.124251 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 24 22:26:56.125507 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 24 22:26:56.125507 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application next(self.gen) Jun 24 22:26:56.125507 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 24 22:26:56.125507 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application yield resource Jun 24 22:26:56.125507 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 24 22:26:56.125507 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application next(self.gen) Jun 24 22:26:56.125507 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 24 22:26:56.125507 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self.session.rollback() Jun 24 22:26:56.125507 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 24 22:26:56.125507 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self.force_reraise() Jun 24 22:26:56.125507 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 24 22:26:56.125507 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise self.value Jun 24 22:26:56.125507 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 24 22:26:56.125507 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 24 22:26:56.125507 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 24 22:26:56.125507 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application session.commit() Jun 24 22:26:56.125507 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 24 22:26:56.126563 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 24 22:26:56.126563 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 24 22:26:56.126563 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._prepare_impl() Jun 24 22:26:56.126563 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 24 22:26:56.126563 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self.session.flush() Jun 24 22:26:56.126563 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 24 22:26:56.126563 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._flush(objects) Jun 24 22:26:56.126563 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 24 22:26:56.126563 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 24 22:26:56.126563 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 24 22:26:56.126563 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application compat.raise_( Jun 24 22:26:56.126563 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 24 22:26:56.126563 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception Jun 24 22:26:56.126563 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 24 22:26:56.126563 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application flush_context.execute() Jun 24 22:26:56.126563 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 24 22:26:56.126563 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rec.execute(self) Jun 24 22:26:56.127480 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 24 22:26:56.127480 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 24 22:26:56.127480 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 24 22:26:56.127480 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 24 22:26:56.127480 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 24 22:26:56.127480 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 24 22:26:56.127480 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 24 22:26:56.127480 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 24 22:26:56.127480 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 24 22:26:56.127480 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 24 22:26:56.127480 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 24 22:26:56.127480 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 24 22:26:56.127480 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 24 22:26:56.127480 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 24 22:26:56.127480 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 24 22:26:56.128249 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 24 22:26:56.128249 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 24 22:26:56.128249 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception Jun 24 22:26:56.128249 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 24 22:26:56.128249 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 24 22:26:56.128249 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 24 22:26:56.128249 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 24 22:26:56.128249 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 24 22:26:56.128249 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application result = self._query(query) Jun 24 22:26:56.128249 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 24 22:26:56.128249 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application conn.query(q) Jun 24 22:26:56.128249 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 24 22:26:56.128249 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 24 22:26:56.128249 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 24 22:26:56.128249 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application result.read() Jun 24 22:26:56.128249 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 24 22:26:56.128249 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 24 22:26:56.129114 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 24 22:26:56.129114 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 24 22:26:56.129114 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 24 22:26:56.129114 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 24 22:26:56.129114 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 24 22:26:56.129114 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 24 22:26:56.129114 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 24 22:26:56.129114 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 24 22:26:56.129114 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [parameters: {'id': 'bf199fb59ea241b6976829acdef17eb5', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 24 22:26:56.129114 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 24 22:26:56.129114 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:26:56.129114 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 22:26:56.129114 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:26:56.129114 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:56.129114 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 24 22:26:56.135764 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 24 22:26:56.135764 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 24 22:26:56.135764 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 24 22:26:56.135764 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 24 22:26:56.135764 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:26:56.135764 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 22:26:56.135764 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:26:56.135764 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:56.135764 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:56.135764 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:56.135764 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:56.135764 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:56.135764 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:56.135764 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:56.135764 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:56.135764 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:56.135764 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:56.137925 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:56.137925 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 24 22:26:56.137925 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 24 22:26:56.137925 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:56.137925 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:56.137925 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 24 22:26:56.137925 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 24 22:26:56.137925 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id bf199fb59ea241b6976829acdef17eb5. Jun 24 22:26:56.137925 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:26:56.137925 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 458/927] 10.222.0.36 () {60 vars in 1140 bytes} [Fri Jun 24 22:26:55 2022] POST /identity/v3/projects => generated 262 bytes in 173 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:56.139222 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2301531-1d3e-49d8-8708-57b8e25a4375 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:56.233107 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2301531-1d3e-49d8-8708-57b8e25a4375 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:56.273635 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dda58f-6256-4e95-b03d-b87f6f03c758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:56.274437 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dda58f-6256-4e95-b03d-b87f6f03c758 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:56.274713 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dda58f-6256-4e95-b03d-b87f6f03c758 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:56.274978 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dda58f-6256-4e95-b03d-b87f6f03c758 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:56.281879 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dda58f-6256-4e95-b03d-b87f6f03c758 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:56.283360 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dda58f-6256-4e95-b03d-b87f6f03c758 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:56.296903 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-73dda58f-6256-4e95-b03d-b87f6f03c758 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 22:26:56.296903 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:56.296903 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:56.296903 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:56.296903 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:56.296903 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:56.296903 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:56.296903 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:56.296903 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:56.296903 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:56.296903 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:56.296903 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:56.296903 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 22:26:56.296903 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 22:26:56.296903 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 22:26:56.297802 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 22:26:56.297802 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:56.297802 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:56.297802 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:56.297802 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:56.297802 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:56.297802 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:56.297802 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:56.297802 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:56.297802 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:56.297802 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:56.297802 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:56.297802 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:56.297802 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:56.297802 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:56.297802 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:56.297802 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:56.298855 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 22:26:56.298855 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 22:26:56.298855 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 22:26:56.298855 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 22:26:56.298855 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 22:26:56.298855 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 22:26:56.298855 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 22:26:56.298855 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:26:56.298855 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 470/928] 10.222.0.36 () {56 vars in 1111 bytes} [Fri Jun 24 22:26:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:56.304139 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f0e235-3f49-40db-82c7-bd4b00b96b63 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:56.333927 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22032025-ba51-4f1d-87c3-1c4586099daf None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:56.334270 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22032025-ba51-4f1d-87c3-1c4586099daf None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:56.334525 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22032025-ba51-4f1d-87c3-1c4586099daf None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:56.336463 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 471/929] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:26:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:26:56.337281 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:56.341713 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84377d3-8bd3-42a5-b599-bd4daa7e0c20 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:56.342191 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84377d3-8bd3-42a5-b599-bd4daa7e0c20 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:56.342191 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84377d3-8bd3-42a5-b599-bd4daa7e0c20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:56.359460 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-e84377d3-8bd3-42a5-b599-bd4daa7e0c20 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:26:56.360689 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-e84377d3-8bd3-42a5-b599-bd4daa7e0c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:26:56.377394 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:56.417772 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f0e235-3f49-40db-82c7-bd4b00b96b63 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:56.447282 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 472/930] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:26:56 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 22:26:56.464749 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84377d3-8bd3-42a5-b599-bd4daa7e0c20 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:56.472480 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2560b80-e452-4934-9e37-ac968c9b3c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:56.473487 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2560b80-e452-4934-9e37-ac968c9b3c13 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:56.473974 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2560b80-e452-4934-9e37-ac968c9b3c13 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:56.474465 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2560b80-e452-4934-9e37-ac968c9b3c13 None admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:56.475580 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2560b80-e452-4934-9e37-ac968c9b3c13 None admin] RBAC: Adding query filter params (name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:56.476253 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2560b80-e452-4934-9e37-ac968c9b3c13 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:56.478119 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2560b80-e452-4934-9e37-ac968c9b3c13 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:56.500730 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 459/931] 10.222.0.36 () {56 vars in 1112 bytes} [Fri Jun 24 22:26:56 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:56.575153 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84377d3-8bd3-42a5-b599-bd4daa7e0c20 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:56.612220 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2624f2-a070-4d99-b2b1-a98962720726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:56.613053 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2624f2-a070-4d99-b2b1-a98962720726 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:56.613332 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2624f2-a070-4d99-b2b1-a98962720726 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:56.613600 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2624f2-a070-4d99-b2b1-a98962720726 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:56.614332 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2624f2-a070-4d99-b2b1-a98962720726 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:56.615790 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2624f2-a070-4d99-b2b1-a98962720726 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:56.629137 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-ca2624f2-a070-4d99-b2b1-a98962720726 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 22:26:56.629137 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:56.629137 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 22:26:56.629137 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 22:26:56.629137 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 22:26:56.629137 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 22:26:56.629137 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 22:26:56.629137 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 22:26:56.629137 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 22:26:56.629137 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:26:56.629137 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 22:26:56.629137 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:26:56.629137 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:56.629137 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:56.629137 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:56.629137 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:56.629137 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:56.630216 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:56.630216 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:56.630216 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:56.630216 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:56.630216 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:56.630216 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:56.630216 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 22:26:56.630216 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 22:26:56.630216 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 22:26:56.630216 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 22:26:56.630216 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:56.630216 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:56.630216 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:56.630216 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:56.630216 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:56.630216 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:56.631463 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:56.631463 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:56.631463 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:56.631463 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:56.631463 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:56.631463 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:56.631463 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:56.631463 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:56.631463 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:56.631463 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:56.631463 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 22:26:56.631463 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 22:26:56.631463 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 22:26:56.631463 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:26:56.631463 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 473/932] 10.222.0.36 () {56 vars in 1126 bytes} [Fri Jun 24 22:26:56 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:56.639138 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2560b80-e452-4934-9e37-ac968c9b3c13 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:56.739959 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:56.749010 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2560b80-e452-4934-9e37-ac968c9b3c13 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:56.784663 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b73deaa-5cb5-4b19-a45c-8ec6701c4f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:56.785336 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b73deaa-5cb5-4b19-a45c-8ec6701c4f48 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:56.785615 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b73deaa-5cb5-4b19-a45c-8ec6701c4f48 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:56.785887 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b73deaa-5cb5-4b19-a45c-8ec6701c4f48 None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:56.786600 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b73deaa-5cb5-4b19-a45c-8ec6701c4f48 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:56.786899 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b73deaa-5cb5-4b19-a45c-8ec6701c4f48 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:56.788313 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b73deaa-5cb5-4b19-a45c-8ec6701c4f48 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:56.793816 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 460/933] 10.222.0.36 () {56 vars in 1122 bytes} [Fri Jun 24 22:26:56 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 22:26:56.799470 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2624f2-a070-4d99-b2b1-a98962720726 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:56.818852 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:56.916167 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2624f2-a070-4d99-b2b1-a98962720726 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:56.950452 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc70600-e640-4373-9d2f-6cd178c030c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:56.951130 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc70600-e640-4373-9d2f-6cd178c030c4 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:56.951524 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc70600-e640-4373-9d2f-6cd178c030c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:56.951802 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc70600-e640-4373-9d2f-6cd178c030c4 None admin] PATH_INFO: `/v3/services` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:56.952514 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc70600-e640-4373-9d2f-6cd178c030c4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:56.952820 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc70600-e640-4373-9d2f-6cd178c030c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:56.954217 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc70600-e640-4373-9d2f-6cd178c030c4 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:56.959667 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 474/934] 10.222.0.36 () {56 vars in 1122 bytes} [Fri Jun 24 22:26:56 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:56.966048 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b73deaa-5cb5-4b19-a45c-8ec6701c4f48 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:57.075662 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b73deaa-5cb5-4b19-a45c-8ec6701c4f48 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:57.102490 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b9e804-a3d7-4a99-914b-86db8e7500f2 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:57.102805 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b9e804-a3d7-4a99-914b-86db8e7500f2 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:57.103040 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b9e804-a3d7-4a99-914b-86db8e7500f2 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:57.104721 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 475/935] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:26:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:26:57.109694 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6f7ecc-edb7-4111-bb46-efb22af32c89 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:57.109985 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6f7ecc-edb7-4111-bb46-efb22af32c89 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:57.110266 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6f7ecc-edb7-4111-bb46-efb22af32c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:57.113121 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e652ab-a88b-414b-9232-94493c3221ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:57.114058 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e652ab-a88b-414b-9232-94493c3221ff None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:57.114593 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e652ab-a88b-414b-9232-94493c3221ff None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:57.115073 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e652ab-a88b-414b-9232-94493c3221ff None admin] PATH_INFO: `/v3/endpoints` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:57.116068 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e652ab-a88b-414b-9232-94493c3221ff None admin] RBAC: Adding query filter params (interface=public, service_id=efe71b8399a64d009f41aadf7b650669, region_id=RegionOne) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:57.116579 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e652ab-a88b-414b-9232-94493c3221ff None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:57.118271 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e652ab-a88b-414b-9232-94493c3221ff None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:57.124246 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 461/936] 10.222.0.36 () {56 vars in 1251 bytes} [Fri Jun 24 22:26:56 2022] GET /identity/v3/endpoints?service_id=efe71b8399a64d009f41aadf7b650669&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:57.129166 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-2a6f7ecc-edb7-4111-bb46-efb22af32c89 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:26:57.129586 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e652ab-a88b-414b-9232-94493c3221ff None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:57.131033 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-2a6f7ecc-edb7-4111-bb46-efb22af32c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:26:57.159542 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:57.235731 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 476/937] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:26:57 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 22:26:57.252179 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b45f534-abbd-4a88-874c-202f9d420661 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:57.252571 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b45f534-abbd-4a88-874c-202f9d420661 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:57.252914 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b45f534-abbd-4a88-874c-202f9d420661 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:57.258419 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 477/938] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:26:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 22:26:57.259032 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e652ab-a88b-414b-9232-94493c3221ff None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:57.259518 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b45f534-abbd-4a88-874c-202f9d420661 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:57.271864 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:57.295505 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e7d143-a42d-4c27-abe3-ed886b16f277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:57.296269 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e7d143-a42d-4c27-abe3-ed886b16f277 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:57.296558 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e7d143-a42d-4c27-abe3-ed886b16f277 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:57.296963 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e7d143-a42d-4c27-abe3-ed886b16f277 None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:57.297656 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e7d143-a42d-4c27-abe3-ed886b16f277 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:57.299098 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e7d143-a42d-4c27-abe3-ed886b16f277 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:57.311608 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 462/939] 10.222.0.36 () {56 vars in 1087 bytes} [Fri Jun 24 22:26:57 2022] GET /identity/v3/services => generated 1497 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:26:57.313012 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bbe84e-422e-48ad-82bf-fac77bef845c None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:57.313306 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bbe84e-422e-48ad-82bf-fac77bef845c None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:57.313590 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bbe84e-422e-48ad-82bf-fac77bef845c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:57.341269 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-d8bbe84e-422e-48ad-82bf-fac77bef845c None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:26:57.343135 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-d8bbe84e-422e-48ad-82bf-fac77bef845c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:26:57.391493 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b45f534-abbd-4a88-874c-202f9d420661 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:57.439483 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 463/940] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:26:57 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 22:26:57.456205 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bbe84e-422e-48ad-82bf-fac77bef845c None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:57.456553 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6355f624-81a6-46f0-844b-e6e5b2b3f9b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:57.457342 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6355f624-81a6-46f0-844b-e6e5b2b3f9b8 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:57.457674 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6355f624-81a6-46f0-844b-e6e5b2b3f9b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:57.457957 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6355f624-81a6-46f0-844b-e6e5b2b3f9b8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:57.470752 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6355f624-81a6-46f0-844b-e6e5b2b3f9b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 22:26:57.476731 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:57.479479 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-6355f624-81a6-46f0-844b-e6e5b2b3f9b8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 22:26:57.479479 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:57.479479 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:57.479479 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:57.479479 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:57.479479 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:57.479479 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:57.479479 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:57.479479 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:57.479479 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:57.479479 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:57.479479 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:57.479479 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 22:26:57.479479 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 22:26:57.479479 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 22:26:57.479479 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 22:26:57.481537 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 22:26:57.481537 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 22:26:57.481537 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 22:26:57.481537 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 22:26:57.481537 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:57.481537 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:57.481537 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:57.481537 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:57.481537 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:57.481537 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:57.481537 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:57.481537 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:57.481537 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:57.481537 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:57.481537 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:57.481537 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:57.482859 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:57.482859 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:57.482859 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:57.482859 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:57.482859 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 22:26:57.482859 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 22:26:57.482859 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 22:26:57.482859 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 22:26:57.482859 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 22:26:57.482859 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 22:26:57.482859 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 22:26:57.482859 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:26:57.482859 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 478/941] 10.222.0.36 () {56 vars in 1120 bytes} [Fri Jun 24 22:26:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:57.488215 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6355f624-81a6-46f0-844b-e6e5b2b3f9b8 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:57.579929 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:57.586203 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bbe84e-422e-48ad-82bf-fac77bef845c None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:57.621817 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19d9c18-eeda-49a9-9cf8-c9eef8b15468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:57.622155 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6355f624-81a6-46f0-844b-e6e5b2b3f9b8 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:57.623146 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d9c18-eeda-49a9-9cf8-c9eef8b15468 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:57.623675 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d9c18-eeda-49a9-9cf8-c9eef8b15468 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:57.624155 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d9c18-eeda-49a9-9cf8-c9eef8b15468 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:57.625020 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19d9c18-eeda-49a9-9cf8-c9eef8b15468 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:57.626598 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19d9c18-eeda-49a9-9cf8-c9eef8b15468 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:57.639181 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-b19d9c18-eeda-49a9-9cf8-c9eef8b15468 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 24 22:26:57.639181 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:57.639181 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 22:26:57.639181 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 22:26:57.639181 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 22:26:57.639181 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 22:26:57.639181 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 22:26:57.639181 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 22:26:57.639181 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 24 22:26:57.639181 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:26:57.639181 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 22:26:57.639181 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:26:57.639181 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:57.639181 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:57.639181 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:57.639181 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:57.639181 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:57.640204 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:57.640204 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:57.640204 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:57.640204 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:57.640204 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:57.640204 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:57.640204 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 22:26:57.640204 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 22:26:57.640204 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 22:26:57.640204 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 22:26:57.640204 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:57.640204 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:57.640204 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:57.640204 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:57.640204 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:57.640204 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:57.641033 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:57.641033 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:57.641033 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:57.641033 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:57.641033 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:57.641033 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:57.641033 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:57.641033 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:57.641033 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:57.641033 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:57.641033 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 22:26:57.641033 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 22:26:57.641033 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 24 22:26:57.641033 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:26:57.648762 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 464/942] 10.222.0.36 () {56 vars in 1111 bytes} [Fri Jun 24 22:26:57 2022] GET /identity/v3/services/compute => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 22:26:57.650246 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19d9c18-eeda-49a9-9cf8-c9eef8b15468 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:57.660264 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c920bfd3-352c-422d-8675-d886f03b2914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:57.660964 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c920bfd3-352c-422d-8675-d886f03b2914 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:57.661241 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c920bfd3-352c-422d-8675-d886f03b2914 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:57.661519 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c920bfd3-352c-422d-8675-d886f03b2914 None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:57.662278 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c920bfd3-352c-422d-8675-d886f03b2914 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:57.662582 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c920bfd3-352c-422d-8675-d886f03b2914 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:57.664577 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c920bfd3-352c-422d-8675-d886f03b2914 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:57.676405 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 479/943] 10.222.0.36 () {56 vars in 1115 bytes} [Fri Jun 24 22:26:57 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:57.682083 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c920bfd3-352c-422d-8675-d886f03b2914 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:57.737029 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:57.762646 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19d9c18-eeda-49a9-9cf8-c9eef8b15468 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:57.794486 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c920bfd3-352c-422d-8675-d886f03b2914 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:57.800254 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8034109-3b72-4225-9106-3e18103a7e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:57.801206 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8034109-3b72-4225-9106-3e18103a7e0b None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:57.801689 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8034109-3b72-4225-9106-3e18103a7e0b None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:57.802611 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8034109-3b72-4225-9106-3e18103a7e0b None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:57.803568 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8034109-3b72-4225-9106-3e18103a7e0b None admin] RBAC: Adding query filter params (name=compute) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:57.804462 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8034109-3b72-4225-9106-3e18103a7e0b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:57.807014 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8034109-3b72-4225-9106-3e18103a7e0b None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:57.818464 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 465/944] 10.222.0.36 () {56 vars in 1112 bytes} [Fri Jun 24 22:26:57 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 22:26:57.820506 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8034109-3b72-4225-9106-3e18103a7e0b None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:57.827892 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:57.833221 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deed39c3-547e-40ee-842f-1cbf277bac66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:57.834561 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deed39c3-547e-40ee-842f-1cbf277bac66 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:57.835174 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deed39c3-547e-40ee-842f-1cbf277bac66 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:57.835596 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deed39c3-547e-40ee-842f-1cbf277bac66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:57.847695 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deed39c3-547e-40ee-842f-1cbf277bac66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:57.849909 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deed39c3-547e-40ee-842f-1cbf277bac66 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:57.872610 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-deed39c3-547e-40ee-842f-1cbf277bac66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:57.872610 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:57.872610 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:57.872610 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:57.872610 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:57.872610 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:57.872610 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:57.872610 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:57.872610 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:57.872610 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:57.872610 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:57.872610 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:57.872610 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 22:26:57.872610 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 22:26:57.872610 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 22:26:57.873629 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 22:26:57.873629 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:57.873629 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:57.873629 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:57.873629 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:57.873629 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:57.873629 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:57.873629 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:57.873629 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:57.873629 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:57.873629 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:57.873629 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:57.873629 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:57.873629 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:57.873629 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:57.873629 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:57.873629 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:57.874501 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 22:26:57.874501 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 22:26:57.874501 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:57.874501 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:26:57.879413 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 480/945] 10.222.0.36 () {56 vars in 1108 bytes} [Fri Jun 24 22:26:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 22:26:57.880782 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deed39c3-547e-40ee-842f-1cbf277bac66 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:57.952554 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8034109-3b72-4225-9106-3e18103a7e0b None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:57.991400 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1366d9-1f5e-4046-8feb-137feaa6728a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:57.992195 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1366d9-1f5e-4046-8feb-137feaa6728a None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:57.992397 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1366d9-1f5e-4046-8feb-137feaa6728a None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:57.992649 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1366d9-1f5e-4046-8feb-137feaa6728a None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:57.993429 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1366d9-1f5e-4046-8feb-137feaa6728a None admin] RBAC: Adding query filter params (type=compute) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:57.993649 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1366d9-1f5e-4046-8feb-137feaa6728a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:57.995035 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1366d9-1f5e-4046-8feb-137feaa6728a None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:58.000024 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 466/946] 10.222.0.36 () {56 vars in 1112 bytes} [Fri Jun 24 22:26:57 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 22:26:58.007295 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deed39c3-547e-40ee-842f-1cbf277bac66 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:58.046146 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db7895a-2a60-4483-93ab-bfc58af69b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:58.046746 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db7895a-2a60-4483-93ab-bfc58af69b8b None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:58.047029 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db7895a-2a60-4483-93ab-bfc58af69b8b None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:58.047338 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db7895a-2a60-4483-93ab-bfc58af69b8b None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:58.048085 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db7895a-2a60-4483-93ab-bfc58af69b8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:58.048394 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db7895a-2a60-4483-93ab-bfc58af69b8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:58.049841 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db7895a-2a60-4483-93ab-bfc58af69b8b None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:58.064856 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 481/947] 10.222.0.36 () {56 vars in 1109 bytes} [Fri Jun 24 22:26:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:58.071154 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1366d9-1f5e-4046-8feb-137feaa6728a None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:58.081164 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:58.185596 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1366d9-1f5e-4046-8feb-137feaa6728a None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:58.220616 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab82e534-c9d3-47d8-939f-34768cab11f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:58.221831 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab82e534-c9d3-47d8-939f-34768cab11f0 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:58.222325 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab82e534-c9d3-47d8-939f-34768cab11f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:58.222806 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab82e534-c9d3-47d8-939f-34768cab11f0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:58.231091 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab82e534-c9d3-47d8-939f-34768cab11f0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:58.232961 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab82e534-c9d3-47d8-939f-34768cab11f0 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:58.248100 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-ab82e534-c9d3-47d8-939f-34768cab11f0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 22:26:58.248100 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:58.248100 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:58.248100 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:58.248100 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:58.248100 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:58.248100 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:58.248100 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:58.248100 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:58.248100 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:58.248100 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:58.248100 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:58.248100 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 22:26:58.248100 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 22:26:58.248100 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 22:26:58.248100 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 22:26:58.249061 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:58.249061 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:58.249061 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 22:26:58.249061 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 22:26:58.249061 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 22:26:58.249061 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 22:26:58.249061 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:58.249061 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:58.249061 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:58.249061 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:58.249061 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:58.249061 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:58.249061 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:58.249061 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:58.249061 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:58.249061 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:58.249061 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:58.249061 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:58.250060 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:58.250060 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:58.250060 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 22:26:58.250060 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 22:26:58.250060 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 22:26:58.250060 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 22:26:58.250060 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 22:26:58.250060 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 22:26:58.250060 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 22:26:58.250060 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:26:58.252979 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 467/948] 10.222.0.36 () {56 vars in 1117 bytes} [Fri Jun 24 22:26:58 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:58.263279 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db7895a-2a60-4483-93ab-bfc58af69b8b None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:58.307564 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:58.362819 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db7895a-2a60-4483-93ab-bfc58af69b8b None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:58.398377 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ebcd8e-e50d-4b86-a450-266e8ddac3f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:58.399074 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ebcd8e-e50d-4b86-a450-266e8ddac3f3 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:58.399392 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ebcd8e-e50d-4b86-a450-266e8ddac3f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:58.399670 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ebcd8e-e50d-4b86-a450-266e8ddac3f3 None admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:58.400510 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ebcd8e-e50d-4b86-a450-266e8ddac3f3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:58.400820 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ebcd8e-e50d-4b86-a450-266e8ddac3f3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:58.402273 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ebcd8e-e50d-4b86-a450-266e8ddac3f3 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:58.419961 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 482/949] 10.222.0.36 () {56 vars in 1149 bytes} [Fri Jun 24 22:26:58 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:58.425561 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab82e534-c9d3-47d8-939f-34768cab11f0 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:58.499633 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:58.537726 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab82e534-c9d3-47d8-939f-34768cab11f0 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:58.576725 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738169a4-202f-4494-ab4c-2aaa2a8b3ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:58.577451 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738169a4-202f-4494-ab4c-2aaa2a8b3ee3 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:58.577740 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738169a4-202f-4494-ab4c-2aaa2a8b3ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:58.578021 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738169a4-202f-4494-ab4c-2aaa2a8b3ee3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:58.589644 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738169a4-202f-4494-ab4c-2aaa2a8b3ee3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:58.591134 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738169a4-202f-4494-ab4c-2aaa2a8b3ee3 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:58.609161 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-738169a4-202f-4494-ab4c-2aaa2a8b3ee3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:58.609161 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:58.609161 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:58.609161 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:58.609161 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:58.609161 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:58.609161 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:58.609161 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:58.609161 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:58.609161 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:58.609161 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:58.609161 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:58.609161 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 22:26:58.609161 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 22:26:58.609161 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 22:26:58.610073 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 22:26:58.610073 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:58.610073 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:58.610073 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:58.610073 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:58.610073 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:58.610073 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:58.610073 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:58.610073 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:58.610073 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:58.610073 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:58.610073 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:58.610073 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:58.610073 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:58.610073 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:58.610073 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:58.610073 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:58.610945 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 22:26:58.610945 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 22:26:58.610945 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:26:58.610945 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:26:58.610945 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 468/950] 10.222.0.36 () {56 vars in 1108 bytes} [Fri Jun 24 22:26:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:58.617012 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ebcd8e-e50d-4b86-a450-266e8ddac3f3 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:58.692929 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d986f278-e0d3-4311-ae01-f70567194654 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:58.693270 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d986f278-e0d3-4311-ae01-f70567194654 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:58.693476 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d986f278-e0d3-4311-ae01-f70567194654 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:58.695301 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 469/951] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:26:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:26:58.700609 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c2b22-ed78-42a9-a962-a57a0df8c07c None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:58.700893 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c2b22-ed78-42a9-a962-a57a0df8c07c None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:58.701170 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c2b22-ed78-42a9-a962-a57a0df8c07c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:58.718922 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-5f4c2b22-ed78-42a9-a962-a57a0df8c07c None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:26:58.720151 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-5f4c2b22-ed78-42a9-a962-a57a0df8c07c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:26:58.721155 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ebcd8e-e50d-4b86-a450-266e8ddac3f3 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:58.722987 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:58.757284 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182f5ac8-308b-4da1-8468-5bdef7442ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:58.758013 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182f5ac8-308b-4da1-8468-5bdef7442ba3 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:58.758326 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182f5ac8-308b-4da1-8468-5bdef7442ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:58.758572 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182f5ac8-308b-4da1-8468-5bdef7442ba3 None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:58.759320 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182f5ac8-308b-4da1-8468-5bdef7442ba3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:58.759629 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182f5ac8-308b-4da1-8468-5bdef7442ba3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:58.761135 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182f5ac8-308b-4da1-8468-5bdef7442ba3 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:58.773122 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 483/952] 10.222.0.36 () {56 vars in 1109 bytes} [Fri Jun 24 22:26:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:58.779650 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182f5ac8-308b-4da1-8468-5bdef7442ba3 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:58.799363 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 470/953] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:26:58 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 22:26:58.820303 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4c2b22-ed78-42a9-a962-a57a0df8c07c None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:58.879997 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:58.896066 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182f5ac8-308b-4da1-8468-5bdef7442ba3 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:58.939539 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf29186-14e6-431e-8574-7c02a0c12e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:58.940735 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf29186-14e6-431e-8574-7c02a0c12e83 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:58.941384 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf29186-14e6-431e-8574-7c02a0c12e83 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:58.941834 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf29186-14e6-431e-8574-7c02a0c12e83 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:58.945759 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4c2b22-ed78-42a9-a962-a57a0df8c07c None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:58.950817 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf29186-14e6-431e-8574-7c02a0c12e83 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:58.952325 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf29186-14e6-431e-8574-7c02a0c12e83 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:58.973833 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-dbf29186-14e6-431e-8574-7c02a0c12e83 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 22:26:58.973833 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:58.973833 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:58.973833 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:58.973833 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:58.973833 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:58.973833 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:58.973833 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:58.973833 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:58.973833 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:58.973833 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:58.973833 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:58.973833 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 22:26:58.973833 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 22:26:58.973833 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 22:26:58.974737 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 22:26:58.974737 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:58.974737 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:58.974737 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:58.974737 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:58.974737 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:58.974737 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:58.974737 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:58.974737 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:58.974737 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:58.974737 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:58.974737 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:58.974737 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:58.974737 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:58.974737 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:58.974737 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:58.974737 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:58.975861 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 22:26:58.975861 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 22:26:58.975861 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 22:26:58.975861 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 22:26:58.975861 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 22:26:58.975861 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 22:26:58.975861 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 22:26:58.975861 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:26:58.979310 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 484/954] 10.222.0.36 () {56 vars in 1111 bytes} [Fri Jun 24 22:26:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:58.982227 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf29186-14e6-431e-8574-7c02a0c12e83 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:58.996211 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c273c710-afc8-440b-a225-e93e1fc448df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:58.996902 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c273c710-afc8-440b-a225-e93e1fc448df None admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:58.997189 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c273c710-afc8-440b-a225-e93e1fc448df None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:58.997471 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c273c710-afc8-440b-a225-e93e1fc448df None admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:58.998661 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c273c710-afc8-440b-a225-e93e1fc448df None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:59.000595 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c273c710-afc8-440b-a225-e93e1fc448df None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:59.016617 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:59.021295 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.sql.core [None req-c273c710-afc8-440b-a225-e93e1fc448df None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 24 22:26:59.021295 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 24 22:26:59.021295 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [parameters: {'user_id': 'fa56c89cdbc343e3b6c715a312869aab', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 24 22:26:59.021295 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80214) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 24 22:26:59.033531 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-c273c710-afc8-440b-a225-e93e1fc448df None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 24 22:26:59.033531 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:59.033531 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 24 22:26:59.033531 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 24 22:26:59.033531 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 24 22:26:59.033531 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 24 22:26:59.033531 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 24 22:26:59.033531 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application result = self._query(query) Jun 24 22:26:59.033531 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 24 22:26:59.033531 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application conn.query(q) Jun 24 22:26:59.033531 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 24 22:26:59.033531 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 24 22:26:59.033531 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 24 22:26:59.033531 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application result.read() Jun 24 22:26:59.033531 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 24 22:26:59.034447 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 24 22:26:59.034447 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 24 22:26:59.034447 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 24 22:26:59.034447 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 24 22:26:59.034447 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 24 22:26:59.034447 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 24 22:26:59.034447 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 24 22:26:59.034447 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 24 22:26:59.034447 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:26:59.034447 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 24 22:26:59.034447 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:26:59.034447 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:59.034447 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 24 22:26:59.034447 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 24 22:26:59.034447 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 24 22:26:59.034447 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 24 22:26:59.034447 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 24 22:26:59.034447 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application next(self.gen) Jun 24 22:26:59.035575 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 24 22:26:59.035575 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application yield resource Jun 24 22:26:59.035575 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 24 22:26:59.035575 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application next(self.gen) Jun 24 22:26:59.035575 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 24 22:26:59.035575 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self.session.rollback() Jun 24 22:26:59.035575 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 24 22:26:59.035575 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self.force_reraise() Jun 24 22:26:59.035575 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 24 22:26:59.035575 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise self.value Jun 24 22:26:59.035575 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 24 22:26:59.035575 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 24 22:26:59.035575 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 24 22:26:59.035575 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application session.commit() Jun 24 22:26:59.035575 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 24 22:26:59.035575 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 24 22:26:59.035575 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 24 22:26:59.036492 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._prepare_impl() Jun 24 22:26:59.036492 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 24 22:26:59.036492 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self.session.flush() Jun 24 22:26:59.036492 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 24 22:26:59.036492 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._flush(objects) Jun 24 22:26:59.036492 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 24 22:26:59.036492 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 24 22:26:59.036492 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 24 22:26:59.036492 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application compat.raise_( Jun 24 22:26:59.036492 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 24 22:26:59.036492 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception Jun 24 22:26:59.036492 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 24 22:26:59.036492 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application flush_context.execute() Jun 24 22:26:59.036492 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 24 22:26:59.036492 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rec.execute(self) Jun 24 22:26:59.036492 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 24 22:26:59.036492 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 24 22:26:59.037380 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 24 22:26:59.037380 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 24 22:26:59.037380 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 24 22:26:59.037380 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 24 22:26:59.037380 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 24 22:26:59.037380 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 24 22:26:59.037380 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 24 22:26:59.037380 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 24 22:26:59.037380 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 24 22:26:59.037380 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 24 22:26:59.037380 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 24 22:26:59.037380 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 24 22:26:59.037380 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 24 22:26:59.037380 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 24 22:26:59.037380 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 24 22:26:59.037380 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception Jun 24 22:26:59.038228 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 24 22:26:59.038228 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 24 22:26:59.038228 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 24 22:26:59.038228 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 24 22:26:59.038228 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 24 22:26:59.038228 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application result = self._query(query) Jun 24 22:26:59.038228 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 24 22:26:59.038228 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application conn.query(q) Jun 24 22:26:59.038228 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 24 22:26:59.038228 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 24 22:26:59.038228 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 24 22:26:59.038228 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application result.read() Jun 24 22:26:59.038228 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 24 22:26:59.038228 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 24 22:26:59.038228 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 24 22:26:59.038228 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 24 22:26:59.039179 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 24 22:26:59.039179 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 24 22:26:59.039179 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 24 22:26:59.039179 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 24 22:26:59.039179 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 24 22:26:59.039179 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 24 22:26:59.039179 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [parameters: {'user_id': 'fa56c89cdbc343e3b6c715a312869aab', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 24 22:26:59.039179 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 24 22:26:59.039179 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:26:59.039179 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 22:26:59.039179 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:26:59.039179 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:59.039179 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:59.039179 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:59.039179 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:59.041441 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:59.041441 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:59.041441 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:59.041441 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:59.041441 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:59.041441 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:59.041441 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:59.041441 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 24 22:26:59.041441 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 24 22:26:59.041441 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:59.041441 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:59.041441 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 22:26:59.041441 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 22:26:59.041441 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 22:26:59.041441 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 22:26:59.041441 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 24 22:26:59.041441 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 24 22:26:59.043157 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 24 22:26:59.043157 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 24 22:26:59.043157 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 24 22:26:59.043157 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 24 22:26:59.043157 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 24 22:26:59.043157 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:26:59.043157 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 471/955] 10.222.0.36 () {60 vars in 1131 bytes} [Fri Jun 24 22:26:58 2022] POST /identity/v3/users => generated 160 bytes in 215 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:59.043157 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c273c710-afc8-440b-a225-e93e1fc448df None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:59.120194 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf29186-14e6-431e-8574-7c02a0c12e83 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:59.165382 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b521938a-0fd8-415c-8771-1868dec78a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:59.165829 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c273c710-afc8-440b-a225-e93e1fc448df None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:59.166754 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b521938a-0fd8-415c-8771-1868dec78a7a None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:59.167218 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b521938a-0fd8-415c-8771-1868dec78a7a None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:59.168103 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b521938a-0fd8-415c-8771-1868dec78a7a None admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:59.170427 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b521938a-0fd8-415c-8771-1868dec78a7a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:59.170973 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b521938a-0fd8-415c-8771-1868dec78a7a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:59.172701 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b521938a-0fd8-415c-8771-1868dec78a7a None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:59.179405 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:59.191658 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 485/956] 10.222.0.36 () {56 vars in 1148 bytes} [Fri Jun 24 22:26:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:59.199373 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b521938a-0fd8-415c-8771-1868dec78a7a None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:59.212202 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f957d4-06de-41ff-a1a1-77f326945e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:59.213690 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f957d4-06de-41ff-a1a1-77f326945e12 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:59.214150 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f957d4-06de-41ff-a1a1-77f326945e12 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:59.214595 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f957d4-06de-41ff-a1a1-77f326945e12 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:59.225166 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f957d4-06de-41ff-a1a1-77f326945e12 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:59.227839 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f957d4-06de-41ff-a1a1-77f326945e12 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:59.245941 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-77f957d4-06de-41ff-a1a1-77f326945e12 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 24 22:26:59.245941 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:59.245941 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:59.245941 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:59.245941 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:59.245941 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:59.245941 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:59.245941 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:59.245941 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:59.245941 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:59.245941 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:59.245941 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:59.245941 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 22:26:59.245941 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 22:26:59.245941 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 22:26:59.245941 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 22:26:59.246912 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:59.246912 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:59.246912 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 22:26:59.246912 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 22:26:59.246912 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 22:26:59.246912 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 22:26:59.246912 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:59.246912 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:59.246912 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:59.246912 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:59.246912 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:59.246912 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:59.246912 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:59.246912 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:59.246912 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:59.246912 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:59.246912 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:59.246912 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:59.247884 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:59.247884 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:59.247884 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 22:26:59.247884 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 22:26:59.247884 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 22:26:59.247884 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 22:26:59.247884 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 22:26:59.247884 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 22:26:59.247884 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 24 22:26:59.247884 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:26:59.253762 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 472/957] 10.222.0.36 () {56 vars in 1099 bytes} [Fri Jun 24 22:26:59 2022] GET /identity/v3/users/cinder => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:26:59.254234 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f957d4-06de-41ff-a1a1-77f326945e12 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:59.306353 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:59.331450 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b521938a-0fd8-415c-8771-1868dec78a7a None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:59.376091 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a77973-a16b-4136-b007-edaee8d2b317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:59.377268 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a77973-a16b-4136-b007-edaee8d2b317 None admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:59.377561 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a77973-a16b-4136-b007-edaee8d2b317 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:59.377842 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a77973-a16b-4136-b007-edaee8d2b317 None admin] PATH_INFO: `/v3/projects/d189b31bbec0469381292d2cde3cb420/users/542ea2e5a8114792836d0cdfd36b4c51/roles/89095043d87040e39cf7bd2875c789f2` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:59.379909 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f957d4-06de-41ff-a1a1-77f326945e12 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:59.380114 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a77973-a16b-4136-b007-edaee8d2b317 None admin] RBAC: Authorizing `identity:create_grant(project_id=d189b31bbec0469381292d2cde3cb420, user_id=542ea2e5a8114792836d0cdfd36b4c51, role_id=89095043d87040e39cf7bd2875c789f2)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:59.382587 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a77973-a16b-4136-b007-edaee8d2b317 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:59.405466 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 486/958] 10.222.0.36 () {58 vars in 1439 bytes} [Fri Jun 24 22:26:59 2022] PUT /identity/v3/projects/d189b31bbec0469381292d2cde3cb420/users/542ea2e5a8114792836d0cdfd36b4c51/roles/89095043d87040e39cf7bd2875c789f2 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 22:26:59.429631 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e283476-a5d2-4a06-b716-14680516638c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:59.430651 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e283476-a5d2-4a06-b716-14680516638c None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:59.431149 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e283476-a5d2-4a06-b716-14680516638c None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:59.431575 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e283476-a5d2-4a06-b716-14680516638c None admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:59.432745 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e283476-a5d2-4a06-b716-14680516638c None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:59.433274 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e283476-a5d2-4a06-b716-14680516638c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:59.439274 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e283476-a5d2-4a06-b716-14680516638c None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:59.480253 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 473/959] 10.222.0.36 () {56 vars in 1101 bytes} [Fri Jun 24 22:26:59 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 22:26:59.524286 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c37f13-33c7-4ebb-8fe6-6e4205541fe9 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:59.524610 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c37f13-33c7-4ebb-8fe6-6e4205541fe9 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:59.524855 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c37f13-33c7-4ebb-8fe6-6e4205541fe9 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:59.526590 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 487/960] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:26:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:26:59.532553 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb0e138-4433-407f-964a-8798e626c008 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:59.532874 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb0e138-4433-407f-964a-8798e626c008 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:59.533120 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb0e138-4433-407f-964a-8798e626c008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:59.552526 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-9fb0e138-4433-407f-964a-8798e626c008 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:26:59.554159 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-9fb0e138-4433-407f-964a-8798e626c008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:26:59.584988 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:26:59.642168 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 474/961] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:26:59 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 22:26:59.665395 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c37f13-33c7-4ebb-8fe6-6e4205541fe9 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:59.777633 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c37f13-33c7-4ebb-8fe6-6e4205541fe9 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:59.813114 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4a4582-dbf2-4c59-a10e-e5416e18caae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:59.814005 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a4582-dbf2-4c59-a10e-e5416e18caae None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:59.814283 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a4582-dbf2-4c59-a10e-e5416e18caae None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:59.814552 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a4582-dbf2-4c59-a10e-e5416e18caae None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:59.815213 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4a4582-dbf2-4c59-a10e-e5416e18caae None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:59.816656 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4a4582-dbf2-4c59-a10e-e5416e18caae None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:59.829430 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-5a4a4582-dbf2-4c59-a10e-e5416e18caae None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 22:26:59.829430 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:59.829430 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 22:26:59.829430 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 22:26:59.829430 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 22:26:59.829430 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 22:26:59.829430 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 22:26:59.829430 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 22:26:59.829430 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 22:26:59.829430 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:26:59.829430 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 22:26:59.829430 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:26:59.829430 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:26:59.829430 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:26:59.829430 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:26:59.829430 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:26:59.829430 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:26:59.830457 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:26:59.830457 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:26:59.830457 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:26:59.830457 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:26:59.830457 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:26:59.830457 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:26:59.830457 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 22:26:59.830457 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 22:26:59.830457 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 22:26:59.830457 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 22:26:59.830457 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:26:59.830457 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:26:59.830457 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:26:59.830457 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:26:59.830457 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:26:59.830457 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:26:59.831698 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:26:59.831698 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:26:59.831698 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:26:59.831698 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:26:59.831698 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:26:59.831698 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:26:59.831698 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:26:59.831698 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:26:59.831698 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:26:59.831698 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:26:59.831698 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 22:26:59.831698 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 22:26:59.831698 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 22:26:59.831698 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:26:59.831698 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 488/962] 10.222.0.36 () {56 vars in 1126 bytes} [Fri Jun 24 22:26:59 2022] GET /identity/v3/services/object-store => generated 93 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 22:26:59.836897 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb0e138-4433-407f-964a-8798e626c008 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:26:59.940711 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb0e138-4433-407f-964a-8798e626c008 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:26:59.985234 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23eb3b5-5bb7-4f8c-b221-da32ed59e53b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:26:59.985911 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23eb3b5-5bb7-4f8c-b221-da32ed59e53b None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:26:59.986194 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23eb3b5-5bb7-4f8c-b221-da32ed59e53b None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:26:59.986468 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23eb3b5-5bb7-4f8c-b221-da32ed59e53b None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:26:59.987183 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23eb3b5-5bb7-4f8c-b221-da32ed59e53b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:26:59.987522 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23eb3b5-5bb7-4f8c-b221-da32ed59e53b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:26:59.988910 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23eb3b5-5bb7-4f8c-b221-da32ed59e53b None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:26:59.994199 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 475/963] 10.222.0.36 () {56 vars in 1122 bytes} [Fri Jun 24 22:26:59 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:26:59.999780 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4a4582-dbf2-4c59-a10e-e5416e18caae None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:00.010451 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:00.106180 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4a4582-dbf2-4c59-a10e-e5416e18caae None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:00.112871 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249d5b91-4127-4b11-abcc-d1e633eee4a8 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:00.113325 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249d5b91-4127-4b11-abcc-d1e633eee4a8 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:00.114078 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249d5b91-4127-4b11-abcc-d1e633eee4a8 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:00.115663 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 476/964] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:27:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:27:00.121057 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9861fd8e-a76a-407b-97a9-ef9c87eb6b8f None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:00.121643 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9861fd8e-a76a-407b-97a9-ef9c87eb6b8f None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:00.121643 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9861fd8e-a76a-407b-97a9-ef9c87eb6b8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:00.138848 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-9861fd8e-a76a-407b-97a9-ef9c87eb6b8f None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:27:00.140069 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-9861fd8e-a76a-407b-97a9-ef9c87eb6b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:27:00.144315 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8969c20-fec6-4d01-aaed-a1d6034c105c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:00.144989 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8969c20-fec6-4d01-aaed-a1d6034c105c None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:00.145266 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8969c20-fec6-4d01-aaed-a1d6034c105c None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:00.145535 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8969c20-fec6-4d01-aaed-a1d6034c105c None admin] PATH_INFO: `/v3/services` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:00.146232 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8969c20-fec6-4d01-aaed-a1d6034c105c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:27:00.146531 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8969c20-fec6-4d01-aaed-a1d6034c105c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:00.147988 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8969c20-fec6-4d01-aaed-a1d6034c105c None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:00.153366 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 489/965] 10.222.0.36 () {56 vars in 1122 bytes} [Fri Jun 24 22:26:59 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:27:00.159310 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:00.161013 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8969c20-fec6-4d01-aaed-a1d6034c105c None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:00.214363 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 477/966] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:27:00 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 22:27:00.233198 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:00.237261 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9861fd8e-a76a-407b-97a9-ef9c87eb6b8f None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:00.265180 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8969c20-fec6-4d01-aaed-a1d6034c105c None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:00.300346 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da808b68-eb81-454c-bea7-710ec8cc50bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:00.301001 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da808b68-eb81-454c-bea7-710ec8cc50bc None admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:00.301282 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da808b68-eb81-454c-bea7-710ec8cc50bc None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:00.301548 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da808b68-eb81-454c-bea7-710ec8cc50bc None admin] PATH_INFO: `/v3/endpoints` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:00.302283 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da808b68-eb81-454c-bea7-710ec8cc50bc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:00.304331 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da808b68-eb81-454c-bea7-710ec8cc50bc None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:00.325298 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 490/967] 10.222.0.36 () {60 vars in 1144 bytes} [Fri Jun 24 22:27:00 2022] POST /identity/v3/endpoints => generated 349 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:27:00.355510 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9861fd8e-a76a-407b-97a9-ef9c87eb6b8f None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:00.402937 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d59524-bc26-4d3a-ae95-85e6cf986be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:00.403577 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d59524-bc26-4d3a-ae95-85e6cf986be6 None admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:00.403841 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d59524-bc26-4d3a-ae95-85e6cf986be6 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:00.404111 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d59524-bc26-4d3a-ae95-85e6cf986be6 None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:00.404853 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d59524-bc26-4d3a-ae95-85e6cf986be6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:00.406258 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d59524-bc26-4d3a-ae95-85e6cf986be6 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:00.423133 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 478/968] 10.222.0.36 () {60 vars in 1141 bytes} [Fri Jun 24 22:27:00 2022] POST /identity/v3/services => generated 242 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 22:27:01.493048 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3a19da-edea-4fd8-9d29-0bd4f45c25c6 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:01.493576 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3a19da-edea-4fd8-9d29-0bd4f45c25c6 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:01.493576 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3a19da-edea-4fd8-9d29-0bd4f45c25c6 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:01.495282 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 491/969] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:27:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:27:01.500289 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7889a4db-ef85-46df-ad94-7a6b6b2772f3 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:01.500678 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7889a4db-ef85-46df-ad94-7a6b6b2772f3 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:01.500853 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7889a4db-ef85-46df-ad94-7a6b6b2772f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:01.522911 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-7889a4db-ef85-46df-ad94-7a6b6b2772f3 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:27:01.524339 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-7889a4db-ef85-46df-ad94-7a6b6b2772f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:27:01.526386 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:01.617349 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 479/970] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:27:01 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 22:27:01.640947 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3a19da-edea-4fd8-9d29-0bd4f45c25c6 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:01.748018 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3a19da-edea-4fd8-9d29-0bd4f45c25c6 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:01.773852 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:01.783579 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfbbda4-9235-48d9-9928-340e1e113896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:01.784364 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfbbda4-9235-48d9-9928-340e1e113896 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:01.784653 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfbbda4-9235-48d9-9928-340e1e113896 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:01.785117 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfbbda4-9235-48d9-9928-340e1e113896 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:01.797286 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfbbda4-9235-48d9-9928-340e1e113896 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 22:27:01.805487 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-8cfbbda4-9235-48d9-9928-340e1e113896 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 22:27:01.805487 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:27:01.805487 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:27:01.805487 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:27:01.805487 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:27:01.805487 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:27:01.805487 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:27:01.805487 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:27:01.805487 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:27:01.805487 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:27:01.805487 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:27:01.805487 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:27:01.805487 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 22:27:01.805487 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 22:27:01.805487 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 22:27:01.805487 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 22:27:01.806402 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 22:27:01.806402 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 22:27:01.806402 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 22:27:01.806402 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 22:27:01.806402 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:27:01.806402 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:27:01.806402 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:27:01.806402 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:27:01.806402 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:27:01.806402 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:27:01.806402 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:27:01.806402 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:27:01.806402 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:27:01.806402 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:27:01.806402 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:27:01.806402 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:27:01.807241 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:27:01.807241 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:27:01.807241 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:27:01.807241 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:27:01.807241 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 22:27:01.807241 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 22:27:01.807241 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 22:27:01.807241 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 22:27:01.807241 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 22:27:01.807241 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 22:27:01.807241 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 22:27:01.807241 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:27:01.811632 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 492/971] 10.222.0.36 () {56 vars in 1120 bytes} [Fri Jun 24 22:27:01 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:27:01.813090 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7889a4db-ef85-46df-ad94-7a6b6b2772f3 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:01.939771 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7889a4db-ef85-46df-ad94-7a6b6b2772f3 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:01.974788 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722f520f-5295-4cef-84b2-6afb34e96477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:01.975508 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f520f-5295-4cef-84b2-6afb34e96477 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:01.975795 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f520f-5295-4cef-84b2-6afb34e96477 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:01.976166 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f520f-5295-4cef-84b2-6afb34e96477 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:01.977037 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722f520f-5295-4cef-84b2-6afb34e96477 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:27:01.977347 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722f520f-5295-4cef-84b2-6afb34e96477 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:01.978736 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722f520f-5295-4cef-84b2-6afb34e96477 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:01.980325 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:01.989275 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 480/972] 10.222.0.36 () {56 vars in 1115 bytes} [Fri Jun 24 22:27:01 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:27:01.994810 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfbbda4-9235-48d9-9928-340e1e113896 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:02.098423 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfbbda4-9235-48d9-9928-340e1e113896 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:02.134536 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21be4b55-8ecb-423a-b0a7-67e2ab7ede91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:02.135745 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21be4b55-8ecb-423a-b0a7-67e2ab7ede91 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:02.136245 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21be4b55-8ecb-423a-b0a7-67e2ab7ede91 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:02.136753 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21be4b55-8ecb-423a-b0a7-67e2ab7ede91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:02.147739 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21be4b55-8ecb-423a-b0a7-67e2ab7ede91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:02.149679 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21be4b55-8ecb-423a-b0a7-67e2ab7ede91 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:02.169499 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-21be4b55-8ecb-423a-b0a7-67e2ab7ede91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:27:02.169499 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:27:02.169499 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:27:02.169499 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:27:02.169499 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:27:02.169499 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:27:02.169499 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:27:02.169499 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:27:02.169499 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:27:02.169499 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:27:02.169499 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:27:02.169499 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:27:02.169499 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 22:27:02.169499 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 22:27:02.169499 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 22:27:02.170612 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 22:27:02.170612 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:27:02.170612 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:27:02.170612 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:27:02.170612 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:27:02.170612 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:27:02.170612 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:27:02.170612 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:27:02.170612 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:27:02.170612 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:27:02.170612 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:27:02.170612 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:27:02.170612 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:27:02.170612 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:27:02.170612 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:27:02.170612 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:27:02.170612 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:27:02.171738 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 22:27:02.171738 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 22:27:02.171738 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:27:02.171738 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:27:02.173674 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 493/973] 10.222.0.36 () {56 vars in 1108 bytes} [Fri Jun 24 22:27:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:27:02.182442 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722f520f-5295-4cef-84b2-6afb34e96477 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:02.288124 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722f520f-5295-4cef-84b2-6afb34e96477 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:02.323732 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0560f6d2-09e1-445e-8300-c104776d0db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:02.324419 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0560f6d2-09e1-445e-8300-c104776d0db8 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:02.324705 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0560f6d2-09e1-445e-8300-c104776d0db8 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:02.324983 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0560f6d2-09e1-445e-8300-c104776d0db8 None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:02.325730 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0560f6d2-09e1-445e-8300-c104776d0db8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:27:02.326037 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0560f6d2-09e1-445e-8300-c104776d0db8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:02.327463 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0560f6d2-09e1-445e-8300-c104776d0db8 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:02.344672 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 481/974] 10.222.0.36 () {56 vars in 1109 bytes} [Fri Jun 24 22:27:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:27:02.345959 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21be4b55-8ecb-423a-b0a7-67e2ab7ede91 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:02.389560 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:02.395100 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69fdab9-e63a-4150-b768-31ead3fd8363 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:02.395368 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69fdab9-e63a-4150-b768-31ead3fd8363 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:02.395492 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69fdab9-e63a-4150-b768-31ead3fd8363 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:02.397058 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 482/975] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:27:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 22:27:02.402068 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f81883e-db77-451d-b45b-add33d748d62 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:02.402356 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f81883e-db77-451d-b45b-add33d748d62 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:02.402634 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f81883e-db77-451d-b45b-add33d748d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:02.419353 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-7f81883e-db77-451d-b45b-add33d748d62 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:27:02.420506 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-7f81883e-db77-451d-b45b-add33d748d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:27:02.451500 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21be4b55-8ecb-423a-b0a7-67e2ab7ede91 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:02.481290 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:02.487037 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f3abb4-d14c-4916-a6cb-da7eae1cf041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:02.487899 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f3abb4-d14c-4916-a6cb-da7eae1cf041 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:02.488200 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f3abb4-d14c-4916-a6cb-da7eae1cf041 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:02.488463 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f3abb4-d14c-4916-a6cb-da7eae1cf041 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:02.496272 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f3abb4-d14c-4916-a6cb-da7eae1cf041 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:02.497821 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f3abb4-d14c-4916-a6cb-da7eae1cf041 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:02.498785 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 483/976] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:27:02 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 22:27:02.500205 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdf0988-c5da-4cad-a33f-8ad726b6bfdb None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:02.500497 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdf0988-c5da-4cad-a33f-8ad726b6bfdb None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:02.500964 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdf0988-c5da-4cad-a33f-8ad726b6bfdb None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:02.502145 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 484/977] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:27:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:27:02.507774 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f6dbcb-f167-4cb0-aeb0-aa9ff913a06a None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:02.508064 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f6dbcb-f167-4cb0-aeb0-aa9ff913a06a None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:02.508337 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f6dbcb-f167-4cb0-aeb0-aa9ff913a06a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:02.519584 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-18f3abb4-d14c-4916-a6cb-da7eae1cf041 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 22:27:02.519584 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:27:02.519584 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:27:02.519584 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:27:02.519584 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:27:02.519584 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:27:02.519584 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:27:02.519584 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:27:02.519584 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:27:02.519584 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:27:02.519584 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:27:02.519584 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:27:02.519584 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 22:27:02.519584 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 22:27:02.519584 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 22:27:02.519584 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 22:27:02.520706 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:27:02.520706 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:27:02.520706 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 22:27:02.520706 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 22:27:02.520706 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 22:27:02.520706 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 22:27:02.520706 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:27:02.520706 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:27:02.520706 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:27:02.520706 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:27:02.520706 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:27:02.520706 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:27:02.520706 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:27:02.520706 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:27:02.520706 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:27:02.520706 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:27:02.520706 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:27:02.520706 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:27:02.521837 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:27:02.521837 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:27:02.521837 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 22:27:02.521837 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 22:27:02.521837 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 22:27:02.521837 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 22:27:02.521837 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 22:27:02.521837 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 22:27:02.521837 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 22:27:02.521837 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:27:02.524028 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 494/978] 10.222.0.36 () {56 vars in 1117 bytes} [Fri Jun 24 22:27:02 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 22:27:02.524941 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f3abb4-d14c-4916-a6cb-da7eae1cf041 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:02.525762 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-15f6dbcb-f167-4cb0-aeb0-aa9ff913a06a None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:27:02.526935 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-15f6dbcb-f167-4cb0-aeb0-aa9ff913a06a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:27:02.591822 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 485/979] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:27:02 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 22:27:02.591822 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f6dbcb-f167-4cb0-aeb0-aa9ff913a06a None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:02.623489 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:02.627517 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f3abb4-d14c-4916-a6cb-da7eae1cf041 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:02.661761 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da2df8a-3122-4576-be4d-e5a7023eb8d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:02.662490 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da2df8a-3122-4576-be4d-e5a7023eb8d9 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:02.662770 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da2df8a-3122-4576-be4d-e5a7023eb8d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:02.663039 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da2df8a-3122-4576-be4d-e5a7023eb8d9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:02.663898 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da2df8a-3122-4576-be4d-e5a7023eb8d9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:02.665293 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da2df8a-3122-4576-be4d-e5a7023eb8d9 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:02.677205 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-6da2df8a-3122-4576-be4d-e5a7023eb8d9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 22:27:02.677205 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:27:02.677205 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 22:27:02.677205 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 22:27:02.677205 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 22:27:02.677205 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 22:27:02.677205 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 22:27:02.677205 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 22:27:02.677205 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 22:27:02.677205 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:27:02.677205 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 22:27:02.677205 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:27:02.677205 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:27:02.677205 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:27:02.677205 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:27:02.677205 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:27:02.677205 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:27:02.678315 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:27:02.678315 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:27:02.678315 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:27:02.678315 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:27:02.678315 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:27:02.678315 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:27:02.678315 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 22:27:02.678315 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 22:27:02.678315 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 22:27:02.678315 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 22:27:02.678315 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:27:02.678315 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:27:02.678315 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:27:02.678315 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:27:02.678315 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:27:02.678315 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:27:02.679677 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:27:02.679677 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:27:02.679677 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:27:02.679677 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:27:02.679677 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:27:02.679677 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:27:02.679677 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:27:02.679677 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:27:02.679677 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:27:02.679677 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:27:02.679677 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 22:27:02.679677 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 22:27:02.679677 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 22:27:02.679677 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:27:02.679677 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 495/980] 10.222.0.36 () {56 vars in 1126 bytes} [Fri Jun 24 22:27:02 2022] GET /identity/v3/services/object-store => generated 93 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:27:02.680679 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da2df8a-3122-4576-be4d-e5a7023eb8d9 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:02.707056 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f6dbcb-f167-4cb0-aeb0-aa9ff913a06a None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:02.723385 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:02.741472 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4414e922-653a-4732-b466-e91e4a7d57aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:02.742217 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4414e922-653a-4732-b466-e91e4a7d57aa None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:02.742501 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4414e922-653a-4732-b466-e91e4a7d57aa None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:02.742778 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4414e922-653a-4732-b466-e91e4a7d57aa None admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:02.743652 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4414e922-653a-4732-b466-e91e4a7d57aa None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:27:02.743960 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4414e922-653a-4732-b466-e91e4a7d57aa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:02.745406 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4414e922-653a-4732-b466-e91e4a7d57aa None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:02.762396 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 486/981] 10.222.0.36 () {56 vars in 1149 bytes} [Fri Jun 24 22:27:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:27:02.763196 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4414e922-653a-4732-b466-e91e4a7d57aa None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:02.780392 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da2df8a-3122-4576-be4d-e5a7023eb8d9 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:02.813065 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662738df-d7f5-45c8-a49c-5f6e26f7fb2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:02.813856 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662738df-d7f5-45c8-a49c-5f6e26f7fb2c None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:02.814133 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662738df-d7f5-45c8-a49c-5f6e26f7fb2c None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:02.814402 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662738df-d7f5-45c8-a49c-5f6e26f7fb2c None admin] PATH_INFO: `/v3/services/compute` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:02.815045 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662738df-d7f5-45c8-a49c-5f6e26f7fb2c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:02.816461 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662738df-d7f5-45c8-a49c-5f6e26f7fb2c None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:02.828033 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-662738df-d7f5-45c8-a49c-5f6e26f7fb2c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 24 22:27:02.828033 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:27:02.828033 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 22:27:02.828033 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 22:27:02.828033 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 22:27:02.828033 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 22:27:02.828033 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 22:27:02.828033 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 22:27:02.828033 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 24 22:27:02.828033 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:27:02.828033 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 22:27:02.828033 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:27:02.828033 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:27:02.828033 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:27:02.828033 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:27:02.828033 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:27:02.828033 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:27:02.829272 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:27:02.829272 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:27:02.829272 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:27:02.829272 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:27:02.829272 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:27:02.829272 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:27:02.829272 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 22:27:02.829272 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 22:27:02.829272 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 22:27:02.829272 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 22:27:02.829272 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:27:02.829272 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:27:02.829272 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:27:02.829272 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:27:02.829272 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:27:02.829272 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:27:02.830237 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:27:02.830237 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:27:02.830237 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:27:02.830237 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:27:02.830237 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:27:02.830237 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:27:02.830237 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:27:02.830237 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:27:02.830237 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:27:02.830237 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:27:02.830237 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 22:27:02.830237 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 22:27:02.830237 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 24 22:27:02.830237 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:27:02.830237 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 496/982] 10.222.0.36 () {56 vars in 1111 bytes} [Fri Jun 24 22:27:02 2022] GET /identity/v3/services/compute => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:27:02.831056 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662738df-d7f5-45c8-a49c-5f6e26f7fb2c None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:02.856310 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:02.865668 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4414e922-653a-4732-b466-e91e4a7d57aa None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:02.900027 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d264d9a0-d39e-40f5-b758-8fcbab6ab11c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:02.900688 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d264d9a0-d39e-40f5-b758-8fcbab6ab11c None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:02.900969 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d264d9a0-d39e-40f5-b758-8fcbab6ab11c None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:02.901242 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d264d9a0-d39e-40f5-b758-8fcbab6ab11c None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:02.901942 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d264d9a0-d39e-40f5-b758-8fcbab6ab11c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:27:02.902246 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d264d9a0-d39e-40f5-b758-8fcbab6ab11c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:02.903646 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d264d9a0-d39e-40f5-b758-8fcbab6ab11c None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:02.908572 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 487/983] 10.222.0.36 () {56 vars in 1122 bytes} [Fri Jun 24 22:27:02 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:27:02.909147 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d264d9a0-d39e-40f5-b758-8fcbab6ab11c None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:02.930140 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662738df-d7f5-45c8-a49c-5f6e26f7fb2c None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:02.947306 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:02.963744 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c136a1f6-4950-4f78-8376-5019003c12a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:02.964502 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c136a1f6-4950-4f78-8376-5019003c12a8 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:02.964776 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c136a1f6-4950-4f78-8376-5019003c12a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:02.965101 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c136a1f6-4950-4f78-8376-5019003c12a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:03.006855 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d264d9a0-d39e-40f5-b758-8fcbab6ab11c None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:03.032190 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c136a1f6-4950-4f78-8376-5019003c12a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:03.033707 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c136a1f6-4950-4f78-8376-5019003c12a8 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:03.039694 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe7f75a-3eb6-4136-b0a1-3725efe68c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:03.040366 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe7f75a-3eb6-4136-b0a1-3725efe68c76 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:03.040649 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe7f75a-3eb6-4136-b0a1-3725efe68c76 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:03.040924 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe7f75a-3eb6-4136-b0a1-3725efe68c76 None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:03.041631 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe7f75a-3eb6-4136-b0a1-3725efe68c76 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:27:03.041939 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe7f75a-3eb6-4136-b0a1-3725efe68c76 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:03.043330 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe7f75a-3eb6-4136-b0a1-3725efe68c76 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:03.048084 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 488/984] 10.222.0.36 () {56 vars in 1112 bytes} [Fri Jun 24 22:27:02 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:27:03.048846 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe7f75a-3eb6-4136-b0a1-3725efe68c76 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:03.059822 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:03.134740 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 497/985] 10.222.0.36 () {58 vars in 1282 bytes} [Fri Jun 24 22:27:02 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 22:27:03.136896 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c136a1f6-4950-4f78-8376-5019003c12a8 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:03.152684 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe7f75a-3eb6-4136-b0a1-3725efe68c76 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:03.154252 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:03.189292 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c1885e-9456-4269-bc11-3911993f09be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:03.189884 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c1885e-9456-4269-bc11-3911993f09be None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:03.190163 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c1885e-9456-4269-bc11-3911993f09be None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:03.190435 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c1885e-9456-4269-bc11-3911993f09be None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:03.191137 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c1885e-9456-4269-bc11-3911993f09be None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:27:03.191460 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c1885e-9456-4269-bc11-3911993f09be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:03.192837 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c1885e-9456-4269-bc11-3911993f09be None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:03.198157 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 489/986] 10.222.0.36 () {56 vars in 1122 bytes} [Fri Jun 24 22:27:03 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:27:03.198739 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c1885e-9456-4269-bc11-3911993f09be None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:03.240147 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c136a1f6-4950-4f78-8376-5019003c12a8 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:03.266561 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:03.276380 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3997419-3be8-482e-a44c-efdc0361415f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:03.277049 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3997419-3be8-482e-a44c-efdc0361415f None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:03.277334 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3997419-3be8-482e-a44c-efdc0361415f None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:03.277612 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3997419-3be8-482e-a44c-efdc0361415f None admin] PATH_INFO: `/v3/services` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:03.278324 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3997419-3be8-482e-a44c-efdc0361415f None admin] RBAC: Adding query filter params (type=compute) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:27:03.278629 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3997419-3be8-482e-a44c-efdc0361415f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:03.280067 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3997419-3be8-482e-a44c-efdc0361415f None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:03.284877 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 498/987] 10.222.0.36 () {56 vars in 1112 bytes} [Fri Jun 24 22:27:03 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:27:03.285643 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3997419-3be8-482e-a44c-efdc0361415f None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:03.300505 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c1885e-9456-4269-bc11-3911993f09be None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:03.334605 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0648e17d-9e9e-4308-b2d6-dfb7b2675c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:03.335669 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0648e17d-9e9e-4308-b2d6-dfb7b2675c20 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:03.336390 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0648e17d-9e9e-4308-b2d6-dfb7b2675c20 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:03.336390 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0648e17d-9e9e-4308-b2d6-dfb7b2675c20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:03.346411 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0648e17d-9e9e-4308-b2d6-dfb7b2675c20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:03.347916 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0648e17d-9e9e-4308-b2d6-dfb7b2675c20 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:03.365524 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-0648e17d-9e9e-4308-b2d6-dfb7b2675c20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:27:03.365524 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:27:03.365524 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:27:03.365524 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:27:03.365524 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:27:03.365524 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:27:03.365524 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:27:03.365524 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:27:03.365524 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:27:03.365524 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:27:03.365524 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:27:03.365524 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:27:03.365524 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 22:27:03.365524 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 22:27:03.365524 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 22:27:03.366781 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 22:27:03.366781 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:27:03.366781 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:27:03.366781 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:27:03.366781 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:27:03.366781 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:27:03.366781 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:27:03.366781 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:27:03.366781 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:27:03.366781 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:27:03.366781 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:27:03.366781 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:27:03.366781 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:27:03.366781 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:27:03.366781 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:27:03.366781 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:27:03.366781 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:27:03.368039 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 22:27:03.368039 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 22:27:03.368039 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:27:03.368039 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:27:03.368039 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 490/988] 10.222.0.36 () {56 vars in 1108 bytes} [Fri Jun 24 22:27:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:27:03.368039 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0648e17d-9e9e-4308-b2d6-dfb7b2675c20 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:03.388629 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:03.389978 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3997419-3be8-482e-a44c-efdc0361415f None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:03.423603 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b41c945-377a-437c-90da-3dea32c8703f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:03.424259 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b41c945-377a-437c-90da-3dea32c8703f None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:03.424543 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b41c945-377a-437c-90da-3dea32c8703f None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:03.424813 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b41c945-377a-437c-90da-3dea32c8703f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:03.425607 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b41c945-377a-437c-90da-3dea32c8703f None admin] RBAC: Adding query filter params (interface=admin, service_id=efe71b8399a64d009f41aadf7b650669, region_id=RegionOne) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:27:03.425915 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b41c945-377a-437c-90da-3dea32c8703f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:03.427333 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b41c945-377a-437c-90da-3dea32c8703f None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:03.433057 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 499/989] 10.222.0.36 () {56 vars in 1249 bytes} [Fri Jun 24 22:27:03 2022] GET /identity/v3/endpoints?service_id=efe71b8399a64d009f41aadf7b650669&interface=admin®ion_id=RegionOne => generated 193 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:27:03.433861 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b41c945-377a-437c-90da-3dea32c8703f None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:03.478306 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0648e17d-9e9e-4308-b2d6-dfb7b2675c20 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:03.489740 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:03.512059 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8526dec6-515b-4121-ba4f-f36bf90b9270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:03.512727 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8526dec6-515b-4121-ba4f-f36bf90b9270 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:03.513013 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8526dec6-515b-4121-ba4f-f36bf90b9270 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:03.513287 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8526dec6-515b-4121-ba4f-f36bf90b9270 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:03.514074 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8526dec6-515b-4121-ba4f-f36bf90b9270 None admin] RBAC: Adding query filter params (interface=public, service_id=e0b06a27e448461a9453a5046f4a9f1c, region_id=RegionOne) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:27:03.514384 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8526dec6-515b-4121-ba4f-f36bf90b9270 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:03.515814 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8526dec6-515b-4121-ba4f-f36bf90b9270 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:03.521031 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 491/990] 10.222.0.36 () {56 vars in 1251 bytes} [Fri Jun 24 22:27:03 2022] GET /identity/v3/endpoints?service_id=e0b06a27e448461a9453a5046f4a9f1c&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:27:03.521801 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8526dec6-515b-4121-ba4f-f36bf90b9270 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:03.538235 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b41c945-377a-437c-90da-3dea32c8703f None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:03.572152 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dd9e13-75ad-489e-bca7-27d07292790d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:03.572803 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd9e13-75ad-489e-bca7-27d07292790d None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:03.573104 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd9e13-75ad-489e-bca7-27d07292790d None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:03.573374 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd9e13-75ad-489e-bca7-27d07292790d None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:03.574091 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dd9e13-75ad-489e-bca7-27d07292790d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:27:03.574392 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dd9e13-75ad-489e-bca7-27d07292790d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:03.575813 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dd9e13-75ad-489e-bca7-27d07292790d None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:03.587130 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 500/991] 10.222.0.36 () {56 vars in 1109 bytes} [Fri Jun 24 22:27:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:27:03.587777 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dd9e13-75ad-489e-bca7-27d07292790d None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:03.601590 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:03.619872 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8526dec6-515b-4121-ba4f-f36bf90b9270 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:03.653494 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f63b3b-aed6-4ae3-ad2a-ac244ef0a74e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:03.654162 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f63b3b-aed6-4ae3-ad2a-ac244ef0a74e None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:03.654448 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f63b3b-aed6-4ae3-ad2a-ac244ef0a74e None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:03.654728 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f63b3b-aed6-4ae3-ad2a-ac244ef0a74e None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:03.655444 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f63b3b-aed6-4ae3-ad2a-ac244ef0a74e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:03.656830 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f63b3b-aed6-4ae3-ad2a-ac244ef0a74e None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:03.663228 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 492/992] 10.222.0.36 () {56 vars in 1087 bytes} [Fri Jun 24 22:27:03 2022] GET /identity/v3/services => generated 1727 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:27:03.664107 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f63b3b-aed6-4ae3-ad2a-ac244ef0a74e None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:03.697070 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dd9e13-75ad-489e-bca7-27d07292790d None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:03.713393 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:03.739028 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6649d387-6614-4ddd-a6a7-de0df7603b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:03.739663 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6649d387-6614-4ddd-a6a7-de0df7603b29 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:03.739946 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6649d387-6614-4ddd-a6a7-de0df7603b29 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:03.740220 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6649d387-6614-4ddd-a6a7-de0df7603b29 None admin] PATH_INFO: `/v3/services` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:03.740911 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6649d387-6614-4ddd-a6a7-de0df7603b29 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:03.742757 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6649d387-6614-4ddd-a6a7-de0df7603b29 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:03.749827 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 501/993] 10.222.0.36 () {56 vars in 1087 bytes} [Fri Jun 24 22:27:03 2022] GET /identity/v3/services => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:27:03.790854 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f63b3b-aed6-4ae3-ad2a-ac244ef0a74e None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:03.832257 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9f2d3b-c319-45d2-b7ea-bb7c3f3dfdf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:03.833082 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9f2d3b-c319-45d2-b7ea-bb7c3f3dfdf8 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:03.833371 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9f2d3b-c319-45d2-b7ea-bb7c3f3dfdf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:03.833648 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9f2d3b-c319-45d2-b7ea-bb7c3f3dfdf8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:03.842102 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9f2d3b-c319-45d2-b7ea-bb7c3f3dfdf8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:03.843735 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9f2d3b-c319-45d2-b7ea-bb7c3f3dfdf8 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:03.859325 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-4f9f2d3b-c319-45d2-b7ea-bb7c3f3dfdf8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 22:27:03.859325 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:27:03.859325 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:27:03.859325 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:27:03.859325 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:27:03.859325 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:27:03.859325 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:27:03.859325 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:27:03.859325 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:27:03.859325 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:27:03.859325 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:27:03.859325 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:27:03.859325 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 22:27:03.859325 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 22:27:03.859325 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 22:27:03.860300 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 22:27:03.860300 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:27:03.860300 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:27:03.860300 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:27:03.860300 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:27:03.860300 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:27:03.860300 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:27:03.860300 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:27:03.860300 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:27:03.860300 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:27:03.860300 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:27:03.860300 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:27:03.860300 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:27:03.860300 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:27:03.860300 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:27:03.860300 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:27:03.860300 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:27:03.861208 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 22:27:03.861208 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 22:27:03.861208 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 22:27:03.861208 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 22:27:03.861208 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 22:27:03.861208 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 22:27:03.861208 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 22:27:03.861208 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:27:03.861208 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 493/994] 10.222.0.36 () {56 vars in 1111 bytes} [Fri Jun 24 22:27:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:27:03.866753 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6649d387-6614-4ddd-a6a7-de0df7603b29 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:03.978035 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6649d387-6614-4ddd-a6a7-de0df7603b29 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:04.024003 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb84bd5-7cd3-4ed2-b728-c4d0f2f9fa76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:04.024600 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb84bd5-7cd3-4ed2-b728-c4d0f2f9fa76 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:04.024887 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb84bd5-7cd3-4ed2-b728-c4d0f2f9fa76 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:04.025171 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb84bd5-7cd3-4ed2-b728-c4d0f2f9fa76 None admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:04.025970 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb84bd5-7cd3-4ed2-b728-c4d0f2f9fa76 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:27:04.026285 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb84bd5-7cd3-4ed2-b728-c4d0f2f9fa76 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:04.027804 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb84bd5-7cd3-4ed2-b728-c4d0f2f9fa76 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:04.041913 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 502/995] 10.222.0.36 () {56 vars in 1148 bytes} [Fri Jun 24 22:27:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:27:04.048090 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9f2d3b-c319-45d2-b7ea-bb7c3f3dfdf8 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:04.058848 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:04.154780 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9f2d3b-c319-45d2-b7ea-bb7c3f3dfdf8 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:04.189787 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa99eb7-7b47-483f-9246-ab226e820985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:04.190456 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa99eb7-7b47-483f-9246-ab226e820985 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:04.190738 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa99eb7-7b47-483f-9246-ab226e820985 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:04.191016 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa99eb7-7b47-483f-9246-ab226e820985 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:04.191975 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa99eb7-7b47-483f-9246-ab226e820985 None admin] RBAC: Adding query filter params (role.id=89095043d87040e39cf7bd2875c789f2, scope.project.id=d189b31bbec0469381292d2cde3cb420, user.id=542ea2e5a8114792836d0cdfd36b4c51) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:27:04.192294 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa99eb7-7b47-483f-9246-ab226e820985 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:04.193745 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa99eb7-7b47-483f-9246-ab226e820985 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:04.200296 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 494/996] 10.222.0.36 () {56 vars in 1374 bytes} [Fri Jun 24 22:27:04 2022] GET /identity/v3/role_assignments?user.id=542ea2e5a8114792836d0cdfd36b4c51&scope.project.id=d189b31bbec0469381292d2cde3cb420&role.id=89095043d87040e39cf7bd2875c789f2 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:27:05.736775 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee0b34b-a3d7-400d-8638-4a912cf52131 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:05.737300 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee0b34b-a3d7-400d-8638-4a912cf52131 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:05.737300 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee0b34b-a3d7-400d-8638-4a912cf52131 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:05.738592 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 503/997] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:27:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:27:05.744320 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bfc61e-6b3b-4090-b9fe-3c7793732700 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:05.744773 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bfc61e-6b3b-4090-b9fe-3c7793732700 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:05.744847 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bfc61e-6b3b-4090-b9fe-3c7793732700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:05.762898 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-d8bfc61e-6b3b-4090-b9fe-3c7793732700 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:27:05.764111 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-d8bfc61e-6b3b-4090-b9fe-3c7793732700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:27:05.798130 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a4f2fa-48a3-421d-baa7-ffac379a29b9 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:05.798419 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a4f2fa-48a3-421d-baa7-ffac379a29b9 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:05.798701 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a4f2fa-48a3-421d-baa7-ffac379a29b9 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:05.800110 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 504/998] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:27:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 22:27:05.805546 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb4cc3-ee96-4e64-9f25-617ddb237be6 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:05.805830 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb4cc3-ee96-4e64-9f25-617ddb237be6 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:05.806104 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb4cc3-ee96-4e64-9f25-617ddb237be6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:05.822979 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-6deb4cc3-ee96-4e64-9f25-617ddb237be6 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:27:05.824209 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-6deb4cc3-ee96-4e64-9f25-617ddb237be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:27:05.836012 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:05.842859 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 495/999] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:27:05 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 22:27:05.856090 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:05.864751 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bfc61e-6b3b-4090-b9fe-3c7793732700 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:05.899382 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 505/1000] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:27:05 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 22:27:05.920280 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deb4cc3-ee96-4e64-9f25-617ddb237be6 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:05.971352 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bfc61e-6b3b-4090-b9fe-3c7793732700 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:06.005783 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7ced02-0cf2-49f3-b17d-77acb3825502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:06.006511 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7ced02-0cf2-49f3-b17d-77acb3825502 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:06.006793 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7ced02-0cf2-49f3-b17d-77acb3825502 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:06.007065 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7ced02-0cf2-49f3-b17d-77acb3825502 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:06.007817 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7ced02-0cf2-49f3-b17d-77acb3825502 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:06.009182 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7ced02-0cf2-49f3-b17d-77acb3825502 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:06.021069 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-bb7ced02-0cf2-49f3-b17d-77acb3825502 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 22:27:06.021069 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:27:06.021069 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 22:27:06.021069 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 22:27:06.021069 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 22:27:06.021069 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 22:27:06.021069 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 22:27:06.021069 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 22:27:06.021069 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 22:27:06.021069 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:27:06.021069 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 22:27:06.021069 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:27:06.021069 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:27:06.021069 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:27:06.021069 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:27:06.021069 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:27:06.021069 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:27:06.022099 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:27:06.022099 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:27:06.022099 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:27:06.022099 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:27:06.022099 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:27:06.022099 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:27:06.022099 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 22:27:06.022099 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 22:27:06.022099 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 22:27:06.022099 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 22:27:06.022099 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:27:06.022099 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:27:06.022099 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:27:06.022099 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:27:06.022099 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:27:06.022099 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:27:06.023752 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:27:06.023752 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:27:06.023752 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:27:06.023752 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:27:06.023752 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:27:06.023752 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:27:06.023752 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:27:06.023752 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:27:06.023752 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:27:06.023752 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:27:06.023752 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 22:27:06.023752 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 22:27:06.023752 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 22:27:06.023752 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:27:06.023752 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 496/1001] 10.222.0.36 () {56 vars in 1126 bytes} [Fri Jun 24 22:27:05 2022] GET /identity/v3/services/object-store => generated 93 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 22:27:06.027809 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deb4cc3-ee96-4e64-9f25-617ddb237be6 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:06.028229 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7ced02-0cf2-49f3-b17d-77acb3825502 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:06.069355 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2cb18a-bfd9-49e0-b77a-07b684d7e79a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:06.070399 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2cb18a-bfd9-49e0-b77a-07b684d7e79a None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:06.070694 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2cb18a-bfd9-49e0-b77a-07b684d7e79a None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:06.070966 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2cb18a-bfd9-49e0-b77a-07b684d7e79a None admin] PATH_INFO: `/v3/services/compute` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:06.071683 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2cb18a-bfd9-49e0-b77a-07b684d7e79a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:06.073155 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2cb18a-bfd9-49e0-b77a-07b684d7e79a None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:06.085604 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-8c2cb18a-bfd9-49e0-b77a-07b684d7e79a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 24 22:27:06.085604 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:27:06.085604 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 22:27:06.085604 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 22:27:06.085604 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 22:27:06.085604 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 22:27:06.085604 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 22:27:06.085604 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 22:27:06.085604 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 24 22:27:06.085604 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:27:06.085604 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 22:27:06.085604 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:27:06.085604 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:27:06.085604 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:27:06.085604 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:27:06.085604 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:27:06.085604 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:27:06.086652 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:27:06.086652 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:27:06.086652 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:27:06.086652 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:27:06.086652 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:27:06.086652 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:27:06.086652 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 22:27:06.086652 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 22:27:06.086652 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 22:27:06.086652 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 22:27:06.086652 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:27:06.086652 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:27:06.086652 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:27:06.086652 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:27:06.086652 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:27:06.086652 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:27:06.088138 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:27:06.088138 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:27:06.088138 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:27:06.088138 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:27:06.088138 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:27:06.088138 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:27:06.088138 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:27:06.088138 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:27:06.088138 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:27:06.088138 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:27:06.088138 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 22:27:06.088138 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 22:27:06.088138 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 24 22:27:06.088138 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:27:06.088138 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 506/1002] 10.222.0.36 () {56 vars in 1111 bytes} [Fri Jun 24 22:27:05 2022] GET /identity/v3/services/compute => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:27:06.092813 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2cb18a-bfd9-49e0-b77a-07b684d7e79a None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:06.093343 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:06.127192 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:06.135005 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7ced02-0cf2-49f3-b17d-77acb3825502 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:06.170526 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cf330f-0f2e-4760-bf7a-a15af99f2b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:06.171651 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf330f-0f2e-4760-bf7a-a15af99f2b11 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:06.172160 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf330f-0f2e-4760-bf7a-a15af99f2b11 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:06.172637 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf330f-0f2e-4760-bf7a-a15af99f2b11 None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:06.173542 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cf330f-0f2e-4760-bf7a-a15af99f2b11 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:27:06.174045 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cf330f-0f2e-4760-bf7a-a15af99f2b11 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:06.175649 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cf330f-0f2e-4760-bf7a-a15af99f2b11 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:06.185983 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 497/1003] 10.222.0.36 () {56 vars in 1122 bytes} [Fri Jun 24 22:27:06 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 22:27:06.187585 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cf330f-0f2e-4760-bf7a-a15af99f2b11 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:06.207377 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2cb18a-bfd9-49e0-b77a-07b684d7e79a None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:06.243481 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c2f717-37d5-49c0-83c6-7ced1e8120a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:06.244152 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2f717-37d5-49c0-83c6-7ced1e8120a2 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:06.244430 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2f717-37d5-49c0-83c6-7ced1e8120a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:06.244703 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2f717-37d5-49c0-83c6-7ced1e8120a2 None admin] PATH_INFO: `/v3/services` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:06.245407 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c2f717-37d5-49c0-83c6-7ced1e8120a2 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:27:06.245711 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c2f717-37d5-49c0-83c6-7ced1e8120a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:06.247095 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c2f717-37d5-49c0-83c6-7ced1e8120a2 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:06.251923 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 507/1004] 10.222.0.36 () {56 vars in 1112 bytes} [Fri Jun 24 22:27:06 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 22:27:06.253388 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53235c2f-0801-4f83-b9a1-0ae16d7b94db None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:06.253679 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53235c2f-0801-4f83-b9a1-0ae16d7b94db None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:06.253957 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53235c2f-0801-4f83-b9a1-0ae16d7b94db None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:06.255627 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 508/1005] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:27:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:27:06.260682 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025dc386-bd1a-42a5-b28f-844a750067c3 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:06.260904 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025dc386-bd1a-42a5-b28f-844a750067c3 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:06.261181 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025dc386-bd1a-42a5-b28f-844a750067c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:06.276997 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-025dc386-bd1a-42a5-b28f-844a750067c3 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:27:06.278171 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-025dc386-bd1a-42a5-b28f-844a750067c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:27:06.290905 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cf330f-0f2e-4760-bf7a-a15af99f2b11 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:06.316362 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:06.325976 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ed8ebe-d284-4f31-9b8b-83a926d1b654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:06.326657 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ed8ebe-d284-4f31-9b8b-83a926d1b654 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:06.326932 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ed8ebe-d284-4f31-9b8b-83a926d1b654 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:06.327384 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ed8ebe-d284-4f31-9b8b-83a926d1b654 None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:06.327941 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ed8ebe-d284-4f31-9b8b-83a926d1b654 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:27:06.328244 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ed8ebe-d284-4f31-9b8b-83a926d1b654 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:06.329718 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ed8ebe-d284-4f31-9b8b-83a926d1b654 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:06.336704 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 498/1006] 10.222.0.36 () {56 vars in 1122 bytes} [Fri Jun 24 22:27:06 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 22:27:06.337466 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ed8ebe-d284-4f31-9b8b-83a926d1b654 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:06.354197 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 509/1007] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:27:06 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 22:27:06.355074 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025dc386-bd1a-42a5-b28f-844a750067c3 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:06.383629 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:06.443063 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ed8ebe-d284-4f31-9b8b-83a926d1b654 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:06.457135 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025dc386-bd1a-42a5-b28f-844a750067c3 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:06.477074 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9416d4-5d2f-4941-b916-18fd1cfdab42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:06.477740 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9416d4-5d2f-4941-b916-18fd1cfdab42 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:06.478023 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9416d4-5d2f-4941-b916-18fd1cfdab42 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:06.478299 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9416d4-5d2f-4941-b916-18fd1cfdab42 None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:06.479008 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9416d4-5d2f-4941-b916-18fd1cfdab42 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:27:06.479344 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9416d4-5d2f-4941-b916-18fd1cfdab42 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:06.480730 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9416d4-5d2f-4941-b916-18fd1cfdab42 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:06.485511 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 499/1008] 10.222.0.36 () {56 vars in 1112 bytes} [Fri Jun 24 22:27:06 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:27:06.486281 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9416d4-5d2f-4941-b916-18fd1cfdab42 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:06.496459 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b76e379-1eba-4360-929a-c81b44c61677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:06.497157 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b76e379-1eba-4360-929a-c81b44c61677 None admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:06.497431 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b76e379-1eba-4360-929a-c81b44c61677 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:06.497706 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b76e379-1eba-4360-929a-c81b44c61677 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:06.498456 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b76e379-1eba-4360-929a-c81b44c61677 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:06.499897 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b76e379-1eba-4360-929a-c81b44c61677 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:06.516469 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 510/1009] 10.222.0.36 () {60 vars in 1144 bytes} [Fri Jun 24 22:27:06 2022] POST /identity/v3/endpoints => generated 325 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:27:06.517180 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b76e379-1eba-4360-929a-c81b44c61677 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:06.545145 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:06.598282 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9416d4-5d2f-4941-b916-18fd1cfdab42 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:06.624099 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:06.647310 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b76e379-1eba-4360-929a-c81b44c61677 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:06.647528 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c3ac8c-3988-461e-b4b1-8e06f1d1d599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:06.648562 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c3ac8c-3988-461e-b4b1-8e06f1d1d599 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:06.648961 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c3ac8c-3988-461e-b4b1-8e06f1d1d599 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:06.649250 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c3ac8c-3988-461e-b4b1-8e06f1d1d599 None admin] PATH_INFO: `/v3/services/image` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:06.650020 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c3ac8c-3988-461e-b4b1-8e06f1d1d599 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:06.651459 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c3ac8c-3988-461e-b4b1-8e06f1d1d599 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:06.665021 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-b2c3ac8c-3988-461e-b4b1-8e06f1d1d599 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 24 22:27:06.665021 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:27:06.665021 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 22:27:06.665021 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 22:27:06.665021 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 22:27:06.665021 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 22:27:06.665021 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 22:27:06.665021 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 22:27:06.665021 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 24 22:27:06.665021 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:27:06.665021 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 22:27:06.665021 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:27:06.665021 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:27:06.665021 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:27:06.665021 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:27:06.665021 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:27:06.665021 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:27:06.666104 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:27:06.666104 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:27:06.666104 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:27:06.666104 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:27:06.666104 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:27:06.666104 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:27:06.666104 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 22:27:06.666104 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 22:27:06.666104 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 22:27:06.666104 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 22:27:06.666104 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:27:06.666104 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:27:06.666104 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:27:06.666104 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:27:06.666104 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:27:06.666104 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:27:06.666942 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:27:06.666942 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:27:06.666942 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:27:06.666942 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:27:06.666942 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:27:06.666942 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:27:06.666942 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:27:06.666942 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:27:06.666942 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:27:06.666942 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:27:06.666942 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 22:27:06.666942 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 22:27:06.666942 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 24 22:27:06.666942 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:27:06.666942 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 500/1010] 10.222.0.36 () {56 vars in 1105 bytes} [Fri Jun 24 22:27:06 2022] GET /identity/v3/services/image => generated 86 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:27:06.672504 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c3ac8c-3988-461e-b4b1-8e06f1d1d599 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:06.690063 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5fce29-0958-4328-830a-73bd03230226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:06.690808 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5fce29-0958-4328-830a-73bd03230226 None admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:06.691098 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5fce29-0958-4328-830a-73bd03230226 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:06.691436 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5fce29-0958-4328-830a-73bd03230226 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:06.692357 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5fce29-0958-4328-830a-73bd03230226 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:06.693744 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5fce29-0958-4328-830a-73bd03230226 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:06.720424 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 511/1011] 10.222.0.36 () {60 vars in 1144 bytes} [Fri Jun 24 22:27:06 2022] POST /identity/v3/endpoints => generated 334 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:27:06.793093 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c3ac8c-3988-461e-b4b1-8e06f1d1d599 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:06.811579 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:06.838577 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0611d45-7c3b-4eed-8122-f829aa776de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:06.839289 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0611d45-7c3b-4eed-8122-f829aa776de1 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:06.839566 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0611d45-7c3b-4eed-8122-f829aa776de1 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:06.839865 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0611d45-7c3b-4eed-8122-f829aa776de1 None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:06.840545 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0611d45-7c3b-4eed-8122-f829aa776de1 None admin] RBAC: Adding query filter params (name=image) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:27:06.840853 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0611d45-7c3b-4eed-8122-f829aa776de1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:06.842256 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0611d45-7c3b-4eed-8122-f829aa776de1 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:06.848378 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 501/1012] 10.222.0.36 () {56 vars in 1108 bytes} [Fri Jun 24 22:27:06 2022] GET /identity/v3/services?name=image => generated 122 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 22:27:06.854462 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5fce29-0958-4328-830a-73bd03230226 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:06.963142 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5fce29-0958-4328-830a-73bd03230226 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:06.997934 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcba52b-e3ee-4321-a738-a272755550ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:06.998611 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcba52b-e3ee-4321-a738-a272755550ad None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:06.998891 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcba52b-e3ee-4321-a738-a272755550ad None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:06.999169 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcba52b-e3ee-4321-a738-a272755550ad None admin] PATH_INFO: `/v3/services` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:06.999907 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcba52b-e3ee-4321-a738-a272755550ad None admin] RBAC: Adding query filter params (type=image) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:27:07.000211 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcba52b-e3ee-4321-a738-a272755550ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:07.001595 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcba52b-e3ee-4321-a738-a272755550ad None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:07.006829 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 512/1013] 10.222.0.36 () {56 vars in 1108 bytes} [Fri Jun 24 22:27:06 2022] GET /identity/v3/services?type=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:27:08.565560 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f72a92-241f-4bd8-b9d6-b910ad4e21be None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:08.566109 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f72a92-241f-4bd8-b9d6-b910ad4e21be None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:08.566109 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f72a92-241f-4bd8-b9d6-b910ad4e21be None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:08.567727 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 502/1014] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:27:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:27:08.572852 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c181ec-d716-44a0-9040-8524e7973bdb None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:08.573292 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c181ec-d716-44a0-9040-8524e7973bdb None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:08.573379 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c181ec-d716-44a0-9040-8524e7973bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:08.579049 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:08.592380 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-94c181ec-d716-44a0-9040-8524e7973bdb None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:27:08.593989 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-94c181ec-d716-44a0-9040-8524e7973bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:27:08.665082 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 513/1015] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:27:08 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 22:27:08.689107 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f72a92-241f-4bd8-b9d6-b910ad4e21be None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:08.799691 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f72a92-241f-4bd8-b9d6-b910ad4e21be None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:08.833348 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519322d0-224a-4d69-a3c3-6404279bfd5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:08.834150 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519322d0-224a-4d69-a3c3-6404279bfd5f None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:08.834431 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519322d0-224a-4d69-a3c3-6404279bfd5f None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:08.834706 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519322d0-224a-4d69-a3c3-6404279bfd5f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:08.835978 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519322d0-224a-4d69-a3c3-6404279bfd5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:08.837433 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519322d0-224a-4d69-a3c3-6404279bfd5f None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:08.839305 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 503/1016] 10.222.0.36 () {56 vars in 1108 bytes} [Fri Jun 24 22:27:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:27:08.844913 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c181ec-d716-44a0-9040-8524e7973bdb None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:08.864226 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fbabd5-20e5-4ed6-a0ae-3705cc8323c4 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:08.864553 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fbabd5-20e5-4ed6-a0ae-3705cc8323c4 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:08.864780 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fbabd5-20e5-4ed6-a0ae-3705cc8323c4 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:08.866301 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 504/1017] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:27:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:27:08.871729 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e811f51-1cf0-45f9-bd2d-17430a71efbd None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:08.872017 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e811f51-1cf0-45f9-bd2d-17430a71efbd None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:08.872447 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e811f51-1cf0-45f9-bd2d-17430a71efbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:08.892586 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-2e811f51-1cf0-45f9-bd2d-17430a71efbd None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:27:08.894390 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-2e811f51-1cf0-45f9-bd2d-17430a71efbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:27:08.940701 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:08.951754 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c181ec-d716-44a0-9040-8524e7973bdb None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:08.970487 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 505/1018] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:27:08 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 22:27:08.983463 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:08.989190 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e35f59-0cb7-4ffa-8e38-c92fcd3bd771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:08.989863 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e35f59-0cb7-4ffa-8e38-c92fcd3bd771 None admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:08.990147 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e35f59-0cb7-4ffa-8e38-c92fcd3bd771 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:08.990424 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e35f59-0cb7-4ffa-8e38-c92fcd3bd771 None admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:08.991133 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e35f59-0cb7-4ffa-8e38-c92fcd3bd771 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:08.992704 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e35f59-0cb7-4ffa-8e38-c92fcd3bd771 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:08.993990 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e811f51-1cf0-45f9-bd2d-17430a71efbd None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:09.021375 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 514/1019] 10.222.0.36 () {60 vars in 1141 bytes} [Fri Jun 24 22:27:08 2022] POST /identity/v3/projects => generated 311 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:27:09.022756 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505894e1-7325-4ab1-9d09-777c029a2c1f None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:09.023044 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505894e1-7325-4ab1-9d09-777c029a2c1f None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:09.023423 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505894e1-7325-4ab1-9d09-777c029a2c1f None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:09.025023 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 515/1020] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:27:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:27:09.030556 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf24ee8-0cc5-41bd-949e-42a6d77cfd64 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:09.030825 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf24ee8-0cc5-41bd-949e-42a6d77cfd64 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:09.031110 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf24ee8-0cc5-41bd-949e-42a6d77cfd64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:09.049488 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-daf24ee8-0cc5-41bd-949e-42a6d77cfd64 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:27:09.050735 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-daf24ee8-0cc5-41bd-949e-42a6d77cfd64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:27:09.128885 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e811f51-1cf0-45f9-bd2d-17430a71efbd None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:09.133938 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 516/1021] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:27:09 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 22:27:09.157133 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf24ee8-0cc5-41bd-949e-42a6d77cfd64 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:09.169206 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add74a78-2c7d-46d5-8c3e-7146f6bd4e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:09.170038 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add74a78-2c7d-46d5-8c3e-7146f6bd4e76 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:09.170320 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add74a78-2c7d-46d5-8c3e-7146f6bd4e76 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:09.170592 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add74a78-2c7d-46d5-8c3e-7146f6bd4e76 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:09.182069 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add74a78-2c7d-46d5-8c3e-7146f6bd4e76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 22:27:09.190634 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-add74a78-2c7d-46d5-8c3e-7146f6bd4e76 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 22:27:09.190634 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:27:09.190634 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:27:09.190634 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:27:09.190634 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:27:09.190634 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:27:09.190634 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:27:09.190634 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:27:09.190634 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:27:09.190634 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:27:09.190634 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:27:09.190634 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:27:09.190634 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 22:27:09.190634 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 22:27:09.190634 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 22:27:09.190634 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 22:27:09.191763 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 22:27:09.191763 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 22:27:09.191763 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 22:27:09.191763 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 22:27:09.191763 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:27:09.191763 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:27:09.191763 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:27:09.191763 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:27:09.191763 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:27:09.191763 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:27:09.191763 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:27:09.191763 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:27:09.191763 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:27:09.191763 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:27:09.191763 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:27:09.191763 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:27:09.197958 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:27:09.197958 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:27:09.197958 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:27:09.197958 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:27:09.197958 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 22:27:09.197958 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 22:27:09.197958 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 22:27:09.197958 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 22:27:09.197958 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 22:27:09.197958 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 22:27:09.197958 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 22:27:09.197958 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:27:09.197958 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 506/1022] 10.222.0.36 () {56 vars in 1120 bytes} [Fri Jun 24 22:27:08 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 22:27:09.201250 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add74a78-2c7d-46d5-8c3e-7146f6bd4e76 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:09.238723 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:09.273220 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf24ee8-0cc5-41bd-949e-42a6d77cfd64 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:09.288805 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:09.307017 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add74a78-2c7d-46d5-8c3e-7146f6bd4e76 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:09.311493 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef1830a-0c70-4804-b675-219acb80cd45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:09.312175 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef1830a-0c70-4804-b675-219acb80cd45 None admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:09.312457 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef1830a-0c70-4804-b675-219acb80cd45 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:09.312733 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef1830a-0c70-4804-b675-219acb80cd45 None admin] PATH_INFO: `/v3/services` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:09.313458 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef1830a-0c70-4804-b675-219acb80cd45 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:09.315463 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef1830a-0c70-4804-b675-219acb80cd45 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:09.331616 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 517/1023] 10.222.0.36 () {60 vars in 1141 bytes} [Fri Jun 24 22:27:09 2022] POST /identity/v3/services => generated 242 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 22:27:09.356750 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049d2e25-edee-4b07-9cd0-5173df4d682d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:09.357459 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049d2e25-edee-4b07-9cd0-5173df4d682d None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:09.357748 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049d2e25-edee-4b07-9cd0-5173df4d682d None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:09.358028 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049d2e25-edee-4b07-9cd0-5173df4d682d None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:09.358809 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049d2e25-edee-4b07-9cd0-5173df4d682d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:27:09.359123 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049d2e25-edee-4b07-9cd0-5173df4d682d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:09.360604 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049d2e25-edee-4b07-9cd0-5173df4d682d None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:09.375516 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 507/1024] 10.222.0.36 () {56 vars in 1115 bytes} [Fri Jun 24 22:27:09 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 22:27:09.378198 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef1830a-0c70-4804-b675-219acb80cd45 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:09.501199 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef1830a-0c70-4804-b675-219acb80cd45 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:09.536860 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fb937b-781a-4b29-940c-04b766f60f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:09.537677 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb937b-781a-4b29-940c-04b766f60f5e None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:09.537962 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb937b-781a-4b29-940c-04b766f60f5e None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:09.538262 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb937b-781a-4b29-940c-04b766f60f5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:09.549639 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fb937b-781a-4b29-940c-04b766f60f5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:09.551121 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fb937b-781a-4b29-940c-04b766f60f5e None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:09.568412 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-a6fb937b-781a-4b29-940c-04b766f60f5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:27:09.568412 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:27:09.568412 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:27:09.568412 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:27:09.568412 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:27:09.568412 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:27:09.568412 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:27:09.568412 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:27:09.568412 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:27:09.568412 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:27:09.568412 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:27:09.568412 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:27:09.568412 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 22:27:09.568412 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 22:27:09.568412 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 22:27:09.569349 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 22:27:09.569349 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:27:09.569349 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:27:09.569349 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:27:09.569349 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:27:09.569349 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:27:09.569349 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:27:09.569349 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:27:09.569349 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:27:09.569349 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:27:09.569349 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:27:09.569349 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:27:09.569349 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:27:09.569349 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:27:09.569349 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:27:09.569349 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:27:09.569349 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:27:09.570288 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 22:27:09.570288 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 22:27:09.570288 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:27:09.570288 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:27:09.570288 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 518/1025] 10.222.0.36 () {56 vars in 1108 bytes} [Fri Jun 24 22:27:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:27:09.576832 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049d2e25-edee-4b07-9cd0-5173df4d682d None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:09.672555 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:09.683006 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049d2e25-edee-4b07-9cd0-5173df4d682d None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:09.717902 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a087d827-e676-4092-bb7c-ef885165eca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:09.718937 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a087d827-e676-4092-bb7c-ef885165eca5 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:09.719440 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a087d827-e676-4092-bb7c-ef885165eca5 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:09.719884 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a087d827-e676-4092-bb7c-ef885165eca5 None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:09.720774 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a087d827-e676-4092-bb7c-ef885165eca5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:27:09.721269 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a087d827-e676-4092-bb7c-ef885165eca5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:09.722818 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a087d827-e676-4092-bb7c-ef885165eca5 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:09.736001 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 508/1026] 10.222.0.36 () {56 vars in 1109 bytes} [Fri Jun 24 22:27:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:27:09.741238 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fb937b-781a-4b29-940c-04b766f60f5e None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:09.771064 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:09.846167 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fb937b-781a-4b29-940c-04b766f60f5e None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:09.879286 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ce097f-7a51-4a5b-b630-9cb88a1ceb8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:09.880080 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ce097f-7a51-4a5b-b630-9cb88a1ceb8c None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:09.880686 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ce097f-7a51-4a5b-b630-9cb88a1ceb8c None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:09.880954 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ce097f-7a51-4a5b-b630-9cb88a1ceb8c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:09.888639 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ce097f-7a51-4a5b-b630-9cb88a1ceb8c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:09.890089 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ce097f-7a51-4a5b-b630-9cb88a1ceb8c None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:09.903816 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-02ce097f-7a51-4a5b-b630-9cb88a1ceb8c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 24 22:27:09.903816 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:27:09.903816 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:27:09.903816 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:27:09.903816 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:27:09.903816 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:27:09.903816 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:27:09.903816 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:27:09.903816 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:27:09.903816 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:27:09.903816 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:27:09.903816 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:27:09.903816 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 22:27:09.903816 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 22:27:09.903816 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 22:27:09.903816 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 22:27:09.904744 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:27:09.904744 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:27:09.904744 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 22:27:09.904744 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 22:27:09.904744 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 22:27:09.904744 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 22:27:09.904744 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:27:09.904744 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:27:09.904744 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:27:09.904744 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:27:09.904744 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:27:09.904744 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:27:09.904744 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:27:09.904744 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:27:09.904744 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:27:09.904744 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:27:09.904744 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:27:09.904744 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:27:09.910355 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:27:09.910355 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:27:09.910355 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 22:27:09.910355 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 22:27:09.910355 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 22:27:09.910355 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 22:27:09.910355 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 22:27:09.910355 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 22:27:09.910355 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 24 22:27:09.910355 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:27:09.910355 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 519/1027] 10.222.0.36 () {56 vars in 1093 bytes} [Fri Jun 24 22:27:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:27:09.910967 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a087d827-e676-4092-bb7c-ef885165eca5 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:10.010287 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a087d827-e676-4092-bb7c-ef885165eca5 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:10.044867 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e48cd0-b8a7-495a-b83f-0a4837a3cb21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:10.045457 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e48cd0-b8a7-495a-b83f-0a4837a3cb21 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:10.045734 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e48cd0-b8a7-495a-b83f-0a4837a3cb21 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:10.046004 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e48cd0-b8a7-495a-b83f-0a4837a3cb21 None admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:10.046831 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e48cd0-b8a7-495a-b83f-0a4837a3cb21 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:27:10.047136 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e48cd0-b8a7-495a-b83f-0a4837a3cb21 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:10.048614 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e48cd0-b8a7-495a-b83f-0a4837a3cb21 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:10.070912 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 509/1028] 10.222.0.36 () {56 vars in 1133 bytes} [Fri Jun 24 22:27:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 22:27:10.072372 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ce097f-7a51-4a5b-b630-9cb88a1ceb8c None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:10.160884 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:10.178106 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ce097f-7a51-4a5b-b630-9cb88a1ceb8c None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:10.214105 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633c78e4-952f-4558-8a75-795750bc2967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:10.215102 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c78e4-952f-4558-8a75-795750bc2967 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:10.215652 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c78e4-952f-4558-8a75-795750bc2967 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:10.216200 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c78e4-952f-4558-8a75-795750bc2967 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:10.283180 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633c78e4-952f-4558-8a75-795750bc2967 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:10.284883 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633c78e4-952f-4558-8a75-795750bc2967 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:10.365960 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:10.383190 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 520/1029] 10.222.0.36 () {58 vars in 1282 bytes} [Fri Jun 24 22:27:10 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 24 22:27:10.388934 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e48cd0-b8a7-495a-b83f-0a4837a3cb21 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:10.401385 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:10.500161 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e48cd0-b8a7-495a-b83f-0a4837a3cb21 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:10.536106 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b997af2-0ca1-4631-a32a-83ba51fb276f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:10.536899 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b997af2-0ca1-4631-a32a-83ba51fb276f None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:10.537148 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b997af2-0ca1-4631-a32a-83ba51fb276f None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:10.537449 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b997af2-0ca1-4631-a32a-83ba51fb276f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:10.548151 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b997af2-0ca1-4631-a32a-83ba51fb276f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:10.549623 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b997af2-0ca1-4631-a32a-83ba51fb276f None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:10.567469 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-2b997af2-0ca1-4631-a32a-83ba51fb276f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:27:10.567469 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:27:10.567469 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:27:10.567469 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:27:10.567469 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:27:10.567469 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:27:10.567469 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:27:10.567469 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:27:10.567469 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:27:10.567469 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:27:10.567469 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:27:10.567469 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:27:10.567469 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 22:27:10.567469 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 22:27:10.567469 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 22:27:10.568402 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 22:27:10.568402 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:27:10.568402 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:27:10.568402 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:27:10.568402 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:27:10.568402 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:27:10.568402 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:27:10.568402 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:27:10.568402 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:27:10.568402 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:27:10.568402 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:27:10.568402 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:27:10.568402 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:27:10.568402 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:27:10.568402 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:27:10.568402 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:27:10.568402 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:27:10.569297 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 22:27:10.569297 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 22:27:10.569297 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:27:10.569297 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:27:10.571352 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 510/1030] 10.222.0.36 () {56 vars in 1108 bytes} [Fri Jun 24 22:27:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:27:10.574762 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633c78e4-952f-4558-8a75-795750bc2967 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:10.678252 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633c78e4-952f-4558-8a75-795750bc2967 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:10.714797 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41af1081-42ec-4c92-a09a-801b17263425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:10.715509 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41af1081-42ec-4c92-a09a-801b17263425 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:10.715790 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41af1081-42ec-4c92-a09a-801b17263425 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:10.716067 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41af1081-42ec-4c92-a09a-801b17263425 None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:10.716779 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41af1081-42ec-4c92-a09a-801b17263425 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:27:10.717080 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41af1081-42ec-4c92-a09a-801b17263425 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:10.718500 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41af1081-42ec-4c92-a09a-801b17263425 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:10.731079 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 521/1031] 10.222.0.36 () {56 vars in 1109 bytes} [Fri Jun 24 22:27:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:27:10.736583 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b997af2-0ca1-4631-a32a-83ba51fb276f None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:10.801964 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:10.841665 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b997af2-0ca1-4631-a32a-83ba51fb276f None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:10.875679 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1107838a-b5d7-4cfa-a9cf-599e3e61ccb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:10.876474 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1107838a-b5d7-4cfa-a9cf-599e3e61ccb4 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:10.876752 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1107838a-b5d7-4cfa-a9cf-599e3e61ccb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:10.877024 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1107838a-b5d7-4cfa-a9cf-599e3e61ccb4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:10.884237 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1107838a-b5d7-4cfa-a9cf-599e3e61ccb4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:10.885691 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1107838a-b5d7-4cfa-a9cf-599e3e61ccb4 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:10.899413 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-1107838a-b5d7-4cfa-a9cf-599e3e61ccb4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 22:27:10.899413 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:27:10.899413 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:27:10.899413 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:27:10.899413 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:27:10.899413 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:27:10.899413 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:27:10.899413 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:27:10.899413 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:27:10.899413 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:27:10.899413 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:27:10.899413 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:27:10.899413 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 22:27:10.899413 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 22:27:10.899413 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 22:27:10.900317 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 22:27:10.900317 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:27:10.900317 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:27:10.900317 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:27:10.900317 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:27:10.900317 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:27:10.900317 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:27:10.900317 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:27:10.900317 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:27:10.900317 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:27:10.900317 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:27:10.900317 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:27:10.900317 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:27:10.900317 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:27:10.900317 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:27:10.900317 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:27:10.900317 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:27:10.901202 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 22:27:10.901202 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 22:27:10.901202 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 22:27:10.901202 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 22:27:10.901202 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 22:27:10.901202 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 22:27:10.901202 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 22:27:10.901202 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:27:10.901202 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 511/1032] 10.222.0.36 () {56 vars in 1111 bytes} [Fri Jun 24 22:27:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:27:10.907719 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41af1081-42ec-4c92-a09a-801b17263425 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:10.955722 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:11.012741 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41af1081-42ec-4c92-a09a-801b17263425 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:11.049582 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a671a5b-caae-4cca-b428-ec5c27794e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:11.050249 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a671a5b-caae-4cca-b428-ec5c27794e1d None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:11.050528 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a671a5b-caae-4cca-b428-ec5c27794e1d None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:11.050801 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a671a5b-caae-4cca-b428-ec5c27794e1d None admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:11.051620 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a671a5b-caae-4cca-b428-ec5c27794e1d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:27:11.051928 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a671a5b-caae-4cca-b428-ec5c27794e1d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:11.053387 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a671a5b-caae-4cca-b428-ec5c27794e1d None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:11.071436 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 522/1033] 10.222.0.36 () {56 vars in 1148 bytes} [Fri Jun 24 22:27:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:27:11.072711 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1107838a-b5d7-4cfa-a9cf-599e3e61ccb4 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:11.110308 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a3b6cd-6df9-4fed-98c4-07ecc1a74dec None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:11.110684 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a3b6cd-6df9-4fed-98c4-07ecc1a74dec None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:11.110863 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a3b6cd-6df9-4fed-98c4-07ecc1a74dec None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:11.112274 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 523/1034] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:27:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:27:11.117378 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543ba918-5d49-4b24-ad62-3f9581c7d3f2 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:11.117666 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543ba918-5d49-4b24-ad62-3f9581c7d3f2 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:11.117944 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543ba918-5d49-4b24-ad62-3f9581c7d3f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:11.134680 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-543ba918-5d49-4b24-ad62-3f9581c7d3f2 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:27:11.135894 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-543ba918-5d49-4b24-ad62-3f9581c7d3f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:27:11.181768 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1107838a-b5d7-4cfa-a9cf-599e3e61ccb4 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:11.203742 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 524/1035] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:27:11 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 22:27:11.206569 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:11.219168 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e6632e-61a8-4004-9f3b-5b5d74a800b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:11.219860 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e6632e-61a8-4004-9f3b-5b5d74a800b5 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:11.220139 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e6632e-61a8-4004-9f3b-5b5d74a800b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:11.220412 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e6632e-61a8-4004-9f3b-5b5d74a800b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:11.221237 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e6632e-61a8-4004-9f3b-5b5d74a800b5 None admin] RBAC: Adding query filter params (role.id=89095043d87040e39cf7bd2875c789f2, scope.project.id=d189b31bbec0469381292d2cde3cb420, user.id=214d9071042c4bad886bf060a079b6e2) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:27:11.221545 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e6632e-61a8-4004-9f3b-5b5d74a800b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:11.223022 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e6632e-61a8-4004-9f3b-5b5d74a800b5 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:11.231290 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 512/1036] 10.222.0.36 () {56 vars in 1374 bytes} [Fri Jun 24 22:27:11 2022] GET /identity/v3/role_assignments?user.id=214d9071042c4bad886bf060a079b6e2&scope.project.id=d189b31bbec0469381292d2cde3cb420&role.id=89095043d87040e39cf7bd2875c789f2 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 22:27:11.231448 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543ba918-5d49-4b24-ad62-3f9581c7d3f2 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:11.267509 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:11.343808 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543ba918-5d49-4b24-ad62-3f9581c7d3f2 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:11.382498 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a75a3e-32ea-46b9-a8da-cb1e7829229d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:11.383468 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a75a3e-32ea-46b9-a8da-cb1e7829229d None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:11.383745 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a75a3e-32ea-46b9-a8da-cb1e7829229d None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:11.384005 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a75a3e-32ea-46b9-a8da-cb1e7829229d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:11.385196 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a75a3e-32ea-46b9-a8da-cb1e7829229d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:11.386644 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a75a3e-32ea-46b9-a8da-cb1e7829229d None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:11.388334 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 525/1037] 10.222.0.36 () {56 vars in 1108 bytes} [Fri Jun 24 22:27:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 22:27:11.394625 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e6632e-61a8-4004-9f3b-5b5d74a800b5 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:11.440758 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee4250a-5cef-4717-b052-0dc6b3aa9f6b None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:11.441050 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee4250a-5cef-4717-b052-0dc6b3aa9f6b None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:11.441333 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee4250a-5cef-4717-b052-0dc6b3aa9f6b None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:11.442858 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 526/1038] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:27:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:27:11.448381 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68060e1b-327f-4051-beb5-d2ed39a22a46 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:11.448656 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68060e1b-327f-4051-beb5-d2ed39a22a46 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:11.448956 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68060e1b-327f-4051-beb5-d2ed39a22a46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:11.466089 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-68060e1b-327f-4051-beb5-d2ed39a22a46 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:27:11.467347 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-68060e1b-327f-4051-beb5-d2ed39a22a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:27:11.507499 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e6632e-61a8-4004-9f3b-5b5d74a800b5 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:11.542481 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 527/1039] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:27:11 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 22:27:11.543266 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76561a6-61ff-470b-8e70-8b6479ed2a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:11.544145 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76561a6-61ff-470b-8e70-8b6479ed2a35 None admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:11.544603 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76561a6-61ff-470b-8e70-8b6479ed2a35 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:11.545075 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76561a6-61ff-470b-8e70-8b6479ed2a35 None admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:11.545986 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76561a6-61ff-470b-8e70-8b6479ed2a35 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:11.547637 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76561a6-61ff-470b-8e70-8b6479ed2a35 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:11.568029 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68060e1b-327f-4051-beb5-d2ed39a22a46 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:11.571534 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 513/1040] 10.222.0.36 () {60 vars in 1132 bytes} [Fri Jun 24 22:27:11 2022] POST /identity/v3/users => generated 285 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 22:27:11.606065 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:11.680683 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68060e1b-327f-4051-beb5-d2ed39a22a46 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:11.719289 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73af786-6d1b-426e-9c18-0dee2b6ab945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:11.720040 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73af786-6d1b-426e-9c18-0dee2b6ab945 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:11.720320 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73af786-6d1b-426e-9c18-0dee2b6ab945 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:11.720595 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73af786-6d1b-426e-9c18-0dee2b6ab945 None admin] PATH_INFO: `/v3/services/image` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:11.721297 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73af786-6d1b-426e-9c18-0dee2b6ab945 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:11.722702 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73af786-6d1b-426e-9c18-0dee2b6ab945 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:11.734817 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-a73af786-6d1b-426e-9c18-0dee2b6ab945 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 24 22:27:11.734817 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:27:11.734817 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 22:27:11.734817 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 22:27:11.734817 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 22:27:11.734817 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 22:27:11.734817 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 22:27:11.734817 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 22:27:11.734817 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 24 22:27:11.734817 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:27:11.734817 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 22:27:11.734817 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:27:11.734817 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:27:11.734817 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:27:11.734817 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:27:11.734817 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:27:11.734817 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:27:11.735875 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:27:11.735875 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:27:11.735875 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:27:11.735875 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:27:11.735875 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:27:11.735875 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:27:11.735875 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 22:27:11.735875 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 22:27:11.735875 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 22:27:11.735875 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 22:27:11.735875 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:27:11.735875 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:27:11.735875 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:27:11.735875 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:27:11.735875 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:27:11.735875 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:27:11.736710 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:27:11.736710 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:27:11.736710 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:27:11.736710 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:27:11.736710 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:27:11.736710 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:27:11.736710 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:27:11.736710 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:27:11.736710 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:27:11.736710 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:27:11.736710 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 22:27:11.736710 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 22:27:11.736710 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 24 22:27:11.736710 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:27:11.736710 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 528/1041] 10.222.0.36 () {56 vars in 1105 bytes} [Fri Jun 24 22:27:11 2022] GET /identity/v3/services/image => generated 86 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:27:11.743839 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76561a6-61ff-470b-8e70-8b6479ed2a35 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:11.790262 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:11.851669 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76561a6-61ff-470b-8e70-8b6479ed2a35 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:11.885612 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbbe2a8-2d39-4c0b-a8fb-7222f6000834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:11.886613 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbbe2a8-2d39-4c0b-a8fb-7222f6000834 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:11.887077 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbbe2a8-2d39-4c0b-a8fb-7222f6000834 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:11.887544 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbbe2a8-2d39-4c0b-a8fb-7222f6000834 None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:11.888418 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbbe2a8-2d39-4c0b-a8fb-7222f6000834 None admin] RBAC: Adding query filter params (name=image) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:27:11.888890 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbbe2a8-2d39-4c0b-a8fb-7222f6000834 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:11.890452 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbbe2a8-2d39-4c0b-a8fb-7222f6000834 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:11.896088 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 514/1042] 10.222.0.36 () {56 vars in 1108 bytes} [Fri Jun 24 22:27:11 2022] GET /identity/v3/services?name=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:27:11.901857 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73af786-6d1b-426e-9c18-0dee2b6ab945 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:12.003862 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:12.009701 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73af786-6d1b-426e-9c18-0dee2b6ab945 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:12.043731 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cda3477-7d1b-4ab1-9f85-7a760fcc1f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:12.044421 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cda3477-7d1b-4ab1-9f85-7a760fcc1f34 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:12.044695 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cda3477-7d1b-4ab1-9f85-7a760fcc1f34 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:12.044966 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cda3477-7d1b-4ab1-9f85-7a760fcc1f34 None admin] PATH_INFO: `/v3/services` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:12.045669 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cda3477-7d1b-4ab1-9f85-7a760fcc1f34 None admin] RBAC: Adding query filter params (type=image) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:27:12.045967 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cda3477-7d1b-4ab1-9f85-7a760fcc1f34 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:12.047376 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cda3477-7d1b-4ab1-9f85-7a760fcc1f34 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:12.052467 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 529/1043] 10.222.0.36 () {56 vars in 1108 bytes} [Fri Jun 24 22:27:11 2022] GET /identity/v3/services?type=image => generated 350 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:27:12.058393 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbbe2a8-2d39-4c0b-a8fb-7222f6000834 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:12.166565 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbbe2a8-2d39-4c0b-a8fb-7222f6000834 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:12.173864 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:12.202883 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eb3ec2-1098-485e-9237-6aa05e33910e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:12.203581 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb3ec2-1098-485e-9237-6aa05e33910e None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:12.203870 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb3ec2-1098-485e-9237-6aa05e33910e None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:12.204147 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb3ec2-1098-485e-9237-6aa05e33910e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:12.204951 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eb3ec2-1098-485e-9237-6aa05e33910e None admin] RBAC: Adding query filter params (interface=public, service_id=45c3f6d8180a4b67b58b3876b9329fee, region_id=RegionOne) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:27:12.205330 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eb3ec2-1098-485e-9237-6aa05e33910e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:12.206710 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eb3ec2-1098-485e-9237-6aa05e33910e None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:12.212531 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 515/1044] 10.222.0.36 () {56 vars in 1251 bytes} [Fri Jun 24 22:27:12 2022] GET /identity/v3/endpoints?service_id=45c3f6d8180a4b67b58b3876b9329fee&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 22:27:12.217924 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cda3477-7d1b-4ab1-9f85-7a760fcc1f34 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:12.326317 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cda3477-7d1b-4ab1-9f85-7a760fcc1f34 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:12.367281 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be967f24-0250-48c7-b662-6caa1a5198a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:12.368032 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be967f24-0250-48c7-b662-6caa1a5198a9 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:12.368314 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be967f24-0250-48c7-b662-6caa1a5198a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:12.368587 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be967f24-0250-48c7-b662-6caa1a5198a9 None admin] PATH_INFO: `/v3/services` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:12.369274 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be967f24-0250-48c7-b662-6caa1a5198a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:12.370675 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be967f24-0250-48c7-b662-6caa1a5198a9 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:12.378202 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 530/1045] 10.222.0.36 () {56 vars in 1087 bytes} [Fri Jun 24 22:27:12 2022] GET /identity/v3/services => generated 1957 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:27:13.255874 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cd017f-0b60-45cd-ab69-7e8b47ac9cae None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:13.256410 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cd017f-0b60-45cd-ab69-7e8b47ac9cae None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:13.256410 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cd017f-0b60-45cd-ab69-7e8b47ac9cae None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:13.258141 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 516/1046] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:27:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:27:13.263592 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a9a39c-777a-4ce0-b0ce-8395118fb983 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:13.264022 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a9a39c-777a-4ce0-b0ce-8395118fb983 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:13.264211 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a9a39c-777a-4ce0-b0ce-8395118fb983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:13.281327 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-71a9a39c-777a-4ce0-b0ce-8395118fb983 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:27:13.282524 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-71a9a39c-777a-4ce0-b0ce-8395118fb983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:27:13.303800 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:13.354219 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 531/1047] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:27:13 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 22:27:13.376960 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cd017f-0b60-45cd-ab69-7e8b47ac9cae None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:13.492507 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cd017f-0b60-45cd-ab69-7e8b47ac9cae None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:13.530133 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ec2f94-7939-4c82-802a-c1bd058a1eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:13.531350 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec2f94-7939-4c82-802a-c1bd058a1eeb None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:13.531828 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec2f94-7939-4c82-802a-c1bd058a1eeb None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:13.532306 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec2f94-7939-4c82-802a-c1bd058a1eeb None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:13.543831 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ec2f94-7939-4c82-802a-c1bd058a1eeb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 22:27:13.552114 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-b5ec2f94-7939-4c82-802a-c1bd058a1eeb None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 22:27:13.552114 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:27:13.552114 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:27:13.552114 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:27:13.552114 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:27:13.552114 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:27:13.552114 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:27:13.552114 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:27:13.552114 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:27:13.552114 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:27:13.552114 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:27:13.552114 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:27:13.552114 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 22:27:13.552114 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 22:27:13.552114 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 22:27:13.552114 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 22:27:13.553014 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 22:27:13.553014 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 22:27:13.553014 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 22:27:13.553014 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 22:27:13.553014 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:27:13.553014 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:27:13.553014 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:27:13.553014 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:27:13.553014 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:27:13.553014 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:27:13.553014 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:27:13.553014 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:27:13.553014 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:27:13.553014 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:27:13.553014 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:27:13.553014 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:27:13.553891 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:27:13.553891 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:27:13.553891 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:27:13.553891 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:27:13.553891 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 22:27:13.553891 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 22:27:13.553891 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 22:27:13.553891 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 22:27:13.553891 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 22:27:13.553891 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 22:27:13.553891 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 22:27:13.553891 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:27:13.556593 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 517/1048] 10.222.0.36 () {56 vars in 1120 bytes} [Fri Jun 24 22:27:13 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:27:13.562808 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a9a39c-777a-4ce0-b0ce-8395118fb983 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:13.661629 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a9a39c-777a-4ce0-b0ce-8395118fb983 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:13.675093 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b093cef-6c7a-4e9d-8598-879177c67f06 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:13.675495 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b093cef-6c7a-4e9d-8598-879177c67f06 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:13.675834 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b093cef-6c7a-4e9d-8598-879177c67f06 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:13.677312 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 518/1049] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:27:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:27:13.682588 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f2d608-2dc7-4183-8562-88a6df59f6cd None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:13.682876 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f2d608-2dc7-4183-8562-88a6df59f6cd None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:13.683149 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f2d608-2dc7-4183-8562-88a6df59f6cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:13.697440 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee4ba40-ec70-4437-b2ee-ff6e3be01ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:13.698424 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee4ba40-ec70-4437-b2ee-ff6e3be01ebb None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:13.698919 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee4ba40-ec70-4437-b2ee-ff6e3be01ebb None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:13.699420 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee4ba40-ec70-4437-b2ee-ff6e3be01ebb None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:13.699949 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-50f2d608-2dc7-4183-8562-88a6df59f6cd None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:27:13.700608 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee4ba40-ec70-4437-b2ee-ff6e3be01ebb None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:27:13.701112 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee4ba40-ec70-4437-b2ee-ff6e3be01ebb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:13.701215 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-50f2d608-2dc7-4183-8562-88a6df59f6cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:27:13.702807 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee4ba40-ec70-4437-b2ee-ff6e3be01ebb None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:13.712125 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 532/1050] 10.222.0.36 () {56 vars in 1115 bytes} [Fri Jun 24 22:27:13 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 22:27:13.717174 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee4ba40-ec70-4437-b2ee-ff6e3be01ebb None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:13.730106 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:13.738422 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:13.777875 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 519/1051] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:27:13 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 22:27:13.801152 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f2d608-2dc7-4183-8562-88a6df59f6cd None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:13.824786 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee4ba40-ec70-4437-b2ee-ff6e3be01ebb None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:13.856894 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233aa3ef-177d-41ae-9ac5-fe769a66529f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:13.857693 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233aa3ef-177d-41ae-9ac5-fe769a66529f None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:13.857973 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233aa3ef-177d-41ae-9ac5-fe769a66529f None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:13.858237 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233aa3ef-177d-41ae-9ac5-fe769a66529f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:13.868740 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233aa3ef-177d-41ae-9ac5-fe769a66529f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:13.870200 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233aa3ef-177d-41ae-9ac5-fe769a66529f None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:13.887292 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-233aa3ef-177d-41ae-9ac5-fe769a66529f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:27:13.887292 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:27:13.887292 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:27:13.887292 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:27:13.887292 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:27:13.887292 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:27:13.887292 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:27:13.887292 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:27:13.887292 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:27:13.887292 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:27:13.887292 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:27:13.887292 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:27:13.887292 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 22:27:13.887292 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 22:27:13.887292 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 22:27:13.888214 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 22:27:13.888214 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:27:13.888214 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:27:13.888214 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:27:13.888214 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:27:13.888214 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:27:13.888214 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:27:13.888214 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:27:13.888214 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:27:13.888214 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:27:13.888214 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:27:13.888214 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:27:13.888214 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:27:13.888214 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:27:13.888214 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:27:13.888214 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:27:13.888214 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:27:13.889103 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 22:27:13.889103 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 22:27:13.889103 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:27:13.889103 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:27:13.889103 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 533/1052] 10.222.0.36 () {56 vars in 1108 bytes} [Fri Jun 24 22:27:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:27:13.894215 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233aa3ef-177d-41ae-9ac5-fe769a66529f None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:13.911188 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f2d608-2dc7-4183-8562-88a6df59f6cd None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:13.948655 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52f7032-0d76-4daa-ac73-9da789ac1bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:13.949464 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f7032-0d76-4daa-ac73-9da789ac1bba None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:13.949745 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f7032-0d76-4daa-ac73-9da789ac1bba None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:13.950021 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f7032-0d76-4daa-ac73-9da789ac1bba None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:13.961651 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52f7032-0d76-4daa-ac73-9da789ac1bba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 22:27:13.963629 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:13.970364 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-e52f7032-0d76-4daa-ac73-9da789ac1bba None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 22:27:13.970364 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:27:13.970364 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:27:13.970364 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:27:13.970364 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:27:13.970364 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:27:13.970364 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:27:13.970364 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:27:13.970364 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:27:13.970364 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:27:13.970364 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:27:13.970364 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:27:13.970364 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 22:27:13.970364 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 22:27:13.970364 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 22:27:13.970364 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 22:27:13.971522 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 22:27:13.971522 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 22:27:13.971522 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 22:27:13.971522 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 22:27:13.971522 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:27:13.971522 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:27:13.971522 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:27:13.971522 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:27:13.971522 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:27:13.971522 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:27:13.971522 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:27:13.971522 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:27:13.971522 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:27:13.971522 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:27:13.971522 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:27:13.971522 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:27:13.972369 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:27:13.972369 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:27:13.972369 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:27:13.972369 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:27:13.972369 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 22:27:13.972369 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 22:27:13.972369 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 22:27:13.972369 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 22:27:13.972369 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 22:27:13.972369 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 22:27:13.972369 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 22:27:13.972369 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:27:13.972369 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 520/1053] 10.222.0.36 () {56 vars in 1096 bytes} [Fri Jun 24 22:27:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 22:27:13.977812 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52f7032-0d76-4daa-ac73-9da789ac1bba None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:13.998655 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233aa3ef-177d-41ae-9ac5-fe769a66529f None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:14.003049 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:14.036446 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c914e77-6ab8-4693-982e-889a10d66086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:14.037118 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c914e77-6ab8-4693-982e-889a10d66086 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:14.037408 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c914e77-6ab8-4693-982e-889a10d66086 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:14.037680 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c914e77-6ab8-4693-982e-889a10d66086 None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:14.038698 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c914e77-6ab8-4693-982e-889a10d66086 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:27:14.039049 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c914e77-6ab8-4693-982e-889a10d66086 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:14.040502 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c914e77-6ab8-4693-982e-889a10d66086 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:14.052585 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 534/1054] 10.222.0.36 () {56 vars in 1109 bytes} [Fri Jun 24 22:27:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 22:27:14.059185 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c914e77-6ab8-4693-982e-889a10d66086 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:14.091722 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52f7032-0d76-4daa-ac73-9da789ac1bba None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:14.126743 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da0b0e6-a59b-4d7f-8cd0-1272feea7d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:14.127686 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da0b0e6-a59b-4d7f-8cd0-1272feea7d69 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:14.128131 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da0b0e6-a59b-4d7f-8cd0-1272feea7d69 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:14.128546 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da0b0e6-a59b-4d7f-8cd0-1272feea7d69 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:14.129454 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da0b0e6-a59b-4d7f-8cd0-1272feea7d69 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:27:14.129759 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da0b0e6-a59b-4d7f-8cd0-1272feea7d69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:14.131509 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da0b0e6-a59b-4d7f-8cd0-1272feea7d69 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:14.140249 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 521/1055] 10.222.0.36 () {56 vars in 1099 bytes} [Fri Jun 24 22:27:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 22:27:14.145745 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da0b0e6-a59b-4d7f-8cd0-1272feea7d69 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:14.166369 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c914e77-6ab8-4693-982e-889a10d66086 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:14.198426 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:14.205578 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f31020-70ee-42f7-97de-59ca068031bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:14.206500 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f31020-70ee-42f7-97de-59ca068031bd None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:14.206876 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f31020-70ee-42f7-97de-59ca068031bd None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:14.207162 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f31020-70ee-42f7-97de-59ca068031bd None admin] PATH_INFO: `/v3/users/nova` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:14.215007 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f31020-70ee-42f7-97de-59ca068031bd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:14.216538 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f31020-70ee-42f7-97de-59ca068031bd None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:14.230584 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:14.237775 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-33f31020-70ee-42f7-97de-59ca068031bd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 24 22:27:14.237775 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:27:14.237775 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:27:14.237775 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:27:14.237775 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:27:14.237775 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:27:14.237775 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:27:14.237775 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:27:14.237775 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:27:14.237775 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:27:14.237775 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:27:14.237775 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:27:14.237775 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 22:27:14.237775 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 22:27:14.237775 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 22:27:14.237775 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 22:27:14.238790 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:27:14.238790 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:27:14.238790 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 22:27:14.238790 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 22:27:14.238790 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 22:27:14.238790 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 22:27:14.238790 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:27:14.238790 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:27:14.238790 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:27:14.238790 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:27:14.238790 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:27:14.238790 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:27:14.238790 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:27:14.238790 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:27:14.238790 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:27:14.238790 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:27:14.238790 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:27:14.238790 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:27:14.239771 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:27:14.239771 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:27:14.239771 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 22:27:14.239771 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 22:27:14.239771 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 22:27:14.239771 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 22:27:14.239771 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 22:27:14.239771 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 22:27:14.239771 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 24 22:27:14.239771 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:27:14.239771 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 535/1056] 10.222.0.36 () {56 vars in 1093 bytes} [Fri Jun 24 22:27:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 22:27:14.244750 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f31020-70ee-42f7-97de-59ca068031bd None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:14.257896 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da0b0e6-a59b-4d7f-8cd0-1272feea7d69 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:14.297354 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a184ff94-5c94-454b-a971-1cb192715f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:14.298607 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a184ff94-5c94-454b-a971-1cb192715f93 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:14.299086 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a184ff94-5c94-454b-a971-1cb192715f93 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:14.299554 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a184ff94-5c94-454b-a971-1cb192715f93 None admin] PATH_INFO: `/v3/users/32c785c4ae1f4d41bbebdc119c605faf` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:14.314567 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a184ff94-5c94-454b-a971-1cb192715f93 None admin] RBAC: Authorizing `identity:get_user(user_id=32c785c4ae1f4d41bbebdc119c605faf)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:14.316265 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a184ff94-5c94-454b-a971-1cb192715f93 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:14.318134 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 522/1057] 10.222.0.36 () {56 vars in 1177 bytes} [Fri Jun 24 22:27:14 2022] GET /identity/v3/users/32c785c4ae1f4d41bbebdc119c605faf => generated 285 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 22:27:14.324015 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a184ff94-5c94-454b-a971-1cb192715f93 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:14.350714 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f31020-70ee-42f7-97de-59ca068031bd None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:14.386907 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b282919d-c917-460e-9a05-024e552bffb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:14.387602 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b282919d-c917-460e-9a05-024e552bffb7 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:14.387881 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b282919d-c917-460e-9a05-024e552bffb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:14.388153 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b282919d-c917-460e-9a05-024e552bffb7 None admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:14.388986 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b282919d-c917-460e-9a05-024e552bffb7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:27:14.389295 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b282919d-c917-460e-9a05-024e552bffb7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:14.390757 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b282919d-c917-460e-9a05-024e552bffb7 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:14.409569 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 536/1058] 10.222.0.36 () {56 vars in 1133 bytes} [Fri Jun 24 22:27:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 22:27:14.415130 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b282919d-c917-460e-9a05-024e552bffb7 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:14.434276 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a184ff94-5c94-454b-a971-1cb192715f93 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:14.465110 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:14.470336 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63719184-5eeb-45b2-80a3-8b83b84c44ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:14.471147 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63719184-5eeb-45b2-80a3-8b83b84c44ae None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:14.471470 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63719184-5eeb-45b2-80a3-8b83b84c44ae None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:14.471744 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63719184-5eeb-45b2-80a3-8b83b84c44ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:14.482576 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:14.515053 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b282919d-c917-460e-9a05-024e552bffb7 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:14.540433 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63719184-5eeb-45b2-80a3-8b83b84c44ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:14.541895 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63719184-5eeb-45b2-80a3-8b83b84c44ae None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:14.548444 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bde802-4ce1-4712-b52b-68b2655d9fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:14.549246 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bde802-4ce1-4712-b52b-68b2655d9fe1 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:14.549527 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bde802-4ce1-4712-b52b-68b2655d9fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:14.549804 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bde802-4ce1-4712-b52b-68b2655d9fe1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:14.560647 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bde802-4ce1-4712-b52b-68b2655d9fe1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:14.562120 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bde802-4ce1-4712-b52b-68b2655d9fe1 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:14.580268 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-e5bde802-4ce1-4712-b52b-68b2655d9fe1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:27:14.580268 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:27:14.580268 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:27:14.580268 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:27:14.580268 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:27:14.580268 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:27:14.580268 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:27:14.580268 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:27:14.580268 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:27:14.580268 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:27:14.580268 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:27:14.580268 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:27:14.580268 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 22:27:14.580268 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 22:27:14.580268 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 22:27:14.581187 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 22:27:14.581187 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:27:14.581187 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:27:14.581187 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:27:14.581187 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:27:14.581187 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:27:14.581187 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:27:14.581187 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:27:14.581187 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:27:14.581187 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:27:14.581187 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:27:14.581187 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:27:14.581187 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:27:14.581187 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:27:14.581187 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:27:14.581187 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:27:14.581187 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:27:14.582052 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 22:27:14.582052 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 22:27:14.582052 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:27:14.582052 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:27:14.582052 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 537/1059] 10.222.0.36 () {56 vars in 1108 bytes} [Fri Jun 24 22:27:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 22:27:14.582660 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b52885-56fc-4d15-859a-4e3eb28fdaeb None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:14.582878 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b52885-56fc-4d15-859a-4e3eb28fdaeb None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:14.583155 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b52885-56fc-4d15-859a-4e3eb28fdaeb None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:14.584459 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 538/1060] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:27:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:27:14.587133 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b52885-56fc-4d15-859a-4e3eb28fdaeb None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:14.644829 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 523/1061] 10.222.0.36 () {58 vars in 1282 bytes} [Fri Jun 24 22:27:14 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 22:27:14.646400 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4970b14-7ada-4dbe-83f6-2948841b8e2a None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:14.646684 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4970b14-7ada-4dbe-83f6-2948841b8e2a None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:14.646966 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4970b14-7ada-4dbe-83f6-2948841b8e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:14.662462 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-a4970b14-7ada-4dbe-83f6-2948841b8e2a None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:27:14.663813 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-a4970b14-7ada-4dbe-83f6-2948841b8e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:27:14.688256 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:14.693336 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b52885-56fc-4d15-859a-4e3eb28fdaeb None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:14.698026 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:14.726808 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53e6f93-f49e-4ed7-8a9b-a70cf11016c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:14.727486 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53e6f93-f49e-4ed7-8a9b-a70cf11016c8 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:14.727763 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53e6f93-f49e-4ed7-8a9b-a70cf11016c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:14.728033 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53e6f93-f49e-4ed7-8a9b-a70cf11016c8 None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:14.728742 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53e6f93-f49e-4ed7-8a9b-a70cf11016c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:27:14.728980 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 524/1062] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:27:14 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 22:27:14.729128 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53e6f93-f49e-4ed7-8a9b-a70cf11016c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:14.729788 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4970b14-7ada-4dbe-83f6-2948841b8e2a None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:14.730393 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53e6f93-f49e-4ed7-8a9b-a70cf11016c8 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:14.742120 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 539/1063] 10.222.0.36 () {56 vars in 1109 bytes} [Fri Jun 24 22:27:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:27:14.747599 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53e6f93-f49e-4ed7-8a9b-a70cf11016c8 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:14.849553 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4970b14-7ada-4dbe-83f6-2948841b8e2a None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:14.849778 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53e6f93-f49e-4ed7-8a9b-a70cf11016c8 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:14.883783 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1a7a2e-12a5-4105-baf0-2cdfbaf6697c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:14.884713 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a7a2e-12a5-4105-baf0-2cdfbaf6697c None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:14.884838 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ab0ea7-3a72-448c-aa3c-6d5ac3f690d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:14.885126 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a7a2e-12a5-4105-baf0-2cdfbaf6697c None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:14.885467 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a7a2e-12a5-4105-baf0-2cdfbaf6697c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:14.885567 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ab0ea7-3a72-448c-aa3c-6d5ac3f690d0 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:14.885861 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ab0ea7-3a72-448c-aa3c-6d5ac3f690d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:14.886143 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ab0ea7-3a72-448c-aa3c-6d5ac3f690d0 None admin] PATH_INFO: `/v3/projects/d3e9e7f6798d4bbf8e708208061c1154` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:14.887353 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ab0ea7-3a72-448c-aa3c-6d5ac3f690d0 None admin] RBAC: Authorizing `identity:get_project(project_id=d3e9e7f6798d4bbf8e708208061c1154)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:14.888977 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ab0ea7-3a72-448c-aa3c-6d5ac3f690d0 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:14.890720 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 525/1064] 10.222.0.36 () {56 vars in 1186 bytes} [Fri Jun 24 22:27:14 2022] GET /identity/v3/projects/d3e9e7f6798d4bbf8e708208061c1154 => generated 311 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:27:14.891502 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ab0ea7-3a72-448c-aa3c-6d5ac3f690d0 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:14.892923 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1a7a2e-12a5-4105-baf0-2cdfbaf6697c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:14.894381 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1a7a2e-12a5-4105-baf0-2cdfbaf6697c None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:14.909651 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-2a1a7a2e-12a5-4105-baf0-2cdfbaf6697c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 22:27:14.909651 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:27:14.909651 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:27:14.909651 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:27:14.909651 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:27:14.909651 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:27:14.909651 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:27:14.909651 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:27:14.909651 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:27:14.909651 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:27:14.909651 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:27:14.909651 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:27:14.909651 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 22:27:14.909651 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 22:27:14.909651 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 22:27:14.910694 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 22:27:14.910694 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:27:14.910694 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:27:14.910694 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:27:14.910694 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:27:14.910694 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:27:14.910694 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:27:14.910694 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:27:14.910694 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:27:14.910694 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:27:14.910694 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:27:14.910694 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:27:14.910694 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:27:14.910694 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:27:14.910694 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:27:14.910694 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:27:14.910694 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:27:14.911645 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 22:27:14.911645 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 22:27:14.911645 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 22:27:14.911645 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 22:27:14.911645 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 22:27:14.911645 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 22:27:14.911645 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 22:27:14.911645 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:27:14.911645 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 540/1065] 10.222.0.36 () {56 vars in 1111 bytes} [Fri Jun 24 22:27:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 22:27:14.912129 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1a7a2e-12a5-4105-baf0-2cdfbaf6697c None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:14.934413 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:14.938128 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:14.999957 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ab0ea7-3a72-448c-aa3c-6d5ac3f690d0 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:15.012123 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1a7a2e-12a5-4105-baf0-2cdfbaf6697c None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:15.034015 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b6ba28-20e9-4fe8-a6f6-ef097c28c17a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:15.034824 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b6ba28-20e9-4fe8-a6f6-ef097c28c17a None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:15.035107 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b6ba28-20e9-4fe8-a6f6-ef097c28c17a None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:15.035418 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b6ba28-20e9-4fe8-a6f6-ef097c28c17a None admin] PATH_INFO: `/v3/services/image` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:15.036082 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b6ba28-20e9-4fe8-a6f6-ef097c28c17a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:15.037764 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b6ba28-20e9-4fe8-a6f6-ef097c28c17a None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:15.046567 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efd1f80-833a-46fe-9d77-3c669974821f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:15.047223 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efd1f80-833a-46fe-9d77-3c669974821f None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:15.047535 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efd1f80-833a-46fe-9d77-3c669974821f None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:15.047811 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efd1f80-833a-46fe-9d77-3c669974821f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:15.048642 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efd1f80-833a-46fe-9d77-3c669974821f None admin] RBAC: Adding query filter params (role.id=1a1c43cc97a0407eb7a7c7a1333a9d4a, scope.project.id=d3e9e7f6798d4bbf8e708208061c1154, user.id=32c785c4ae1f4d41bbebdc119c605faf) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:27:15.048952 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efd1f80-833a-46fe-9d77-3c669974821f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:15.049609 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-34b6ba28-20e9-4fe8-a6f6-ef097c28c17a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 24 22:27:15.049609 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:27:15.049609 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 22:27:15.049609 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 22:27:15.049609 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 22:27:15.049609 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 22:27:15.049609 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 22:27:15.049609 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 22:27:15.049609 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 24 22:27:15.049609 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:27:15.049609 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 22:27:15.049609 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:27:15.049609 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:27:15.049609 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:27:15.049609 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:27:15.049609 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:27:15.049609 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:27:15.050728 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:27:15.050728 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:27:15.050728 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:27:15.050728 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:27:15.050728 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:27:15.050728 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:27:15.050728 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 22:27:15.050728 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 22:27:15.050728 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 22:27:15.050728 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 22:27:15.050728 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:27:15.050728 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:27:15.050728 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:27:15.050728 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:27:15.050728 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:27:15.050728 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:27:15.051821 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:27:15.051821 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:27:15.051821 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:27:15.051821 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:27:15.051821 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:27:15.051821 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:27:15.051821 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:27:15.051821 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:27:15.051821 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:27:15.051821 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:27:15.051821 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 22:27:15.051821 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 22:27:15.051821 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 24 22:27:15.051821 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:27:15.052632 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efd1f80-833a-46fe-9d77-3c669974821f None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:15.052703 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 526/1066] 10.222.0.36 () {56 vars in 1105 bytes} [Fri Jun 24 22:27:14 2022] GET /identity/v3/services/image => generated 86 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:27:15.052703 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b6ba28-20e9-4fe8-a6f6-ef097c28c17a None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:15.071388 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 541/1067] 10.222.0.36 () {56 vars in 1374 bytes} [Fri Jun 24 22:27:14 2022] GET /identity/v3/role_assignments?user.id=32c785c4ae1f4d41bbebdc119c605faf&scope.project.id=d3e9e7f6798d4bbf8e708208061c1154&role.id=1a1c43cc97a0407eb7a7c7a1333a9d4a => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:27:15.071388 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efd1f80-833a-46fe-9d77-3c669974821f None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:15.173442 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b6ba28-20e9-4fe8-a6f6-ef097c28c17a None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:15.175280 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:15.185445 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:15.202675 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efd1f80-833a-46fe-9d77-3c669974821f None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:15.215503 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919eff91-d7bf-47ce-ba01-15a5ae82e832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:15.216348 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919eff91-d7bf-47ce-ba01-15a5ae82e832 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:15.216623 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919eff91-d7bf-47ce-ba01-15a5ae82e832 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:15.216894 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919eff91-d7bf-47ce-ba01-15a5ae82e832 None admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:15.217697 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919eff91-d7bf-47ce-ba01-15a5ae82e832 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:27:15.218004 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919eff91-d7bf-47ce-ba01-15a5ae82e832 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:15.219484 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919eff91-d7bf-47ce-ba01-15a5ae82e832 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:15.233131 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 527/1068] 10.222.0.36 () {56 vars in 1148 bytes} [Fri Jun 24 22:27:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:27:15.238645 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919eff91-d7bf-47ce-ba01-15a5ae82e832 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:15.242962 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f0913a-43a1-4eef-9887-60b90c75c2d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:15.243912 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f0913a-43a1-4eef-9887-60b90c75c2d0 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:15.244368 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f0913a-43a1-4eef-9887-60b90c75c2d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:15.244820 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f0913a-43a1-4eef-9887-60b90c75c2d0 None admin] PATH_INFO: `/v3/services` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:15.245727 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f0913a-43a1-4eef-9887-60b90c75c2d0 None admin] RBAC: Adding query filter params (name=image) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:27:15.246200 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f0913a-43a1-4eef-9887-60b90c75c2d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:15.247813 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f0913a-43a1-4eef-9887-60b90c75c2d0 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:15.258282 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 542/1069] 10.222.0.36 () {56 vars in 1108 bytes} [Fri Jun 24 22:27:15 2022] GET /identity/v3/services?name=image => generated 122 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:27:15.259404 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f0913a-43a1-4eef-9887-60b90c75c2d0 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:15.350036 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919eff91-d7bf-47ce-ba01-15a5ae82e832 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:15.368743 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f0913a-43a1-4eef-9887-60b90c75c2d0 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:15.387374 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5d6f05-018c-4579-81a3-19c2cfeb7066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:15.388284 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d6f05-018c-4579-81a3-19c2cfeb7066 None admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:15.388561 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d6f05-018c-4579-81a3-19c2cfeb7066 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:15.388835 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d6f05-018c-4579-81a3-19c2cfeb7066 None admin] PATH_INFO: `/v3/projects/d189b31bbec0469381292d2cde3cb420/users/214d9071042c4bad886bf060a079b6e2/roles/89095043d87040e39cf7bd2875c789f2` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:15.391583 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5d6f05-018c-4579-81a3-19c2cfeb7066 None admin] RBAC: Authorizing `identity:create_grant(project_id=d189b31bbec0469381292d2cde3cb420, user_id=214d9071042c4bad886bf060a079b6e2, role_id=89095043d87040e39cf7bd2875c789f2)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:15.393066 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5d6f05-018c-4579-81a3-19c2cfeb7066 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:15.405082 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4699781d-f3cd-476f-8c92-a3bcbcb421f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:15.406052 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4699781d-f3cd-476f-8c92-a3bcbcb421f9 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:15.406338 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4699781d-f3cd-476f-8c92-a3bcbcb421f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:15.406612 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4699781d-f3cd-476f-8c92-a3bcbcb421f9 None admin] PATH_INFO: `/v3/services` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:15.407343 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4699781d-f3cd-476f-8c92-a3bcbcb421f9 None admin] RBAC: Adding query filter params (type=image) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:27:15.407649 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4699781d-f3cd-476f-8c92-a3bcbcb421f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:15.419508 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 528/1070] 10.222.0.36 () {58 vars in 1439 bytes} [Fri Jun 24 22:27:15 2022] PUT /identity/v3/projects/d189b31bbec0469381292d2cde3cb420/users/214d9071042c4bad886bf060a079b6e2/roles/89095043d87040e39cf7bd2875c789f2 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 22:27:15.419714 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4699781d-f3cd-476f-8c92-a3bcbcb421f9 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:15.419714 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 543/1071] 10.222.0.36 () {56 vars in 1108 bytes} [Fri Jun 24 22:27:15 2022] GET /identity/v3/services?type=image => generated 350 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:27:15.421013 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5d6f05-018c-4579-81a3-19c2cfeb7066 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:15.450215 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:15.535325 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5d6f05-018c-4579-81a3-19c2cfeb7066 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:15.572340 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa8e893-2578-4992-afa2-1233eda4ec23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:15.573010 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa8e893-2578-4992-afa2-1233eda4ec23 None admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:15.573290 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa8e893-2578-4992-afa2-1233eda4ec23 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:15.573562 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa8e893-2578-4992-afa2-1233eda4ec23 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:15.574323 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa8e893-2578-4992-afa2-1233eda4ec23 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:15.575768 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa8e893-2578-4992-afa2-1233eda4ec23 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:15.601775 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 529/1072] 10.222.0.36 () {60 vars in 1144 bytes} [Fri Jun 24 22:27:15 2022] POST /identity/v3/endpoints => generated 327 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:27:17.084768 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7710a2d4-8991-4e4c-a636-9ad980c6e83e None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:17.085359 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7710a2d4-8991-4e4c-a636-9ad980c6e83e None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:17.085359 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7710a2d4-8991-4e4c-a636-9ad980c6e83e None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:17.086958 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 544/1073] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:27:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:27:17.092229 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eb4095-2fad-45b5-adca-c75ab35363af None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:17.092656 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eb4095-2fad-45b5-adca-c75ab35363af None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:17.092848 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eb4095-2fad-45b5-adca-c75ab35363af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:17.110494 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-88eb4095-2fad-45b5-adca-c75ab35363af None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:27:17.111728 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-88eb4095-2fad-45b5-adca-c75ab35363af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:27:17.192442 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 530/1074] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:27:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 22:27:17.214914 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7710a2d4-8991-4e4c-a636-9ad980c6e83e None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:17.231337 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:17.325813 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7710a2d4-8991-4e4c-a636-9ad980c6e83e None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:17.361481 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c394097-9e8a-40ef-a575-2231f5e1728d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:17.362293 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c394097-9e8a-40ef-a575-2231f5e1728d None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:17.362573 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c394097-9e8a-40ef-a575-2231f5e1728d None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:17.362848 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c394097-9e8a-40ef-a575-2231f5e1728d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:17.374154 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c394097-9e8a-40ef-a575-2231f5e1728d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 22:27:17.382237 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-6c394097-9e8a-40ef-a575-2231f5e1728d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 22:27:17.382237 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:27:17.382237 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:27:17.382237 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:27:17.382237 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:27:17.382237 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:27:17.382237 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:27:17.382237 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:27:17.382237 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:27:17.382237 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:27:17.382237 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:27:17.382237 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:27:17.382237 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 22:27:17.382237 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 22:27:17.382237 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 22:27:17.382237 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 22:27:17.383219 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 22:27:17.383219 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 22:27:17.383219 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 22:27:17.383219 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 22:27:17.383219 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:27:17.383219 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:27:17.383219 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:27:17.383219 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:27:17.383219 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:27:17.383219 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:27:17.383219 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:27:17.383219 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:27:17.383219 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:27:17.383219 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:27:17.383219 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:27:17.383219 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:27:17.384852 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:27:17.384852 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:27:17.384852 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:27:17.384852 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:27:17.384852 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 22:27:17.384852 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 22:27:17.384852 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 22:27:17.384852 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 22:27:17.384852 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 22:27:17.384852 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 22:27:17.384852 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 22:27:17.384852 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:27:17.384852 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 545/1075] 10.222.0.36 () {56 vars in 1096 bytes} [Fri Jun 24 22:27:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:27:17.392023 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eb4095-2fad-45b5-adca-c75ab35363af None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:17.396372 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:17.454057 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533bc9f9-dcfb-46a8-8467-dc3d54139238 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:17.454350 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533bc9f9-dcfb-46a8-8467-dc3d54139238 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:17.454661 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533bc9f9-dcfb-46a8-8467-dc3d54139238 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:17.456939 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 546/1076] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:27:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 22:27:17.461418 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385bfb92-e19f-4320-b28d-63e31259b08b None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:17.461711 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385bfb92-e19f-4320-b28d-63e31259b08b None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:17.461999 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385bfb92-e19f-4320-b28d-63e31259b08b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:17.481122 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-385bfb92-e19f-4320-b28d-63e31259b08b None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:27:17.482323 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-385bfb92-e19f-4320-b28d-63e31259b08b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:27:17.509980 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eb4095-2fad-45b5-adca-c75ab35363af None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:17.549714 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d55bd8-f6bf-4bbc-a29a-f6d635751bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:17.550287 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d55bd8-f6bf-4bbc-a29a-f6d635751bf2 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:17.550574 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d55bd8-f6bf-4bbc-a29a-f6d635751bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:17.550863 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d55bd8-f6bf-4bbc-a29a-f6d635751bf2 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:17.551636 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d55bd8-f6bf-4bbc-a29a-f6d635751bf2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:27:17.551949 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d55bd8-f6bf-4bbc-a29a-f6d635751bf2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:17.553357 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d55bd8-f6bf-4bbc-a29a-f6d635751bf2 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:17.557317 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 547/1077] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:27:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 22:27:17.567487 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 531/1078] 10.222.0.36 () {56 vars in 1099 bytes} [Fri Jun 24 22:27:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:27:17.568760 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385bfb92-e19f-4320-b28d-63e31259b08b None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:17.571733 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:17.582546 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d55bd8-f6bf-4bbc-a29a-f6d635751bf2 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:17.648851 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:17.674040 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385bfb92-e19f-4320-b28d-63e31259b08b None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:17.684114 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d55bd8-f6bf-4bbc-a29a-f6d635751bf2 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:17.708134 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f40bdc-5f40-42d2-a7f9-7a7365536ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:17.709049 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f40bdc-5f40-42d2-a7f9-7a7365536ce8 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:17.709328 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f40bdc-5f40-42d2-a7f9-7a7365536ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:17.709575 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f40bdc-5f40-42d2-a7f9-7a7365536ce8 None admin] PATH_INFO: `/v3/users/32c785c4ae1f4d41bbebdc119c605faf` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:17.710877 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f40bdc-5f40-42d2-a7f9-7a7365536ce8 None admin] RBAC: Authorizing `identity:get_user(user_id=32c785c4ae1f4d41bbebdc119c605faf)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:17.712368 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f40bdc-5f40-42d2-a7f9-7a7365536ce8 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:17.714010 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 548/1079] 10.222.0.36 () {56 vars in 1177 bytes} [Fri Jun 24 22:27:17 2022] GET /identity/v3/users/32c785c4ae1f4d41bbebdc119c605faf => generated 285 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 22:27:17.715165 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5c2b15-13ab-4ef9-9d5e-de778df4e5e5 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:17.715474 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5c2b15-13ab-4ef9-9d5e-de778df4e5e5 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:17.715749 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5c2b15-13ab-4ef9-9d5e-de778df4e5e5 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:17.716955 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 549/1080] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:27:17 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:27:17.721635 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5c2b15-13ab-4ef9-9d5e-de778df4e5e5 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:17.721842 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92749720-f937-41c3-bc88-7694b562707a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:17.722670 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92749720-f937-41c3-bc88-7694b562707a None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:17.722949 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92749720-f937-41c3-bc88-7694b562707a None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:17.723221 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92749720-f937-41c3-bc88-7694b562707a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:17.734172 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92749720-f937-41c3-bc88-7694b562707a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 22:27:17.742300 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-92749720-f937-41c3-bc88-7694b562707a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 22:27:17.742300 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:27:17.742300 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:27:17.742300 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:27:17.742300 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:27:17.742300 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:27:17.742300 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:27:17.742300 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:27:17.742300 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:27:17.742300 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:27:17.742300 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:27:17.742300 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:27:17.742300 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 22:27:17.742300 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 22:27:17.742300 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 22:27:17.742300 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 22:27:17.743221 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 22:27:17.743221 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 22:27:17.743221 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 22:27:17.743221 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 22:27:17.743221 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:27:17.743221 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:27:17.743221 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:27:17.743221 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:27:17.743221 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:27:17.743221 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:27:17.743221 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:27:17.743221 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:27:17.743221 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:27:17.743221 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:27:17.743221 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:27:17.743221 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:27:17.744197 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:27:17.744197 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:27:17.744197 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:27:17.744197 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:27:17.744197 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 22:27:17.744197 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 22:27:17.744197 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 22:27:17.744197 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 22:27:17.744197 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 22:27:17.744197 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 22:27:17.744197 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 22:27:17.744197 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:27:17.744197 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 532/1081] 10.222.0.36 () {56 vars in 1120 bytes} [Fri Jun 24 22:27:17 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 22:27:17.744892 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c1059-de5a-404d-bc49-95e9024ca869 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:17.745446 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c1059-de5a-404d-bc49-95e9024ca869 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:17.745446 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c1059-de5a-404d-bc49-95e9024ca869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:17.762380 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-ad3c1059-de5a-404d-bc49-95e9024ca869 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:27:17.763607 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-ad3c1059-de5a-404d-bc49-95e9024ca869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:27:17.795090 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:17.827561 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5c2b15-13ab-4ef9-9d5e-de778df4e5e5 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:17.833766 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 533/1082] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:27:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 22:27:17.834610 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3c1059-de5a-404d-bc49-95e9024ca869 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:17.878147 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432e46a9-61b1-4fc1-a405-cf238e25ba3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:17.879014 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e46a9-61b1-4fc1-a405-cf238e25ba3b None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:17.879285 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e46a9-61b1-4fc1-a405-cf238e25ba3b None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:17.879592 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e46a9-61b1-4fc1-a405-cf238e25ba3b None admin] PATH_INFO: `/v3/projects/d3e9e7f6798d4bbf8e708208061c1154` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:17.881088 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432e46a9-61b1-4fc1-a405-cf238e25ba3b None admin] RBAC: Authorizing `identity:get_project(project_id=d3e9e7f6798d4bbf8e708208061c1154)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:17.882837 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432e46a9-61b1-4fc1-a405-cf238e25ba3b None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:17.884576 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 550/1083] 10.222.0.36 () {56 vars in 1186 bytes} [Fri Jun 24 22:27:17 2022] GET /identity/v3/projects/d3e9e7f6798d4bbf8e708208061c1154 => generated 311 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:27:17.885313 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432e46a9-61b1-4fc1-a405-cf238e25ba3b None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:17.893893 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:17.938307 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3c1059-de5a-404d-bc49-95e9024ca869 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:17.974593 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2f96ed-b1f3-41c8-9fd9-cacc521bd3f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:17.975284 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2f96ed-b1f3-41c8-9fd9-cacc521bd3f1 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:17.975725 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2f96ed-b1f3-41c8-9fd9-cacc521bd3f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:17.976071 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2f96ed-b1f3-41c8-9fd9-cacc521bd3f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:17.976936 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2f96ed-b1f3-41c8-9fd9-cacc521bd3f1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:27:17.977246 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2f96ed-b1f3-41c8-9fd9-cacc521bd3f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:17.978643 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2f96ed-b1f3-41c8-9fd9-cacc521bd3f1 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:17.986188 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432e46a9-61b1-4fc1-a405-cf238e25ba3b None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:17.986640 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 534/1084] 10.222.0.36 () {56 vars in 1115 bytes} [Fri Jun 24 22:27:17 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:27:17.987428 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2f96ed-b1f3-41c8-9fd9-cacc521bd3f1 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:18.022013 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11770d2f-91bf-4b48-b580-a925b8cff628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:18.022639 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11770d2f-91bf-4b48-b580-a925b8cff628 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:18.022928 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11770d2f-91bf-4b48-b580-a925b8cff628 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:18.023197 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11770d2f-91bf-4b48-b580-a925b8cff628 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:18.031804 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:18.090226 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11770d2f-91bf-4b48-b580-a925b8cff628 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:18.091736 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11770d2f-91bf-4b48-b580-a925b8cff628 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:18.091840 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2f96ed-b1f3-41c8-9fd9-cacc521bd3f1 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:18.108191 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:18.125186 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eb0929-83c2-4883-9504-95593c62c1b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:18.126100 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eb0929-83c2-4883-9504-95593c62c1b0 None admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:18.126378 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eb0929-83c2-4883-9504-95593c62c1b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:18.126652 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eb0929-83c2-4883-9504-95593c62c1b0 None admin] PATH_INFO: `/v3/projects/d3e9e7f6798d4bbf8e708208061c1154/users/32c785c4ae1f4d41bbebdc119c605faf/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:18.128706 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eb0929-83c2-4883-9504-95593c62c1b0 None admin] RBAC: Authorizing `identity:create_grant(project_id=d3e9e7f6798d4bbf8e708208061c1154, user_id=32c785c4ae1f4d41bbebdc119c605faf, role_id=1a1c43cc97a0407eb7a7c7a1333a9d4a)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:18.130490 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eb0929-83c2-4883-9504-95593c62c1b0 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:18.144924 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 535/1085] 10.222.0.36 () {58 vars in 1439 bytes} [Fri Jun 24 22:27:17 2022] PUT /identity/v3/projects/d3e9e7f6798d4bbf8e708208061c1154/users/32c785c4ae1f4d41bbebdc119c605faf/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:27:18.145717 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eb0929-83c2-4883-9504-95593c62c1b0 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:18.204609 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 551/1086] 10.222.0.36 () {58 vars in 1282 bytes} [Fri Jun 24 22:27:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 22:27:18.210431 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11770d2f-91bf-4b48-b580-a925b8cff628 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:18.255774 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:18.272057 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eb0929-83c2-4883-9504-95593c62c1b0 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:18.320315 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d1336a-412e-4c91-bdd3-3f0c75ea7017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:18.321416 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d1336a-412e-4c91-bdd3-3f0c75ea7017 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:18.321703 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d1336a-412e-4c91-bdd3-3f0c75ea7017 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:18.321978 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d1336a-412e-4c91-bdd3-3f0c75ea7017 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:18.325883 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11770d2f-91bf-4b48-b580-a925b8cff628 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:18.333462 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d1336a-412e-4c91-bdd3-3f0c75ea7017 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:18.334969 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d1336a-412e-4c91-bdd3-3f0c75ea7017 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:18.352408 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-f6d1336a-412e-4c91-bdd3-3f0c75ea7017 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:27:18.352408 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:27:18.352408 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:27:18.352408 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:27:18.352408 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:27:18.352408 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:27:18.352408 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:27:18.352408 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:27:18.352408 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:27:18.352408 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:27:18.352408 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:27:18.352408 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:27:18.352408 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 22:27:18.352408 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 22:27:18.352408 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 22:27:18.353334 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 22:27:18.353334 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:27:18.353334 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:27:18.353334 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:27:18.353334 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:27:18.353334 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:27:18.353334 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:27:18.353334 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:27:18.353334 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:27:18.353334 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:27:18.353334 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:27:18.353334 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:27:18.353334 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:27:18.353334 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:27:18.353334 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:27:18.353334 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:27:18.353334 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:27:18.354191 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 22:27:18.354191 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 22:27:18.354191 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:27:18.354191 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:27:18.354191 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 536/1087] 10.222.0.36 () {56 vars in 1108 bytes} [Fri Jun 24 22:27:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:27:18.359638 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d1336a-412e-4c91-bdd3-3f0c75ea7017 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:18.364851 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e698d79-6438-41bb-b7ea-435d3d43a109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:18.365657 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e698d79-6438-41bb-b7ea-435d3d43a109 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:18.365938 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e698d79-6438-41bb-b7ea-435d3d43a109 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:18.366354 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e698d79-6438-41bb-b7ea-435d3d43a109 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:18.378354 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e698d79-6438-41bb-b7ea-435d3d43a109 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:18.379874 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e698d79-6438-41bb-b7ea-435d3d43a109 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:18.391965 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:18.398042 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-4e698d79-6438-41bb-b7ea-435d3d43a109 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:27:18.398042 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:27:18.398042 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:27:18.398042 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:27:18.398042 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:27:18.398042 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:27:18.398042 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:27:18.398042 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:27:18.398042 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:27:18.398042 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:27:18.398042 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:27:18.398042 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:27:18.398042 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 22:27:18.398042 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 22:27:18.398042 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 22:27:18.398923 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 22:27:18.398923 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:27:18.398923 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:27:18.398923 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:27:18.398923 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:27:18.398923 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:27:18.398923 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:27:18.398923 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:27:18.398923 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:27:18.398923 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:27:18.398923 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:27:18.398923 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:27:18.398923 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:27:18.398923 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:27:18.398923 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:27:18.398923 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:27:18.398923 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:27:18.399867 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 22:27:18.399867 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 22:27:18.399867 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:27:18.399867 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:27:18.403617 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 552/1088] 10.222.0.36 () {56 vars in 1108 bytes} [Fri Jun 24 22:27:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 22:27:18.405416 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e698d79-6438-41bb-b7ea-435d3d43a109 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:18.471218 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d1336a-412e-4c91-bdd3-3f0c75ea7017 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:18.506488 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695a372b-fff2-4df1-abf5-32a78b80560f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:18.507210 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a372b-fff2-4df1-abf5-32a78b80560f None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:18.507520 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a372b-fff2-4df1-abf5-32a78b80560f None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:18.507795 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a372b-fff2-4df1-abf5-32a78b80560f None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:18.508408 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:18.508519 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695a372b-fff2-4df1-abf5-32a78b80560f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:27:18.508815 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695a372b-fff2-4df1-abf5-32a78b80560f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:18.510186 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695a372b-fff2-4df1-abf5-32a78b80560f None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:18.519967 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e698d79-6438-41bb-b7ea-435d3d43a109 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:18.522902 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 537/1089] 10.222.0.36 () {56 vars in 1109 bytes} [Fri Jun 24 22:27:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:27:18.527926 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695a372b-fff2-4df1-abf5-32a78b80560f None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:18.560065 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6e0bba-80bd-450e-b9ff-6785c98a564d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:18.560986 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6e0bba-80bd-450e-b9ff-6785c98a564d None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:18.561416 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6e0bba-80bd-450e-b9ff-6785c98a564d None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:18.561859 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6e0bba-80bd-450e-b9ff-6785c98a564d None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:18.562730 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6e0bba-80bd-450e-b9ff-6785c98a564d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:27:18.563036 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6e0bba-80bd-450e-b9ff-6785c98a564d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:18.564460 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6e0bba-80bd-450e-b9ff-6785c98a564d None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:18.587285 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 553/1090] 10.222.0.36 () {56 vars in 1109 bytes} [Fri Jun 24 22:27:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 22:27:18.636622 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:18.648406 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695a372b-fff2-4df1-abf5-32a78b80560f None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:18.688155 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b21da8-a41c-47ff-95b6-ad4239d653c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:18.688986 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b21da8-a41c-47ff-95b6-ad4239d653c2 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:18.689268 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b21da8-a41c-47ff-95b6-ad4239d653c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:18.689543 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b21da8-a41c-47ff-95b6-ad4239d653c2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:18.698055 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b21da8-a41c-47ff-95b6-ad4239d653c2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:18.699597 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b21da8-a41c-47ff-95b6-ad4239d653c2 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:18.715830 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-c5b21da8-a41c-47ff-95b6-ad4239d653c2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 24 22:27:18.715830 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:27:18.715830 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:27:18.715830 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:27:18.715830 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:27:18.715830 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:27:18.715830 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:27:18.715830 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:27:18.715830 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:27:18.715830 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:27:18.715830 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:27:18.715830 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:27:18.715830 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 22:27:18.715830 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 22:27:18.715830 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 22:27:18.715830 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 22:27:18.716889 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:27:18.716889 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:27:18.716889 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 22:27:18.716889 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 22:27:18.716889 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 22:27:18.716889 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 22:27:18.716889 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:27:18.716889 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:27:18.716889 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:27:18.716889 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:27:18.716889 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:27:18.716889 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:27:18.716889 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:27:18.716889 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:27:18.716889 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:27:18.716889 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:27:18.716889 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:27:18.716889 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:27:18.717948 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:27:18.717948 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:27:18.717948 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 22:27:18.717948 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 22:27:18.717948 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 22:27:18.717948 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 22:27:18.717948 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 22:27:18.717948 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 22:27:18.717948 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 24 22:27:18.717948 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:27:18.719625 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 538/1091] 10.222.0.36 () {56 vars in 1093 bytes} [Fri Jun 24 22:27:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 22:27:18.723275 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6e0bba-80bd-450e-b9ff-6785c98a564d None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:18.831090 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6e0bba-80bd-450e-b9ff-6785c98a564d None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:18.866073 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002cf0bd-f7be-4c3d-af7c-500313d8e613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:18.866799 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002cf0bd-f7be-4c3d-af7c-500313d8e613 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:18.867083 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002cf0bd-f7be-4c3d-af7c-500313d8e613 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:18.867481 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002cf0bd-f7be-4c3d-af7c-500313d8e613 None admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:18.868333 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002cf0bd-f7be-4c3d-af7c-500313d8e613 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:27:18.868694 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002cf0bd-f7be-4c3d-af7c-500313d8e613 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:18.870172 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002cf0bd-f7be-4c3d-af7c-500313d8e613 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:18.888983 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 554/1092] 10.222.0.36 () {56 vars in 1133 bytes} [Fri Jun 24 22:27:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:27:18.894882 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b21da8-a41c-47ff-95b6-ad4239d653c2 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:18.994526 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b21da8-a41c-47ff-95b6-ad4239d653c2 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:19.029554 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a1a306-04f5-4a51-9995-9ffc431bd8f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:19.030197 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a1a306-04f5-4a51-9995-9ffc431bd8f6 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:19.030479 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a1a306-04f5-4a51-9995-9ffc431bd8f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:19.030759 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a1a306-04f5-4a51-9995-9ffc431bd8f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:19.048651 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:19.100038 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a1a306-04f5-4a51-9995-9ffc431bd8f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:19.101591 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a1a306-04f5-4a51-9995-9ffc431bd8f6 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:19.203703 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 539/1093] 10.222.0.36 () {58 vars in 1282 bytes} [Fri Jun 24 22:27:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 22:27:19.209665 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002cf0bd-f7be-4c3d-af7c-500313d8e613 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:19.221757 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:19.313656 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002cf0bd-f7be-4c3d-af7c-500313d8e613 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:19.348401 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c603c50-2a17-4c76-a85f-3300f97ce080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:19.349202 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c603c50-2a17-4c76-a85f-3300f97ce080 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:19.349482 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c603c50-2a17-4c76-a85f-3300f97ce080 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:19.349753 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c603c50-2a17-4c76-a85f-3300f97ce080 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:19.359991 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c603c50-2a17-4c76-a85f-3300f97ce080 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:19.361445 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c603c50-2a17-4c76-a85f-3300f97ce080 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:19.378485 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-1c603c50-2a17-4c76-a85f-3300f97ce080 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:27:19.378485 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:27:19.378485 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:27:19.378485 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:27:19.378485 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:27:19.378485 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:27:19.378485 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:27:19.378485 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:27:19.378485 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:27:19.378485 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:27:19.378485 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:27:19.378485 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:27:19.378485 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 22:27:19.378485 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 22:27:19.378485 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 22:27:19.379412 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 22:27:19.379412 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:27:19.379412 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:27:19.379412 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:27:19.379412 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:27:19.379412 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:27:19.379412 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:27:19.379412 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:27:19.379412 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:27:19.379412 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:27:19.379412 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:27:19.379412 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:27:19.379412 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:27:19.379412 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:27:19.379412 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:27:19.379412 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:27:19.379412 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:27:19.380644 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 22:27:19.380644 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 22:27:19.380644 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:27:19.380644 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:27:19.380644 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 555/1094] 10.222.0.36 () {56 vars in 1108 bytes} [Fri Jun 24 22:27:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:27:19.386201 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a1a306-04f5-4a51-9995-9ffc431bd8f6 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:19.440620 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:19.492600 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a1a306-04f5-4a51-9995-9ffc431bd8f6 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:19.528725 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554daa03-55c3-4ebc-9834-7de11c77ca8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:19.529394 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554daa03-55c3-4ebc-9834-7de11c77ca8e None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:19.529675 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554daa03-55c3-4ebc-9834-7de11c77ca8e None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:19.529949 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554daa03-55c3-4ebc-9834-7de11c77ca8e None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:19.530679 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554daa03-55c3-4ebc-9834-7de11c77ca8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:27:19.530985 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554daa03-55c3-4ebc-9834-7de11c77ca8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:19.532417 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554daa03-55c3-4ebc-9834-7de11c77ca8e None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:19.544209 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 540/1095] 10.222.0.36 () {56 vars in 1109 bytes} [Fri Jun 24 22:27:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:27:19.549953 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c603c50-2a17-4c76-a85f-3300f97ce080 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:19.615371 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:19.658753 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c603c50-2a17-4c76-a85f-3300f97ce080 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:19.693845 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad797926-345b-4f59-9cca-c45f4e820ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:19.694693 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad797926-345b-4f59-9cca-c45f4e820ad9 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:19.694974 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad797926-345b-4f59-9cca-c45f4e820ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:19.695267 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad797926-345b-4f59-9cca-c45f4e820ad9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:19.702106 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad797926-345b-4f59-9cca-c45f4e820ad9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:19.703597 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad797926-345b-4f59-9cca-c45f4e820ad9 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:19.717338 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-ad797926-345b-4f59-9cca-c45f4e820ad9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 22:27:19.717338 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:27:19.717338 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:27:19.717338 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:27:19.717338 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:27:19.717338 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:27:19.717338 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:27:19.717338 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:27:19.717338 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:27:19.717338 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:27:19.717338 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:27:19.717338 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:27:19.717338 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 22:27:19.717338 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 22:27:19.717338 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 22:27:19.718240 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 22:27:19.718240 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:27:19.718240 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:27:19.718240 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:27:19.718240 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:27:19.718240 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:27:19.718240 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:27:19.718240 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:27:19.718240 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:27:19.718240 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:27:19.718240 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:27:19.718240 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:27:19.718240 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:27:19.718240 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:27:19.718240 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:27:19.718240 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:27:19.718240 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:27:19.719321 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 22:27:19.719321 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 22:27:19.719321 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 22:27:19.719321 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 22:27:19.719321 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 22:27:19.719321 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 22:27:19.719321 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 22:27:19.719321 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:27:19.719321 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 556/1096] 10.222.0.36 () {56 vars in 1111 bytes} [Fri Jun 24 22:27:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:27:19.724557 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554daa03-55c3-4ebc-9834-7de11c77ca8e None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:19.828644 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554daa03-55c3-4ebc-9834-7de11c77ca8e None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:19.839060 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:19.864504 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3136638d-b581-4642-812d-6456d5b72c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:19.865164 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3136638d-b581-4642-812d-6456d5b72c1b None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:19.865504 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3136638d-b581-4642-812d-6456d5b72c1b None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:19.865721 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3136638d-b581-4642-812d-6456d5b72c1b None admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:19.866575 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3136638d-b581-4642-812d-6456d5b72c1b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:27:19.866910 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3136638d-b581-4642-812d-6456d5b72c1b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:19.868355 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3136638d-b581-4642-812d-6456d5b72c1b None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:19.880994 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 541/1097] 10.222.0.36 () {56 vars in 1148 bytes} [Fri Jun 24 22:27:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:27:19.887330 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad797926-345b-4f59-9cca-c45f4e820ad9 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:19.994656 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad797926-345b-4f59-9cca-c45f4e820ad9 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:20.015462 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:20.030868 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4796650e-9f92-4fc7-84d3-b578a0a1ea1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:20.031559 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4796650e-9f92-4fc7-84d3-b578a0a1ea1f None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:20.031847 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4796650e-9f92-4fc7-84d3-b578a0a1ea1f None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:20.032114 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4796650e-9f92-4fc7-84d3-b578a0a1ea1f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:20.032937 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4796650e-9f92-4fc7-84d3-b578a0a1ea1f None admin] RBAC: Adding query filter params (role.id=89095043d87040e39cf7bd2875c789f2, scope.project.id=d189b31bbec0469381292d2cde3cb420, user.id=214d9071042c4bad886bf060a079b6e2) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:27:20.033246 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4796650e-9f92-4fc7-84d3-b578a0a1ea1f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:20.034694 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4796650e-9f92-4fc7-84d3-b578a0a1ea1f None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:20.040747 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 557/1098] 10.222.0.36 () {56 vars in 1374 bytes} [Fri Jun 24 22:27:19 2022] GET /identity/v3/role_assignments?user.id=214d9071042c4bad886bf060a079b6e2&scope.project.id=d189b31bbec0469381292d2cde3cb420&role.id=89095043d87040e39cf7bd2875c789f2 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:27:20.231150 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a202cecb-44d9-4f39-be37-d25537ac2125 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:20.231803 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a202cecb-44d9-4f39-be37-d25537ac2125 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:20.232091 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a202cecb-44d9-4f39-be37-d25537ac2125 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:20.233875 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 542/1099] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:27:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:27:20.239612 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7bcd94-186a-439d-8b16-00181b725429 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:20.240087 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7bcd94-186a-439d-8b16-00181b725429 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:20.240184 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7bcd94-186a-439d-8b16-00181b725429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:20.258941 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-db7bcd94-186a-439d-8b16-00181b725429 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:27:20.260174 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-db7bcd94-186a-439d-8b16-00181b725429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:27:20.328583 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 558/1100] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:27:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 22:27:20.353442 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a202cecb-44d9-4f39-be37-d25537ac2125 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:20.459137 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a202cecb-44d9-4f39-be37-d25537ac2125 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:20.501345 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1a989f-a384-40f5-baa1-c76f9c0c1d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:20.502103 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a989f-a384-40f5-baa1-c76f9c0c1d55 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:20.502380 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a989f-a384-40f5-baa1-c76f9c0c1d55 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:20.502648 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a989f-a384-40f5-baa1-c76f9c0c1d55 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:20.516236 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1a989f-a384-40f5-baa1-c76f9c0c1d55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 22:27:20.524113 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-7d1a989f-a384-40f5-baa1-c76f9c0c1d55 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 22:27:20.524113 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:27:20.524113 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:27:20.524113 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:27:20.524113 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:27:20.524113 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:27:20.524113 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:27:20.524113 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:27:20.524113 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:27:20.524113 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:27:20.524113 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:27:20.524113 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:27:20.524113 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 22:27:20.524113 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 22:27:20.524113 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 22:27:20.524113 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 22:27:20.525039 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 22:27:20.525039 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 22:27:20.525039 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 22:27:20.525039 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 22:27:20.525039 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:27:20.525039 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:27:20.525039 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:27:20.525039 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:27:20.525039 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:27:20.525039 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:27:20.525039 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:27:20.525039 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:27:20.525039 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:27:20.525039 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:27:20.525039 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:27:20.525039 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:27:20.526053 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:27:20.526053 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:27:20.526053 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:27:20.526053 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:27:20.526053 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 22:27:20.526053 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 22:27:20.526053 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 22:27:20.526053 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 22:27:20.526053 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 22:27:20.526053 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 22:27:20.526053 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 22:27:20.526053 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:27:20.526053 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 543/1101] 10.222.0.36 () {56 vars in 1096 bytes} [Fri Jun 24 22:27:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:27:20.532165 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7bcd94-186a-439d-8b16-00181b725429 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:20.631297 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7bcd94-186a-439d-8b16-00181b725429 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:20.645389 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:20.665329 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0909031-438b-4a7c-8f9d-c0adbb376fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:20.666001 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0909031-438b-4a7c-8f9d-c0adbb376fee None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:20.666276 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0909031-438b-4a7c-8f9d-c0adbb376fee None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:20.666555 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0909031-438b-4a7c-8f9d-c0adbb376fee None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:20.667277 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0909031-438b-4a7c-8f9d-c0adbb376fee None admin] RBAC: Adding query filter params (name=admin) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:27:20.667596 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0909031-438b-4a7c-8f9d-c0adbb376fee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:20.669007 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0909031-438b-4a7c-8f9d-c0adbb376fee None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:20.677794 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 559/1102] 10.222.0.36 () {56 vars in 1099 bytes} [Fri Jun 24 22:27:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:27:20.684034 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1a989f-a384-40f5-baa1-c76f9c0c1d55 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:20.716282 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:20.786971 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1a989f-a384-40f5-baa1-c76f9c0c1d55 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:20.821368 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a153a18-8bcb-4cca-9b50-1d129eb12481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:20.822286 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a153a18-8bcb-4cca-9b50-1d129eb12481 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:20.822570 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a153a18-8bcb-4cca-9b50-1d129eb12481 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:20.822847 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a153a18-8bcb-4cca-9b50-1d129eb12481 None admin] PATH_INFO: `/v3/users/32c785c4ae1f4d41bbebdc119c605faf` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:20.824126 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a153a18-8bcb-4cca-9b50-1d129eb12481 None admin] RBAC: Authorizing `identity:get_user(user_id=32c785c4ae1f4d41bbebdc119c605faf)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:20.825586 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a153a18-8bcb-4cca-9b50-1d129eb12481 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:20.831445 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 544/1103] 10.222.0.36 () {56 vars in 1177 bytes} [Fri Jun 24 22:27:20 2022] GET /identity/v3/users/32c785c4ae1f4d41bbebdc119c605faf => generated 285 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:27:20.833210 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0909031-438b-4a7c-8f9d-c0adbb376fee None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:20.935021 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0909031-438b-4a7c-8f9d-c0adbb376fee None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:20.968849 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e37a9e5-f720-47ef-b6b9-36c7f99a266f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:20.969499 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e37a9e5-f720-47ef-b6b9-36c7f99a266f None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:20.969784 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e37a9e5-f720-47ef-b6b9-36c7f99a266f None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:20.970061 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e37a9e5-f720-47ef-b6b9-36c7f99a266f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:21.015538 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:21.044480 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e37a9e5-f720-47ef-b6b9-36c7f99a266f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:21.045887 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e37a9e5-f720-47ef-b6b9-36c7f99a266f None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:21.162167 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 560/1104] 10.222.0.36 () {58 vars in 1282 bytes} [Fri Jun 24 22:27:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 22:27:21.169706 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a153a18-8bcb-4cca-9b50-1d129eb12481 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:21.292458 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:21.296373 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a153a18-8bcb-4cca-9b50-1d129eb12481 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:21.330423 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ab41a8-b970-44a3-8914-95232d895e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:21.331297 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ab41a8-b970-44a3-8914-95232d895e4b None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:21.331567 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ab41a8-b970-44a3-8914-95232d895e4b None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:21.331845 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ab41a8-b970-44a3-8914-95232d895e4b None admin] PATH_INFO: `/v3/projects/d3e9e7f6798d4bbf8e708208061c1154` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:21.333071 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ab41a8-b970-44a3-8914-95232d895e4b None admin] RBAC: Authorizing `identity:get_project(project_id=d3e9e7f6798d4bbf8e708208061c1154)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:21.334508 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ab41a8-b970-44a3-8914-95232d895e4b None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:21.336368 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 545/1105] 10.222.0.36 () {56 vars in 1186 bytes} [Fri Jun 24 22:27:21 2022] GET /identity/v3/projects/d3e9e7f6798d4bbf8e708208061c1154 => generated 311 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:27:21.342617 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e37a9e5-f720-47ef-b6b9-36c7f99a266f None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:21.422438 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:21.450021 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e37a9e5-f720-47ef-b6b9-36c7f99a266f None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:21.485402 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c91025-efc3-47e8-b4ea-7cc2bc05b1a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:21.486050 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c91025-efc3-47e8-b4ea-7cc2bc05b1a0 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:21.486336 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c91025-efc3-47e8-b4ea-7cc2bc05b1a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:21.486615 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c91025-efc3-47e8-b4ea-7cc2bc05b1a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:21.487480 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c91025-efc3-47e8-b4ea-7cc2bc05b1a0 None admin] RBAC: Adding query filter params (role.id=1a1c43cc97a0407eb7a7c7a1333a9d4a, scope.project.id=d3e9e7f6798d4bbf8e708208061c1154, user.id=32c785c4ae1f4d41bbebdc119c605faf) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:27:21.487794 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c91025-efc3-47e8-b4ea-7cc2bc05b1a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:21.489260 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c91025-efc3-47e8-b4ea-7cc2bc05b1a0 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:21.495699 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 561/1106] 10.222.0.36 () {56 vars in 1374 bytes} [Fri Jun 24 22:27:21 2022] GET /identity/v3/role_assignments?user.id=32c785c4ae1f4d41bbebdc119c605faf&scope.project.id=d3e9e7f6798d4bbf8e708208061c1154&role.id=1a1c43cc97a0407eb7a7c7a1333a9d4a => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:27:23.544309 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c446e8-8157-4ee1-9133-dd71a1146dd5 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:23.545153 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c446e8-8157-4ee1-9133-dd71a1146dd5 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:23.545153 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c446e8-8157-4ee1-9133-dd71a1146dd5 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:23.547465 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 546/1107] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:27:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:27:23.553843 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab87a8b-a379-42eb-8224-ea5fa579d85e None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:23.554553 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab87a8b-a379-42eb-8224-ea5fa579d85e None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:23.554725 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab87a8b-a379-42eb-8224-ea5fa579d85e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:23.577684 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-2ab87a8b-a379-42eb-8224-ea5fa579d85e None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:27:23.578873 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-2ab87a8b-a379-42eb-8224-ea5fa579d85e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:27:23.650169 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 562/1108] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:27:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 22:27:23.686733 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c446e8-8157-4ee1-9133-dd71a1146dd5 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:23.794312 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c446e8-8157-4ee1-9133-dd71a1146dd5 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:23.829358 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5febc1f7-91eb-431c-aca5-6e3dd458d9f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:23.830140 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5febc1f7-91eb-431c-aca5-6e3dd458d9f0 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:23.830426 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5febc1f7-91eb-431c-aca5-6e3dd458d9f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:23.830707 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5febc1f7-91eb-431c-aca5-6e3dd458d9f0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:23.832039 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5febc1f7-91eb-431c-aca5-6e3dd458d9f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:23.833495 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5febc1f7-91eb-431c-aca5-6e3dd458d9f0 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:23.835286 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 547/1109] 10.222.0.36 () {56 vars in 1108 bytes} [Fri Jun 24 22:27:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:27:23.841886 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab87a8b-a379-42eb-8224-ea5fa579d85e None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:23.923268 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:23.957042 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab87a8b-a379-42eb-8224-ea5fa579d85e None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:23.991539 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c337bf-3043-41c9-af33-fdf3c65d1f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:23.992201 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c337bf-3043-41c9-af33-fdf3c65d1f41 None admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:23.992482 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c337bf-3043-41c9-af33-fdf3c65d1f41 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:23.992759 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c337bf-3043-41c9-af33-fdf3c65d1f41 None admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:23.993461 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c337bf-3043-41c9-af33-fdf3c65d1f41 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:23.994913 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c337bf-3043-41c9-af33-fdf3c65d1f41 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:24.016689 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 563/1110] 10.222.0.36 () {60 vars in 1132 bytes} [Fri Jun 24 22:27:23 2022] POST /identity/v3/users => generated 286 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:27:26.070910 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c93df1-c727-41fa-aaf0-70f135f33712 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:26.071921 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c93df1-c727-41fa-aaf0-70f135f33712 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:26.071921 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c93df1-c727-41fa-aaf0-70f135f33712 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:26.074062 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 548/1111] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:27:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:27:26.080432 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eea1ea-3b70-42a7-8914-92a8b001dd66 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:26.081204 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eea1ea-3b70-42a7-8914-92a8b001dd66 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:26.081308 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eea1ea-3b70-42a7-8914-92a8b001dd66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:26.100549 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-d3eea1ea-3b70-42a7-8914-92a8b001dd66 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:27:26.101733 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-d3eea1ea-3b70-42a7-8914-92a8b001dd66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:27:26.176367 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 564/1112] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:27:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 22:27:26.201920 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c93df1-c727-41fa-aaf0-70f135f33712 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:26.239479 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:26.309920 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c93df1-c727-41fa-aaf0-70f135f33712 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:26.347865 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d771b6-c480-4412-8c8e-1ff9764b155d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:26.348637 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d771b6-c480-4412-8c8e-1ff9764b155d None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:26.348908 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d771b6-c480-4412-8c8e-1ff9764b155d None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:26.349178 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d771b6-c480-4412-8c8e-1ff9764b155d None admin] PATH_INFO: `/v3/roles/bf32f251a7764c7188fd782b65275038` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:26.350954 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d771b6-c480-4412-8c8e-1ff9764b155d None admin] RBAC: Authorizing `identity:get_role(role_id=bf32f251a7764c7188fd782b65275038)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:26.352387 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d771b6-c480-4412-8c8e-1ff9764b155d None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:26.353835 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 549/1113] 10.222.0.36 () {56 vars in 1177 bytes} [Fri Jun 24 22:27:26 2022] GET /identity/v3/roles/bf32f251a7764c7188fd782b65275038 => generated 223 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:27:26.362587 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eea1ea-3b70-42a7-8914-92a8b001dd66 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:26.418821 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:26.464468 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eea1ea-3b70-42a7-8914-92a8b001dd66 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:26.501424 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b068fa-5be2-430b-931d-a1669e6ac938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:26.502724 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b068fa-5be2-430b-931d-a1669e6ac938 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:26.503085 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b068fa-5be2-430b-931d-a1669e6ac938 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:26.503518 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b068fa-5be2-430b-931d-a1669e6ac938 None admin] PATH_INFO: `/v3/users/60fc2d7fb3bd4a54ac4bc8abb972c713` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:26.520832 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b068fa-5be2-430b-931d-a1669e6ac938 None admin] RBAC: Authorizing `identity:get_user(user_id=60fc2d7fb3bd4a54ac4bc8abb972c713)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:26.522331 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b068fa-5be2-430b-931d-a1669e6ac938 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:26.524194 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 565/1114] 10.222.0.36 () {56 vars in 1177 bytes} [Fri Jun 24 22:27:26 2022] GET /identity/v3/users/60fc2d7fb3bd4a54ac4bc8abb972c713 => generated 286 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 22:27:26.530360 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d771b6-c480-4412-8c8e-1ff9764b155d None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:26.633902 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d771b6-c480-4412-8c8e-1ff9764b155d None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:26.635856 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:26.674669 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7317ebc8-b1c4-4fb8-a44d-441cbba730ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:26.675643 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7317ebc8-b1c4-4fb8-a44d-441cbba730ee None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:26.676009 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7317ebc8-b1c4-4fb8-a44d-441cbba730ee None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:26.676382 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7317ebc8-b1c4-4fb8-a44d-441cbba730ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:26.746084 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7317ebc8-b1c4-4fb8-a44d-441cbba730ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:26.747593 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7317ebc8-b1c4-4fb8-a44d-441cbba730ee None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:26.847998 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 550/1115] 10.222.0.36 () {58 vars in 1282 bytes} [Fri Jun 24 22:27:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 22:27:26.856919 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b068fa-5be2-430b-931d-a1669e6ac938 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:26.973830 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b068fa-5be2-430b-931d-a1669e6ac938 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:26.987928 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:27.014411 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749ce4fb-0c12-463a-b87d-739c807e7a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:27.015293 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749ce4fb-0c12-463a-b87d-739c807e7a24 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:27.015574 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749ce4fb-0c12-463a-b87d-739c807e7a24 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:27.015845 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749ce4fb-0c12-463a-b87d-739c807e7a24 None admin] PATH_INFO: `/v3/projects/d3e9e7f6798d4bbf8e708208061c1154` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:27.017126 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749ce4fb-0c12-463a-b87d-739c807e7a24 None admin] RBAC: Authorizing `identity:get_project(project_id=d3e9e7f6798d4bbf8e708208061c1154)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:27.018564 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749ce4fb-0c12-463a-b87d-739c807e7a24 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:27.020292 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 566/1116] 10.222.0.36 () {56 vars in 1186 bytes} [Fri Jun 24 22:27:26 2022] GET /identity/v3/projects/d3e9e7f6798d4bbf8e708208061c1154 => generated 311 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:27:27.026594 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7317ebc8-b1c4-4fb8-a44d-441cbba730ee None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:27.028916 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:27.132132 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7317ebc8-b1c4-4fb8-a44d-441cbba730ee None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:27.172533 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92592181-740d-4792-997e-898ea4a67b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:27.173338 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92592181-740d-4792-997e-898ea4a67b70 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:27.173707 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92592181-740d-4792-997e-898ea4a67b70 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:27.174066 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92592181-740d-4792-997e-898ea4a67b70 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:27.175329 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92592181-740d-4792-997e-898ea4a67b70 None admin] RBAC: Adding query filter params (role.id=bf32f251a7764c7188fd782b65275038, scope.project.id=d3e9e7f6798d4bbf8e708208061c1154, user.id=60fc2d7fb3bd4a54ac4bc8abb972c713) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:27:27.175764 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92592181-740d-4792-997e-898ea4a67b70 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:27.178006 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92592181-740d-4792-997e-898ea4a67b70 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:27.187408 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 551/1117] 10.222.0.36 () {56 vars in 1374 bytes} [Fri Jun 24 22:27:27 2022] GET /identity/v3/role_assignments?user.id=60fc2d7fb3bd4a54ac4bc8abb972c713&scope.project.id=d3e9e7f6798d4bbf8e708208061c1154&role.id=bf32f251a7764c7188fd782b65275038 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 22:27:29.165342 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046463f1-e17d-4f29-ab39-282233775ac3 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:29.165873 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046463f1-e17d-4f29-ab39-282233775ac3 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:29.165873 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046463f1-e17d-4f29-ab39-282233775ac3 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:29.168070 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 567/1118] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:27:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:27:29.176884 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095f1fc4-d530-4a90-9c65-7862dde79473 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:29.177302 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095f1fc4-d530-4a90-9c65-7862dde79473 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:29.177473 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095f1fc4-d530-4a90-9c65-7862dde79473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:29.196209 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-095f1fc4-d530-4a90-9c65-7862dde79473 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:27:29.197431 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-095f1fc4-d530-4a90-9c65-7862dde79473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:27:29.265103 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:29.273657 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 552/1119] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:27:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 22:27:29.301817 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046463f1-e17d-4f29-ab39-282233775ac3 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:29.416988 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046463f1-e17d-4f29-ab39-282233775ac3 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:29.454274 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41e34fb-480b-4f0c-820d-ba264df17fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:29.455624 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41e34fb-480b-4f0c-820d-ba264df17fc5 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:29.455987 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41e34fb-480b-4f0c-820d-ba264df17fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:29.456324 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41e34fb-480b-4f0c-820d-ba264df17fc5 None admin] PATH_INFO: `/v3/roles/bf32f251a7764c7188fd782b65275038` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:29.458839 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41e34fb-480b-4f0c-820d-ba264df17fc5 None admin] RBAC: Authorizing `identity:get_role(role_id=bf32f251a7764c7188fd782b65275038)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:29.461194 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41e34fb-480b-4f0c-820d-ba264df17fc5 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:29.463244 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 568/1120] 10.222.0.36 () {56 vars in 1177 bytes} [Fri Jun 24 22:27:29 2022] GET /identity/v3/roles/bf32f251a7764c7188fd782b65275038 => generated 223 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:27:29.469557 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095f1fc4-d530-4a90-9c65-7862dde79473 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:29.577021 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095f1fc4-d530-4a90-9c65-7862dde79473 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:29.612447 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364f482e-3f2e-4835-8152-e4a3a133b225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:29.613303 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f482e-3f2e-4835-8152-e4a3a133b225 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:29.613588 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f482e-3f2e-4835-8152-e4a3a133b225 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:29.613853 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f482e-3f2e-4835-8152-e4a3a133b225 None admin] PATH_INFO: `/v3/users/60fc2d7fb3bd4a54ac4bc8abb972c713` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:29.615140 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364f482e-3f2e-4835-8152-e4a3a133b225 None admin] RBAC: Authorizing `identity:get_user(user_id=60fc2d7fb3bd4a54ac4bc8abb972c713)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:29.616648 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364f482e-3f2e-4835-8152-e4a3a133b225 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:29.618247 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 553/1121] 10.222.0.36 () {56 vars in 1177 bytes} [Fri Jun 24 22:27:29 2022] GET /identity/v3/users/60fc2d7fb3bd4a54ac4bc8abb972c713 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:27:29.626957 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41e34fb-480b-4f0c-820d-ba264df17fc5 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:29.682407 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:29.743143 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41e34fb-480b-4f0c-820d-ba264df17fc5 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:29.778836 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873235a7-afb3-4c5b-a3e2-3f34b88b871a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:29.779712 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873235a7-afb3-4c5b-a3e2-3f34b88b871a None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:29.779988 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873235a7-afb3-4c5b-a3e2-3f34b88b871a None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:29.780255 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873235a7-afb3-4c5b-a3e2-3f34b88b871a None admin] PATH_INFO: `/v3/projects/d3e9e7f6798d4bbf8e708208061c1154` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:29.781429 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873235a7-afb3-4c5b-a3e2-3f34b88b871a None admin] RBAC: Authorizing `identity:get_project(project_id=d3e9e7f6798d4bbf8e708208061c1154)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:29.782869 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873235a7-afb3-4c5b-a3e2-3f34b88b871a None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:29.784565 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 569/1122] 10.222.0.36 () {56 vars in 1186 bytes} [Fri Jun 24 22:27:29 2022] GET /identity/v3/projects/d3e9e7f6798d4bbf8e708208061c1154 => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:27:29.793565 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364f482e-3f2e-4835-8152-e4a3a133b225 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:29.858023 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:29.895923 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364f482e-3f2e-4835-8152-e4a3a133b225 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:29.930955 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4332a914-ebdf-4f9e-815b-7c806b7f81f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:29.931860 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4332a914-ebdf-4f9e-815b-7c806b7f81f2 None admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:29.932138 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4332a914-ebdf-4f9e-815b-7c806b7f81f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:29.932406 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4332a914-ebdf-4f9e-815b-7c806b7f81f2 None admin] PATH_INFO: `/v3/projects/d3e9e7f6798d4bbf8e708208061c1154/users/60fc2d7fb3bd4a54ac4bc8abb972c713/roles/bf32f251a7764c7188fd782b65275038` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:29.935022 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4332a914-ebdf-4f9e-815b-7c806b7f81f2 None admin] RBAC: Authorizing `identity:create_grant(project_id=d3e9e7f6798d4bbf8e708208061c1154, user_id=60fc2d7fb3bd4a54ac4bc8abb972c713, role_id=bf32f251a7764c7188fd782b65275038)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:29.936435 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4332a914-ebdf-4f9e-815b-7c806b7f81f2 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:29.956461 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 554/1123] 10.222.0.36 () {58 vars in 1439 bytes} [Fri Jun 24 22:27:29 2022] PUT /identity/v3/projects/d3e9e7f6798d4bbf8e708208061c1154/users/60fc2d7fb3bd4a54ac4bc8abb972c713/roles/bf32f251a7764c7188fd782b65275038 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 22:27:31.934182 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4f258b-aa79-4fe4-93ca-d255d90130db None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:31.934739 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4f258b-aa79-4fe4-93ca-d255d90130db None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:31.934739 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4f258b-aa79-4fe4-93ca-d255d90130db None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:31.936116 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 570/1124] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:27:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:27:31.942457 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cc74bd-6b5f-47ca-adca-7bd6305866be None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:31.943202 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cc74bd-6b5f-47ca-adca-7bd6305866be None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:31.943493 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cc74bd-6b5f-47ca-adca-7bd6305866be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:31.966644 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-e7cc74bd-6b5f-47ca-adca-7bd6305866be None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:27:31.967864 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-e7cc74bd-6b5f-47ca-adca-7bd6305866be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:27:32.041239 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 555/1125] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:27:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 22:27:32.064845 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4f258b-aa79-4fe4-93ca-d255d90130db None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:32.181130 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4f258b-aa79-4fe4-93ca-d255d90130db None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:32.198376 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:32.216913 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8483adec-f2ca-4066-80c1-02c6770655de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:32.217763 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8483adec-f2ca-4066-80c1-02c6770655de None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:32.218040 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8483adec-f2ca-4066-80c1-02c6770655de None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:32.218311 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8483adec-f2ca-4066-80c1-02c6770655de None admin] PATH_INFO: `/v3/roles/bf32f251a7764c7188fd782b65275038` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:32.219851 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8483adec-f2ca-4066-80c1-02c6770655de None admin] RBAC: Authorizing `identity:get_role(role_id=bf32f251a7764c7188fd782b65275038)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:32.221241 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8483adec-f2ca-4066-80c1-02c6770655de None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:32.222597 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 571/1126] 10.222.0.36 () {56 vars in 1177 bytes} [Fri Jun 24 22:27:32 2022] GET /identity/v3/roles/bf32f251a7764c7188fd782b65275038 => generated 223 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:27:32.228611 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cc74bd-6b5f-47ca-adca-7bd6305866be None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:32.283903 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:32.332790 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cc74bd-6b5f-47ca-adca-7bd6305866be None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:32.367867 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c381dc33-3f93-4083-92ef-533d42ee9b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:32.368717 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c381dc33-3f93-4083-92ef-533d42ee9b22 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:32.368993 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c381dc33-3f93-4083-92ef-533d42ee9b22 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:32.369263 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c381dc33-3f93-4083-92ef-533d42ee9b22 None admin] PATH_INFO: `/v3/users/60fc2d7fb3bd4a54ac4bc8abb972c713` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:32.370544 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c381dc33-3f93-4083-92ef-533d42ee9b22 None admin] RBAC: Authorizing `identity:get_user(user_id=60fc2d7fb3bd4a54ac4bc8abb972c713)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:32.372025 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c381dc33-3f93-4083-92ef-533d42ee9b22 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:32.373657 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 556/1127] 10.222.0.36 () {56 vars in 1177 bytes} [Fri Jun 24 22:27:32 2022] GET /identity/v3/users/60fc2d7fb3bd4a54ac4bc8abb972c713 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:27:32.380801 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8483adec-f2ca-4066-80c1-02c6770655de None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:32.492913 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8483adec-f2ca-4066-80c1-02c6770655de None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:32.529184 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7746350-e008-48f3-9820-e98d7215b147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:32.529824 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7746350-e008-48f3-9820-e98d7215b147 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:32.530105 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7746350-e008-48f3-9820-e98d7215b147 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:32.530377 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7746350-e008-48f3-9820-e98d7215b147 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:32.594576 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:32.609197 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7746350-e008-48f3-9820-e98d7215b147 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:32.610664 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7746350-e008-48f3-9820-e98d7215b147 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:32.713106 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 572/1128] 10.222.0.36 () {58 vars in 1282 bytes} [Fri Jun 24 22:27:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 22:27:32.720314 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c381dc33-3f93-4083-92ef-533d42ee9b22 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:32.829424 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c381dc33-3f93-4083-92ef-533d42ee9b22 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:32.852187 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:32.865567 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d51c4f7-9aea-4d36-b942-c7bbc5685a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:32.866497 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d51c4f7-9aea-4d36-b942-c7bbc5685a57 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:32.866783 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d51c4f7-9aea-4d36-b942-c7bbc5685a57 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:32.867093 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d51c4f7-9aea-4d36-b942-c7bbc5685a57 None admin] PATH_INFO: `/v3/projects/d3e9e7f6798d4bbf8e708208061c1154` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:32.868354 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d51c4f7-9aea-4d36-b942-c7bbc5685a57 None admin] RBAC: Authorizing `identity:get_project(project_id=d3e9e7f6798d4bbf8e708208061c1154)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:32.869792 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d51c4f7-9aea-4d36-b942-c7bbc5685a57 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:32.871510 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 557/1129] 10.222.0.36 () {56 vars in 1186 bytes} [Fri Jun 24 22:27:32 2022] GET /identity/v3/projects/d3e9e7f6798d4bbf8e708208061c1154 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:27:32.878073 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7746350-e008-48f3-9820-e98d7215b147 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:32.993557 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:33.011507 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7746350-e008-48f3-9820-e98d7215b147 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:33.049015 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f221237-25d6-4ad8-94fe-f7f6b478ab07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:33.049664 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f221237-25d6-4ad8-94fe-f7f6b478ab07 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:33.049940 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f221237-25d6-4ad8-94fe-f7f6b478ab07 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:33.050209 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f221237-25d6-4ad8-94fe-f7f6b478ab07 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:33.051037 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f221237-25d6-4ad8-94fe-f7f6b478ab07 None admin] RBAC: Adding query filter params (role.id=bf32f251a7764c7188fd782b65275038, scope.project.id=d3e9e7f6798d4bbf8e708208061c1154, user.id=60fc2d7fb3bd4a54ac4bc8abb972c713) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:27:33.051381 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f221237-25d6-4ad8-94fe-f7f6b478ab07 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:33.052845 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f221237-25d6-4ad8-94fe-f7f6b478ab07 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:33.059015 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 573/1130] 10.222.0.36 () {56 vars in 1374 bytes} [Fri Jun 24 22:27:32 2022] GET /identity/v3/role_assignments?user.id=60fc2d7fb3bd4a54ac4bc8abb972c713&scope.project.id=d3e9e7f6798d4bbf8e708208061c1154&role.id=bf32f251a7764c7188fd782b65275038 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:27:35.153443 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a75060-d5aa-44b2-89c4-e9b5c3a2907b None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:35.154337 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a75060-d5aa-44b2-89c4-e9b5c3a2907b None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:35.154337 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a75060-d5aa-44b2-89c4-e9b5c3a2907b None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:35.156513 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 558/1131] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:27:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:27:35.165498 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2195ab96-8153-4fac-ba9f-82d296eebec0 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:35.165986 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2195ab96-8153-4fac-ba9f-82d296eebec0 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:35.166091 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2195ab96-8153-4fac-ba9f-82d296eebec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:35.188757 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-2195ab96-8153-4fac-ba9f-82d296eebec0 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:27:35.189947 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-2195ab96-8153-4fac-ba9f-82d296eebec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:27:35.261169 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 574/1132] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:27:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 22:27:35.285527 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a75060-d5aa-44b2-89c4-e9b5c3a2907b None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:35.400647 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a75060-d5aa-44b2-89c4-e9b5c3a2907b None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:35.440946 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08ba258-1ff9-4788-91c9-23d68f02ad82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:35.441739 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08ba258-1ff9-4788-91c9-23d68f02ad82 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:35.442017 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08ba258-1ff9-4788-91c9-23d68f02ad82 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:35.442287 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08ba258-1ff9-4788-91c9-23d68f02ad82 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:35.443470 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08ba258-1ff9-4788-91c9-23d68f02ad82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:35.445227 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08ba258-1ff9-4788-91c9-23d68f02ad82 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:35.446856 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 559/1133] 10.222.0.36 () {56 vars in 1108 bytes} [Fri Jun 24 22:27:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:27:35.453507 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2195ab96-8153-4fac-ba9f-82d296eebec0 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:35.542366 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:35.572017 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2195ab96-8153-4fac-ba9f-82d296eebec0 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:35.608167 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4eaee2-6567-4a20-af5b-49c48a4f7dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:35.608798 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4eaee2-6567-4a20-af5b-49c48a4f7dcc None admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:35.609077 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4eaee2-6567-4a20-af5b-49c48a4f7dcc None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:35.609359 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4eaee2-6567-4a20-af5b-49c48a4f7dcc None admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:35.610074 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4eaee2-6567-4a20-af5b-49c48a4f7dcc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:35.611561 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4eaee2-6567-4a20-af5b-49c48a4f7dcc None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:35.647318 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 575/1134] 10.222.0.36 () {60 vars in 1141 bytes} [Fri Jun 24 22:27:35 2022] POST /identity/v3/projects => generated 311 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 22:27:37.701323 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66431b8c-1a23-41b7-a64e-52fd839c3418 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:37.702125 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66431b8c-1a23-41b7-a64e-52fd839c3418 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:37.702125 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66431b8c-1a23-41b7-a64e-52fd839c3418 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:37.704332 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 560/1135] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:27:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:27:37.710804 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05517abc-04fe-45ad-a29f-87d87b7b4892 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:37.711235 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05517abc-04fe-45ad-a29f-87d87b7b4892 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:37.711458 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05517abc-04fe-45ad-a29f-87d87b7b4892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:37.733436 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-05517abc-04fe-45ad-a29f-87d87b7b4892 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:27:37.734630 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-05517abc-04fe-45ad-a29f-87d87b7b4892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:27:37.806459 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 576/1136] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:27:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 22:27:37.832002 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66431b8c-1a23-41b7-a64e-52fd839c3418 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:37.899505 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:37.947402 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66431b8c-1a23-41b7-a64e-52fd839c3418 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:37.983199 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f7cd37-9c4b-445a-a6b6-df118f6eee96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:37.983943 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f7cd37-9c4b-445a-a6b6-df118f6eee96 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:37.984224 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f7cd37-9c4b-445a-a6b6-df118f6eee96 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:37.984496 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f7cd37-9c4b-445a-a6b6-df118f6eee96 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:37.985780 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f7cd37-9c4b-445a-a6b6-df118f6eee96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:37.987226 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f7cd37-9c4b-445a-a6b6-df118f6eee96 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:37.988836 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 561/1137] 10.222.0.36 () {56 vars in 1108 bytes} [Fri Jun 24 22:27:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:27:37.994891 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05517abc-04fe-45ad-a29f-87d87b7b4892 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:38.068165 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:38.111071 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05517abc-04fe-45ad-a29f-87d87b7b4892 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:38.146020 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3517938a-0757-4f2a-8b12-4333e84351b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:38.146832 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3517938a-0757-4f2a-8b12-4333e84351b4 None admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:38.147358 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3517938a-0757-4f2a-8b12-4333e84351b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:38.147479 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3517938a-0757-4f2a-8b12-4333e84351b4 None admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:38.148184 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3517938a-0757-4f2a-8b12-4333e84351b4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:38.149637 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3517938a-0757-4f2a-8b12-4333e84351b4 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:38.173003 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 577/1138] 10.222.0.36 () {60 vars in 1132 bytes} [Fri Jun 24 22:27:37 2022] POST /identity/v3/users => generated 286 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:27:40.224127 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af7d060-1d6b-464f-be7c-dd6761e33650 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:40.224728 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af7d060-1d6b-464f-be7c-dd6761e33650 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:40.224728 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af7d060-1d6b-464f-be7c-dd6761e33650 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:40.226804 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 562/1139] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:27:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:27:40.235704 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1a3e40-f80c-440e-832e-182f576a1c29 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:40.236097 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1a3e40-f80c-440e-832e-182f576a1c29 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:40.236344 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1a3e40-f80c-440e-832e-182f576a1c29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:40.256518 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-7c1a3e40-f80c-440e-832e-182f576a1c29 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:27:40.257630 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-7c1a3e40-f80c-440e-832e-182f576a1c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:27:40.328095 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 578/1140] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:27:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 22:27:40.352842 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af7d060-1d6b-464f-be7c-dd6761e33650 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:40.473230 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af7d060-1d6b-464f-be7c-dd6761e33650 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:40.500698 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:40.511272 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc45ee6b-74be-4e8a-8f63-d3db3f2d740d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:40.512172 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc45ee6b-74be-4e8a-8f63-d3db3f2d740d None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:40.512446 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc45ee6b-74be-4e8a-8f63-d3db3f2d740d None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:40.512711 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc45ee6b-74be-4e8a-8f63-d3db3f2d740d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:40.523388 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc45ee6b-74be-4e8a-8f63-d3db3f2d740d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 22:27:40.530795 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-cc45ee6b-74be-4e8a-8f63-d3db3f2d740d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 22:27:40.530795 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:27:40.530795 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:27:40.530795 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:27:40.530795 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:27:40.530795 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:27:40.530795 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:27:40.530795 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:27:40.530795 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:27:40.530795 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:27:40.530795 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:27:40.530795 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:27:40.530795 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 22:27:40.530795 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 22:27:40.530795 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 22:27:40.530795 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 22:27:40.531869 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 22:27:40.531869 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 22:27:40.531869 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 22:27:40.531869 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 22:27:40.531869 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:27:40.531869 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:27:40.531869 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:27:40.531869 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:27:40.531869 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:27:40.531869 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:27:40.531869 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:27:40.531869 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:27:40.531869 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:27:40.531869 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:27:40.531869 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:27:40.531869 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:27:40.532757 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:27:40.532757 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:27:40.532757 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:27:40.532757 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:27:40.532757 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 22:27:40.532757 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 22:27:40.532757 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 22:27:40.532757 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 22:27:40.532757 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 22:27:40.532757 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 22:27:40.532757 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 22:27:40.532757 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:27:40.532757 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 563/1141] 10.222.0.36 () {56 vars in 1096 bytes} [Fri Jun 24 22:27:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:27:40.538331 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1a3e40-f80c-440e-832e-182f576a1c29 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:40.587285 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:40.649412 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1a3e40-f80c-440e-832e-182f576a1c29 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:40.688051 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d598c869-8b67-4109-946b-01f0b88e71d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:40.688696 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d598c869-8b67-4109-946b-01f0b88e71d4 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:40.688972 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d598c869-8b67-4109-946b-01f0b88e71d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:40.689243 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d598c869-8b67-4109-946b-01f0b88e71d4 None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:40.689981 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d598c869-8b67-4109-946b-01f0b88e71d4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:27:40.690283 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d598c869-8b67-4109-946b-01f0b88e71d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:40.691686 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d598c869-8b67-4109-946b-01f0b88e71d4 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:40.699859 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 579/1142] 10.222.0.36 () {56 vars in 1099 bytes} [Fri Jun 24 22:27:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:27:40.706318 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc45ee6b-74be-4e8a-8f63-d3db3f2d740d None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:40.826626 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc45ee6b-74be-4e8a-8f63-d3db3f2d740d None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:40.861900 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22943b5f-0817-4168-ad50-c1745e5ec4af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:40.862765 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22943b5f-0817-4168-ad50-c1745e5ec4af None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:40.863054 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22943b5f-0817-4168-ad50-c1745e5ec4af None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:40.863357 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22943b5f-0817-4168-ad50-c1745e5ec4af None admin] PATH_INFO: `/v3/users/4639231526c64cbe885e234de27df299` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:40.877658 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22943b5f-0817-4168-ad50-c1745e5ec4af None admin] RBAC: Authorizing `identity:get_user(user_id=4639231526c64cbe885e234de27df299)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:40.879115 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22943b5f-0817-4168-ad50-c1745e5ec4af None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:40.881419 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 564/1143] 10.222.0.36 () {56 vars in 1177 bytes} [Fri Jun 24 22:27:40 2022] GET /identity/v3/users/4639231526c64cbe885e234de27df299 => generated 286 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:27:40.890320 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d598c869-8b67-4109-946b-01f0b88e71d4 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:40.999302 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d598c869-8b67-4109-946b-01f0b88e71d4 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:41.017026 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:41.046625 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b40a51-a94b-46c3-9044-43d1db4de8a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:41.047289 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b40a51-a94b-46c3-9044-43d1db4de8a9 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:41.047575 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b40a51-a94b-46c3-9044-43d1db4de8a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:41.047848 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b40a51-a94b-46c3-9044-43d1db4de8a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:41.117604 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b40a51-a94b-46c3-9044-43d1db4de8a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:41.119132 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b40a51-a94b-46c3-9044-43d1db4de8a9 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:41.220882 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 580/1144] 10.222.0.36 () {58 vars in 1282 bytes} [Fri Jun 24 22:27:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 22:27:41.229321 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22943b5f-0817-4168-ad50-c1745e5ec4af None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:41.288700 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:41.351755 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22943b5f-0817-4168-ad50-c1745e5ec4af None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:41.387846 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb1848d-8d18-495d-9f85-e93b5f231be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:41.388707 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb1848d-8d18-495d-9f85-e93b5f231be1 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:41.388988 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb1848d-8d18-495d-9f85-e93b5f231be1 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:41.389260 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb1848d-8d18-495d-9f85-e93b5f231be1 None admin] PATH_INFO: `/v3/projects/fe79d25313694db3bacadf7d637bbbab` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:41.390586 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb1848d-8d18-495d-9f85-e93b5f231be1 None admin] RBAC: Authorizing `identity:get_project(project_id=fe79d25313694db3bacadf7d637bbbab)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:41.392108 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb1848d-8d18-495d-9f85-e93b5f231be1 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:41.393837 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 565/1145] 10.222.0.36 () {56 vars in 1186 bytes} [Fri Jun 24 22:27:41 2022] GET /identity/v3/projects/fe79d25313694db3bacadf7d637bbbab => generated 311 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:27:41.400811 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b40a51-a94b-46c3-9044-43d1db4de8a9 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:41.412682 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:41.508856 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b40a51-a94b-46c3-9044-43d1db4de8a9 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:41.544020 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef47ad8-52a7-42e2-8320-1474bc916f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:41.544659 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef47ad8-52a7-42e2-8320-1474bc916f0a None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:41.544948 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef47ad8-52a7-42e2-8320-1474bc916f0a None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:41.545219 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef47ad8-52a7-42e2-8320-1474bc916f0a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:41.546044 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef47ad8-52a7-42e2-8320-1474bc916f0a None admin] RBAC: Adding query filter params (role.id=1a1c43cc97a0407eb7a7c7a1333a9d4a, scope.project.id=fe79d25313694db3bacadf7d637bbbab, user.id=4639231526c64cbe885e234de27df299) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:27:41.546357 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef47ad8-52a7-42e2-8320-1474bc916f0a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:41.547850 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef47ad8-52a7-42e2-8320-1474bc916f0a None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:41.553423 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 581/1146] 10.222.0.36 () {56 vars in 1374 bytes} [Fri Jun 24 22:27:41 2022] GET /identity/v3/role_assignments?user.id=4639231526c64cbe885e234de27df299&scope.project.id=fe79d25313694db3bacadf7d637bbbab&role.id=1a1c43cc97a0407eb7a7c7a1333a9d4a => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:27:43.535415 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca9c738-a08e-4eb4-b756-bbf0b88971c5 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:43.536307 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca9c738-a08e-4eb4-b756-bbf0b88971c5 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:43.536307 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca9c738-a08e-4eb4-b756-bbf0b88971c5 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:43.538262 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 566/1147] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:27:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:27:43.544612 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca20c7-37a5-48e9-8275-3a7519c24e7f None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:43.545040 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca20c7-37a5-48e9-8275-3a7519c24e7f None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:43.545200 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca20c7-37a5-48e9-8275-3a7519c24e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:43.570837 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-2eca20c7-37a5-48e9-8275-3a7519c24e7f None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:27:43.572044 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-2eca20c7-37a5-48e9-8275-3a7519c24e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:27:43.640443 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 582/1148] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:27:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 22:27:43.671120 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca9c738-a08e-4eb4-b756-bbf0b88971c5 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:43.782476 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca9c738-a08e-4eb4-b756-bbf0b88971c5 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:43.795444 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:43.817369 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0089701-8667-4f88-91c3-e1ad24714dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:43.818155 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0089701-8667-4f88-91c3-e1ad24714dbb None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:43.818481 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0089701-8667-4f88-91c3-e1ad24714dbb None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:43.818761 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0089701-8667-4f88-91c3-e1ad24714dbb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:43.829286 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0089701-8667-4f88-91c3-e1ad24714dbb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 22:27:43.836843 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-f0089701-8667-4f88-91c3-e1ad24714dbb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 22:27:43.836843 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:27:43.836843 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:27:43.836843 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:27:43.836843 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:27:43.836843 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:27:43.836843 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:27:43.836843 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:27:43.836843 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:27:43.836843 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:27:43.836843 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:27:43.836843 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:27:43.836843 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 22:27:43.836843 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 22:27:43.836843 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 22:27:43.836843 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 22:27:43.837875 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 22:27:43.837875 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 22:27:43.837875 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 22:27:43.837875 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 22:27:43.837875 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:27:43.837875 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:27:43.837875 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:27:43.837875 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:27:43.837875 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:27:43.837875 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:27:43.837875 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:27:43.837875 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:27:43.837875 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:27:43.837875 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:27:43.837875 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:27:43.837875 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:27:43.838832 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:27:43.838832 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:27:43.838832 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:27:43.838832 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:27:43.838832 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 22:27:43.838832 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 22:27:43.838832 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 22:27:43.838832 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 22:27:43.838832 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 22:27:43.838832 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 22:27:43.838832 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 22:27:43.838832 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:27:43.838832 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 567/1149] 10.222.0.36 () {56 vars in 1096 bytes} [Fri Jun 24 22:27:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:27:43.844477 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eca20c7-37a5-48e9-8275-3a7519c24e7f None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:43.847694 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:43.948217 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eca20c7-37a5-48e9-8275-3a7519c24e7f None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:43.983225 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaaa8f1-f20d-42d0-a996-1615a4ff9e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:43.983910 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaaa8f1-f20d-42d0-a996-1615a4ff9e5d None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:43.984193 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaaa8f1-f20d-42d0-a996-1615a4ff9e5d None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:43.984464 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaaa8f1-f20d-42d0-a996-1615a4ff9e5d None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:43.985207 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaaa8f1-f20d-42d0-a996-1615a4ff9e5d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:27:43.985513 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaaa8f1-f20d-42d0-a996-1615a4ff9e5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:43.986888 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaaa8f1-f20d-42d0-a996-1615a4ff9e5d None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:43.995005 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 583/1150] 10.222.0.36 () {56 vars in 1099 bytes} [Fri Jun 24 22:27:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:27:44.004377 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0089701-8667-4f88-91c3-e1ad24714dbb None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:44.122745 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0089701-8667-4f88-91c3-e1ad24714dbb None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:44.158168 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508abe7a-e970-4dc5-9c8b-69084596775f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:44.159023 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508abe7a-e970-4dc5-9c8b-69084596775f None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:44.159329 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508abe7a-e970-4dc5-9c8b-69084596775f None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:44.159605 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508abe7a-e970-4dc5-9c8b-69084596775f None admin] PATH_INFO: `/v3/users/4639231526c64cbe885e234de27df299` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:44.160907 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508abe7a-e970-4dc5-9c8b-69084596775f None admin] RBAC: Authorizing `identity:get_user(user_id=4639231526c64cbe885e234de27df299)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:44.162523 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508abe7a-e970-4dc5-9c8b-69084596775f None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:44.164071 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 568/1151] 10.222.0.36 () {56 vars in 1177 bytes} [Fri Jun 24 22:27:44 2022] GET /identity/v3/users/4639231526c64cbe885e234de27df299 => generated 286 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:27:44.170744 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaaa8f1-f20d-42d0-a996-1615a4ff9e5d None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:44.243833 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:44.285711 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaaa8f1-f20d-42d0-a996-1615a4ff9e5d None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:44.321749 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb485cea-1b89-4a3b-95c1-3a5ff77c53ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:44.322612 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb485cea-1b89-4a3b-95c1-3a5ff77c53ca None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:44.322893 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb485cea-1b89-4a3b-95c1-3a5ff77c53ca None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:44.323167 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb485cea-1b89-4a3b-95c1-3a5ff77c53ca None admin] PATH_INFO: `/v3/projects/fe79d25313694db3bacadf7d637bbbab` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:44.324446 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb485cea-1b89-4a3b-95c1-3a5ff77c53ca None admin] RBAC: Authorizing `identity:get_project(project_id=fe79d25313694db3bacadf7d637bbbab)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:44.325900 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb485cea-1b89-4a3b-95c1-3a5ff77c53ca None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:44.327629 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 584/1152] 10.222.0.36 () {56 vars in 1186 bytes} [Fri Jun 24 22:27:44 2022] GET /identity/v3/projects/fe79d25313694db3bacadf7d637bbbab => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:27:44.336824 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508abe7a-e970-4dc5-9c8b-69084596775f None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:44.385243 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:44.454073 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508abe7a-e970-4dc5-9c8b-69084596775f None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:44.499757 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2440b8b-0671-4ec4-94b5-675e88853aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:44.500647 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2440b8b-0671-4ec4-94b5-675e88853aa8 None admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:44.500925 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2440b8b-0671-4ec4-94b5-675e88853aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:44.501197 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2440b8b-0671-4ec4-94b5-675e88853aa8 None admin] PATH_INFO: `/v3/projects/fe79d25313694db3bacadf7d637bbbab/users/4639231526c64cbe885e234de27df299/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:44.503436 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2440b8b-0671-4ec4-94b5-675e88853aa8 None admin] RBAC: Authorizing `identity:create_grant(project_id=fe79d25313694db3bacadf7d637bbbab, user_id=4639231526c64cbe885e234de27df299, role_id=1a1c43cc97a0407eb7a7c7a1333a9d4a)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:44.505224 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2440b8b-0671-4ec4-94b5-675e88853aa8 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:44.523108 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 569/1153] 10.222.0.36 () {58 vars in 1439 bytes} [Fri Jun 24 22:27:44 2022] PUT /identity/v3/projects/fe79d25313694db3bacadf7d637bbbab/users/4639231526c64cbe885e234de27df299/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:27:46.530601 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e82ddc7-7017-4d4c-9a90-a2a4420e8308 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:46.531307 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e82ddc7-7017-4d4c-9a90-a2a4420e8308 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:46.531307 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e82ddc7-7017-4d4c-9a90-a2a4420e8308 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:46.532533 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 585/1154] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:27:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:27:46.539066 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39c3581-2359-484c-880f-71f00b60f0b3 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:46.539564 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39c3581-2359-484c-880f-71f00b60f0b3 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:46.539663 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39c3581-2359-484c-880f-71f00b60f0b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:46.570650 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-b39c3581-2359-484c-880f-71f00b60f0b3 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:27:46.571909 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-b39c3581-2359-484c-880f-71f00b60f0b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:27:46.650292 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 570/1155] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:27:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 22:27:46.681355 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e82ddc7-7017-4d4c-9a90-a2a4420e8308 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:46.804899 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e82ddc7-7017-4d4c-9a90-a2a4420e8308 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:46.847050 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600f8c2c-9918-47e8-baa3-cf3f5044b342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:46.848183 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f8c2c-9918-47e8-baa3-cf3f5044b342 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:46.848523 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f8c2c-9918-47e8-baa3-cf3f5044b342 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:46.848865 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f8c2c-9918-47e8-baa3-cf3f5044b342 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:46.851191 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:46.865319 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600f8c2c-9918-47e8-baa3-cf3f5044b342 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 22:27:46.873296 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-600f8c2c-9918-47e8-baa3-cf3f5044b342 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 22:27:46.873296 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:27:46.873296 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:27:46.873296 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:27:46.873296 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:27:46.873296 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:27:46.873296 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:27:46.873296 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:27:46.873296 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:27:46.873296 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:27:46.873296 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:27:46.873296 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:27:46.873296 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 22:27:46.873296 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 22:27:46.873296 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 22:27:46.873296 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 22:27:46.874361 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 22:27:46.874361 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 22:27:46.874361 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 22:27:46.874361 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 22:27:46.874361 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:27:46.874361 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:27:46.874361 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:27:46.874361 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:27:46.874361 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:27:46.874361 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:27:46.874361 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:27:46.874361 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:27:46.874361 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:27:46.874361 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:27:46.874361 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:27:46.874361 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:27:46.875844 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:27:46.875844 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:27:46.875844 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:27:46.875844 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:27:46.875844 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 22:27:46.875844 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 22:27:46.875844 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 22:27:46.875844 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 22:27:46.875844 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 22:27:46.875844 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 22:27:46.875844 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 22:27:46.875844 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:27:46.875844 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 586/1156] 10.222.0.36 () {56 vars in 1096 bytes} [Fri Jun 24 22:27:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:27:46.884639 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39c3581-2359-484c-880f-71f00b60f0b3 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:46.917692 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:47.010134 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39c3581-2359-484c-880f-71f00b60f0b3 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:47.064420 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1e87ab-e85d-4c65-9ab5-f01f6104355b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:47.065015 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1e87ab-e85d-4c65-9ab5-f01f6104355b None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:47.065302 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1e87ab-e85d-4c65-9ab5-f01f6104355b None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:47.065579 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1e87ab-e85d-4c65-9ab5-f01f6104355b None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:47.066647 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1e87ab-e85d-4c65-9ab5-f01f6104355b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:27:47.067204 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1e87ab-e85d-4c65-9ab5-f01f6104355b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:47.069179 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1e87ab-e85d-4c65-9ab5-f01f6104355b None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:47.079637 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 571/1157] 10.222.0.36 () {56 vars in 1099 bytes} [Fri Jun 24 22:27:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:27:47.086448 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600f8c2c-9918-47e8-baa3-cf3f5044b342 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:47.210812 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600f8c2c-9918-47e8-baa3-cf3f5044b342 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:47.245908 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5cf42f-4f9c-43dc-a4c1-04fe9c441275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:47.246770 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5cf42f-4f9c-43dc-a4c1-04fe9c441275 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:47.247043 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5cf42f-4f9c-43dc-a4c1-04fe9c441275 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:47.247347 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5cf42f-4f9c-43dc-a4c1-04fe9c441275 None admin] PATH_INFO: `/v3/users/4639231526c64cbe885e234de27df299` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:47.248632 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5cf42f-4f9c-43dc-a4c1-04fe9c441275 None admin] RBAC: Authorizing `identity:get_user(user_id=4639231526c64cbe885e234de27df299)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:47.250071 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5cf42f-4f9c-43dc-a4c1-04fe9c441275 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:47.251722 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 587/1158] 10.222.0.36 () {56 vars in 1177 bytes} [Fri Jun 24 22:27:47 2022] GET /identity/v3/users/4639231526c64cbe885e234de27df299 => generated 286 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:27:47.258062 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1e87ab-e85d-4c65-9ab5-f01f6104355b None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:47.353781 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:47.363554 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1e87ab-e85d-4c65-9ab5-f01f6104355b None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:47.401818 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd8f372-b322-411a-a5bf-b8f356fe02f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:47.402460 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd8f372-b322-411a-a5bf-b8f356fe02f9 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:47.402739 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd8f372-b322-411a-a5bf-b8f356fe02f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:47.403012 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd8f372-b322-411a-a5bf-b8f356fe02f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:47.472371 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd8f372-b322-411a-a5bf-b8f356fe02f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:47.473829 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd8f372-b322-411a-a5bf-b8f356fe02f9 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:47.566341 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:47.576126 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 572/1159] 10.222.0.36 () {58 vars in 1282 bytes} [Fri Jun 24 22:27:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 22:27:47.582291 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5cf42f-4f9c-43dc-a4c1-04fe9c441275 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:47.645459 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:47.688662 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5cf42f-4f9c-43dc-a4c1-04fe9c441275 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:47.723382 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae75f4cb-d4b6-440a-b287-2eac3b742801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:47.724228 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae75f4cb-d4b6-440a-b287-2eac3b742801 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:47.724551 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae75f4cb-d4b6-440a-b287-2eac3b742801 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:47.724861 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae75f4cb-d4b6-440a-b287-2eac3b742801 None admin] PATH_INFO: `/v3/projects/fe79d25313694db3bacadf7d637bbbab` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:47.726212 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae75f4cb-d4b6-440a-b287-2eac3b742801 None admin] RBAC: Authorizing `identity:get_project(project_id=fe79d25313694db3bacadf7d637bbbab)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:47.727702 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae75f4cb-d4b6-440a-b287-2eac3b742801 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:47.729412 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 588/1160] 10.222.0.36 () {56 vars in 1186 bytes} [Fri Jun 24 22:27:47 2022] GET /identity/v3/projects/fe79d25313694db3bacadf7d637bbbab => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:27:47.739214 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd8f372-b322-411a-a5bf-b8f356fe02f9 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:47.840606 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd8f372-b322-411a-a5bf-b8f356fe02f9 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:47.877947 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6738bc-ee56-4c54-99aa-7543f32583b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:47.878592 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6738bc-ee56-4c54-99aa-7543f32583b6 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:47.878876 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6738bc-ee56-4c54-99aa-7543f32583b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:47.879147 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6738bc-ee56-4c54-99aa-7543f32583b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:47.880327 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6738bc-ee56-4c54-99aa-7543f32583b6 None admin] RBAC: Adding query filter params (role.id=1a1c43cc97a0407eb7a7c7a1333a9d4a, scope.project.id=fe79d25313694db3bacadf7d637bbbab, user.id=4639231526c64cbe885e234de27df299) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:27:47.880645 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6738bc-ee56-4c54-99aa-7543f32583b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:47.882587 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6738bc-ee56-4c54-99aa-7543f32583b6 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:47.888559 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 573/1161] 10.222.0.36 () {56 vars in 1374 bytes} [Fri Jun 24 22:27:47 2022] GET /identity/v3/role_assignments?user.id=4639231526c64cbe885e234de27df299&scope.project.id=fe79d25313694db3bacadf7d637bbbab&role.id=1a1c43cc97a0407eb7a7c7a1333a9d4a => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:27:49.903622 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f30f288-7366-4d70-9aba-8ec810d07132 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:49.904203 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f30f288-7366-4d70-9aba-8ec810d07132 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:49.904203 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f30f288-7366-4d70-9aba-8ec810d07132 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:49.905524 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 589/1162] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:27:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:27:49.912208 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edb76ea-fd28-46d5-aeea-e892b4112de2 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:49.912933 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edb76ea-fd28-46d5-aeea-e892b4112de2 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:49.913262 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edb76ea-fd28-46d5-aeea-e892b4112de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:49.936636 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-2edb76ea-fd28-46d5-aeea-e892b4112de2 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:27:49.937820 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-2edb76ea-fd28-46d5-aeea-e892b4112de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:27:49.989371 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:50.007178 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 574/1163] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:27:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 22:27:50.030260 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f30f288-7366-4d70-9aba-8ec810d07132 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:50.144019 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f30f288-7366-4d70-9aba-8ec810d07132 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:50.181160 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:50.188002 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a27173-6a17-43e4-a9c1-b1a1a20006d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:50.188645 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a27173-6a17-43e4-a9c1-b1a1a20006d2 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:50.188926 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a27173-6a17-43e4-a9c1-b1a1a20006d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:50.189205 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a27173-6a17-43e4-a9c1-b1a1a20006d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:50.263975 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a27173-6a17-43e4-a9c1-b1a1a20006d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:50.265467 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a27173-6a17-43e4-a9c1-b1a1a20006d2 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:50.372775 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 590/1164] 10.222.0.36 () {58 vars in 1282 bytes} [Fri Jun 24 22:27:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 22:27:50.379193 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edb76ea-fd28-46d5-aeea-e892b4112de2 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:50.488023 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edb76ea-fd28-46d5-aeea-e892b4112de2 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:50.530295 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12be58ac-a160-442a-906f-1d13342058df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:50.531610 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be58ac-a160-442a-906f-1d13342058df None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:50.532075 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be58ac-a160-442a-906f-1d13342058df None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:50.532537 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be58ac-a160-442a-906f-1d13342058df None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:50.541195 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12be58ac-a160-442a-906f-1d13342058df None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:50.542656 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12be58ac-a160-442a-906f-1d13342058df None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:50.557568 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-12be58ac-a160-442a-906f-1d13342058df None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 24 22:27:50.557568 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:27:50.557568 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 24 22:27:50.557568 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 24 22:27:50.557568 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 22:27:50.557568 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 22:27:50.557568 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 22:27:50.557568 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 22:27:50.557568 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 24 22:27:50.557568 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:27:50.557568 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 22:27:50.557568 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:27:50.557568 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:27:50.557568 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:27:50.557568 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:27:50.557568 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:27:50.557568 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:27:50.558672 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:27:50.558672 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:27:50.558672 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:27:50.558672 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:27:50.558672 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:27:50.558672 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:27:50.558672 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 22:27:50.558672 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 22:27:50.558672 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 22:27:50.558672 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 22:27:50.558672 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:27:50.558672 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:27:50.558672 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:27:50.558672 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:27:50.558672 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:27:50.558672 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:27:50.559937 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:27:50.559937 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:27:50.559937 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:27:50.559937 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:27:50.559937 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:27:50.559937 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:27:50.559937 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:27:50.559937 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:27:50.559937 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:27:50.559937 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:27:50.559937 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 24 22:27:50.559937 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 22:27:50.559937 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 24 22:27:50.559937 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:27:50.559937 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 575/1165] 10.222.0.36 () {56 vars in 1117 bytes} [Fri Jun 24 22:27:50 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:27:50.566613 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a27173-6a17-43e4-a9c1-b1a1a20006d2 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:50.597424 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:50.680990 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a27173-6a17-43e4-a9c1-b1a1a20006d2 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:50.720497 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976ed2ac-3141-4c0e-917a-af6986a005e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:50.721075 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976ed2ac-3141-4c0e-917a-af6986a005e0 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:50.721331 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976ed2ac-3141-4c0e-917a-af6986a005e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:50.721640 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976ed2ac-3141-4c0e-917a-af6986a005e0 None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:50.722361 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976ed2ac-3141-4c0e-917a-af6986a005e0 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:27:50.722668 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976ed2ac-3141-4c0e-917a-af6986a005e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:50.724082 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976ed2ac-3141-4c0e-917a-af6986a005e0 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:50.732203 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 591/1166] 10.222.0.36 () {56 vars in 1115 bytes} [Fri Jun 24 22:27:50 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:27:52.715142 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604fca46-4eac-4bff-9c1b-11e0579e458d None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:52.715999 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604fca46-4eac-4bff-9c1b-11e0579e458d None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:52.715999 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604fca46-4eac-4bff-9c1b-11e0579e458d None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:52.718088 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 576/1167] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:27:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:27:52.725977 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9add90d-2aa7-4fd0-a2c0-a8c0d9278538 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:52.726382 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9add90d-2aa7-4fd0-a2c0-a8c0d9278538 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:52.726527 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9add90d-2aa7-4fd0-a2c0-a8c0d9278538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:52.745890 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-e9add90d-2aa7-4fd0-a2c0-a8c0d9278538 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:27:52.747078 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-e9add90d-2aa7-4fd0-a2c0-a8c0d9278538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:27:52.819994 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 592/1168] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:27:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 22:27:52.843647 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604fca46-4eac-4bff-9c1b-11e0579e458d None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:52.891984 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:52.951274 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604fca46-4eac-4bff-9c1b-11e0579e458d None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:52.985991 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86101fd-49c8-4810-9db2-1b314ac27efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:52.986576 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86101fd-49c8-4810-9db2-1b314ac27efe None admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:52.986855 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86101fd-49c8-4810-9db2-1b314ac27efe None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:52.987129 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86101fd-49c8-4810-9db2-1b314ac27efe None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:52.987879 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86101fd-49c8-4810-9db2-1b314ac27efe None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:52.989284 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86101fd-49c8-4810-9db2-1b314ac27efe None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:53.008551 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 577/1169] 10.222.0.36 () {60 vars in 1138 bytes} [Fri Jun 24 22:27:52 2022] POST /identity/v3/domains => generated 267 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:27:55.031449 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74025fdb-bfff-491c-bf8e-3832d165e309 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:55.031999 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74025fdb-bfff-491c-bf8e-3832d165e309 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:55.031999 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74025fdb-bfff-491c-bf8e-3832d165e309 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:55.034125 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 593/1170] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:27:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:27:55.040357 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0dc9bd-ded1-4d12-b2c4-9509159ba7fb None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:55.041045 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0dc9bd-ded1-4d12-b2c4-9509159ba7fb None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:55.041171 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0dc9bd-ded1-4d12-b2c4-9509159ba7fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:55.068887 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-1b0dc9bd-ded1-4d12-b2c4-9509159ba7fb None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:27:55.070079 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-1b0dc9bd-ded1-4d12-b2c4-9509159ba7fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:27:55.140049 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 578/1171] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:27:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 22:27:55.166652 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74025fdb-bfff-491c-bf8e-3832d165e309 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:55.199676 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:55.284942 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74025fdb-bfff-491c-bf8e-3832d165e309 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:55.319719 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b5a956-88ff-48d4-8357-9fa7e20d1e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:55.320573 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b5a956-88ff-48d4-8357-9fa7e20d1e8d None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:55.320856 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b5a956-88ff-48d4-8357-9fa7e20d1e8d None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:55.321128 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b5a956-88ff-48d4-8357-9fa7e20d1e8d None admin] PATH_INFO: `/v3/domains/f2f2f8d5cd5c48ec845700fc8ab1f800` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:55.332059 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b5a956-88ff-48d4-8357-9fa7e20d1e8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=f2f2f8d5cd5c48ec845700fc8ab1f800)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:55.333543 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b5a956-88ff-48d4-8357-9fa7e20d1e8d None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:55.335183 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 594/1172] 10.222.0.36 () {56 vars in 1183 bytes} [Fri Jun 24 22:27:55 2022] GET /identity/v3/domains/f2f2f8d5cd5c48ec845700fc8ab1f800 => generated 267 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:27:55.341417 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0dc9bd-ded1-4d12-b2c4-9509159ba7fb None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:55.380268 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:55.453517 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0dc9bd-ded1-4d12-b2c4-9509159ba7fb None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:55.491703 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e296593-de54-441e-8272-2d9b0e7f4e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:55.492352 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e296593-de54-441e-8272-2d9b0e7f4e22 None admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:55.492630 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e296593-de54-441e-8272-2d9b0e7f4e22 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:55.492905 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e296593-de54-441e-8272-2d9b0e7f4e22 None admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:55.493606 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e296593-de54-441e-8272-2d9b0e7f4e22 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:55.495046 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e296593-de54-441e-8272-2d9b0e7f4e22 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:55.523795 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 579/1173] 10.222.0.36 () {60 vars in 1141 bytes} [Fri Jun 24 22:27:55 2022] POST /identity/v3/projects => generated 361 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:27:57.539394 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dc4b59-db58-460c-bf46-69989207903f None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:57.539971 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dc4b59-db58-460c-bf46-69989207903f None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:57.539971 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dc4b59-db58-460c-bf46-69989207903f None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:57.541299 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 595/1174] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:27:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:27:57.547703 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ec8463-a3ab-4572-b99b-9a7504fabbf2 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:57.548487 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ec8463-a3ab-4572-b99b-9a7504fabbf2 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:57.548643 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ec8463-a3ab-4572-b99b-9a7504fabbf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:57.567794 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-19ec8463-a3ab-4572-b99b-9a7504fabbf2 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:27:57.569004 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-19ec8463-a3ab-4572-b99b-9a7504fabbf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:27:57.637800 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 580/1175] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:27:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 22:27:57.672268 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dc4b59-db58-460c-bf46-69989207903f None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:57.762802 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:57.780901 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dc4b59-db58-460c-bf46-69989207903f None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:57.814912 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f29f73f-7437-4b78-80a2-ed5129e6f0f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:57.815834 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f29f73f-7437-4b78-80a2-ed5129e6f0f6 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:57.816113 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f29f73f-7437-4b78-80a2-ed5129e6f0f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:57.816389 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f29f73f-7437-4b78-80a2-ed5129e6f0f6 None admin] PATH_INFO: `/v3/domains/f2f2f8d5cd5c48ec845700fc8ab1f800` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:57.817654 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f29f73f-7437-4b78-80a2-ed5129e6f0f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=f2f2f8d5cd5c48ec845700fc8ab1f800)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:57.819477 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f29f73f-7437-4b78-80a2-ed5129e6f0f6 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:57.821124 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 596/1176] 10.222.0.36 () {56 vars in 1183 bytes} [Fri Jun 24 22:27:57 2022] GET /identity/v3/domains/f2f2f8d5cd5c48ec845700fc8ab1f800 => generated 267 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:27:57.827426 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ec8463-a3ab-4572-b99b-9a7504fabbf2 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:27:57.846493 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:27:57.939058 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ec8463-a3ab-4572-b99b-9a7504fabbf2 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:27:57.974348 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c6022f-e798-4cf8-89a6-903a67cb7cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:27:57.975007 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c6022f-e798-4cf8-89a6-903a67cb7cea None admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:27:57.975291 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c6022f-e798-4cf8-89a6-903a67cb7cea None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:27:57.975594 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c6022f-e798-4cf8-89a6-903a67cb7cea None admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:27:57.976309 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c6022f-e798-4cf8-89a6-903a67cb7cea None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:27:57.977748 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c6022f-e798-4cf8-89a6-903a67cb7cea None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:27:58.005853 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 581/1177] 10.222.0.36 () {60 vars in 1132 bytes} [Fri Jun 24 22:27:57 2022] POST /identity/v3/users => generated 311 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:28:00.063017 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfa3011-64f1-4f55-8bef-9f0bc13c6871 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:28:00.063965 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfa3011-64f1-4f55-8bef-9f0bc13c6871 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:28:00.063965 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfa3011-64f1-4f55-8bef-9f0bc13c6871 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:28:00.066168 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 597/1178] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:28:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:28:00.071694 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df870cda-0cf1-4f74-82cd-ec6a3f1eb5ee None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:28:00.072139 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df870cda-0cf1-4f74-82cd-ec6a3f1eb5ee None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:28:00.072229 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df870cda-0cf1-4f74-82cd-ec6a3f1eb5ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:28:00.090641 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-df870cda-0cf1-4f74-82cd-ec6a3f1eb5ee None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:28:00.091839 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-df870cda-0cf1-4f74-82cd-ec6a3f1eb5ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:28:00.161746 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 582/1179] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:28:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 22:28:00.185494 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfa3011-64f1-4f55-8bef-9f0bc13c6871 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:28:00.294572 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfa3011-64f1-4f55-8bef-9f0bc13c6871 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:28:00.331122 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75268e9c-ebb3-44e7-9267-6b3d6a12973e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:28:00.331860 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75268e9c-ebb3-44e7-9267-6b3d6a12973e None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:28:00.332140 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75268e9c-ebb3-44e7-9267-6b3d6a12973e None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:28:00.332414 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75268e9c-ebb3-44e7-9267-6b3d6a12973e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:28:00.344616 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75268e9c-ebb3-44e7-9267-6b3d6a12973e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 22:28:00.352259 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-75268e9c-ebb3-44e7-9267-6b3d6a12973e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 22:28:00.352259 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:28:00.352259 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:28:00.352259 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:28:00.352259 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:28:00.352259 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:28:00.352259 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:28:00.352259 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:28:00.352259 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:28:00.352259 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:28:00.352259 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:28:00.352259 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:28:00.352259 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 22:28:00.352259 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 22:28:00.352259 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 22:28:00.352259 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 22:28:00.353388 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 22:28:00.353388 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 22:28:00.353388 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 22:28:00.353388 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 22:28:00.353388 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:28:00.353388 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:28:00.353388 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:28:00.353388 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:28:00.353388 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:28:00.353388 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:28:00.353388 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:28:00.353388 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:28:00.353388 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:28:00.353388 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:28:00.353388 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:28:00.353388 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:28:00.354424 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:28:00.354424 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:28:00.354424 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:28:00.354424 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:28:00.354424 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 22:28:00.354424 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 22:28:00.354424 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 22:28:00.354424 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 22:28:00.354424 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 22:28:00.354424 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 22:28:00.354424 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 22:28:00.354424 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:28:00.354424 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 598/1180] 10.222.0.36 () {56 vars in 1096 bytes} [Fri Jun 24 22:28:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:28:00.359676 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df870cda-0cf1-4f74-82cd-ec6a3f1eb5ee None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:28:00.362866 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:28:00.468865 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df870cda-0cf1-4f74-82cd-ec6a3f1eb5ee None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:28:00.508318 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743d0c1b-27df-458b-86c2-4e66b6e3f5ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:28:00.508981 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d0c1b-27df-458b-86c2-4e66b6e3f5ff None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:28:00.509270 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d0c1b-27df-458b-86c2-4e66b6e3f5ff None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:28:00.509544 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d0c1b-27df-458b-86c2-4e66b6e3f5ff None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:28:00.510291 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743d0c1b-27df-458b-86c2-4e66b6e3f5ff None admin] RBAC: Adding query filter params (name=admin) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:28:00.510599 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743d0c1b-27df-458b-86c2-4e66b6e3f5ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:28:00.512016 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743d0c1b-27df-458b-86c2-4e66b6e3f5ff None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:28:00.520209 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 583/1181] 10.222.0.36 () {56 vars in 1099 bytes} [Fri Jun 24 22:28:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:28:00.526970 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75268e9c-ebb3-44e7-9267-6b3d6a12973e None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:28:00.542499 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:28:00.641156 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75268e9c-ebb3-44e7-9267-6b3d6a12973e None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:28:00.680379 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee308c0-54cd-42ae-a6cd-4223bfb0830b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:28:00.681277 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee308c0-54cd-42ae-a6cd-4223bfb0830b None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:28:00.681560 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee308c0-54cd-42ae-a6cd-4223bfb0830b None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:28:00.681836 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee308c0-54cd-42ae-a6cd-4223bfb0830b None admin] PATH_INFO: `/v3/users/2a0dfb982a7f4c3797f8200086ba367c` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:28:00.696721 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee308c0-54cd-42ae-a6cd-4223bfb0830b None admin] RBAC: Authorizing `identity:get_user(user_id=2a0dfb982a7f4c3797f8200086ba367c)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:28:00.698206 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee308c0-54cd-42ae-a6cd-4223bfb0830b None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:28:00.699891 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 599/1182] 10.222.0.36 () {56 vars in 1177 bytes} [Fri Jun 24 22:28:00 2022] GET /identity/v3/users/2a0dfb982a7f4c3797f8200086ba367c => generated 311 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:28:00.706735 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743d0c1b-27df-458b-86c2-4e66b6e3f5ff None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:28:00.776896 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:28:00.816843 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743d0c1b-27df-458b-86c2-4e66b6e3f5ff None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:28:00.852176 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d936cb8-9b54-471c-b38f-537d0df89162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:28:00.852814 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d936cb8-9b54-471c-b38f-537d0df89162 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:28:00.853099 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d936cb8-9b54-471c-b38f-537d0df89162 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:28:00.853375 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d936cb8-9b54-471c-b38f-537d0df89162 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:28:00.922640 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d936cb8-9b54-471c-b38f-537d0df89162 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:28:00.924062 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d936cb8-9b54-471c-b38f-537d0df89162 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:28:00.988991 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:28:01.031696 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 584/1183] 10.222.0.36 () {58 vars in 1282 bytes} [Fri Jun 24 22:28:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 22:28:01.039783 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee308c0-54cd-42ae-a6cd-4223bfb0830b None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:28:01.108903 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:28:01.143726 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee308c0-54cd-42ae-a6cd-4223bfb0830b None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:28:01.178740 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c4becc-61c9-4382-920c-f0854b07189f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:28:01.179549 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c4becc-61c9-4382-920c-f0854b07189f None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:28:01.179822 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c4becc-61c9-4382-920c-f0854b07189f None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:28:01.180091 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c4becc-61c9-4382-920c-f0854b07189f None admin] PATH_INFO: `/v3/projects/2ed55fc9a4d84768afc2d09810c040a2` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:28:01.181375 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c4becc-61c9-4382-920c-f0854b07189f None admin] RBAC: Authorizing `identity:get_project(project_id=2ed55fc9a4d84768afc2d09810c040a2)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:28:01.182827 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c4becc-61c9-4382-920c-f0854b07189f None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:28:01.184556 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 600/1184] 10.222.0.36 () {56 vars in 1186 bytes} [Fri Jun 24 22:28:01 2022] GET /identity/v3/projects/2ed55fc9a4d84768afc2d09810c040a2 => generated 361 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:28:01.191005 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d936cb8-9b54-471c-b38f-537d0df89162 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:28:01.300235 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d936cb8-9b54-471c-b38f-537d0df89162 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:28:01.336655 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56abdb48-ff7e-446c-8d0b-cecb78c5db96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:28:01.337292 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56abdb48-ff7e-446c-8d0b-cecb78c5db96 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:28:01.337569 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56abdb48-ff7e-446c-8d0b-cecb78c5db96 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:28:01.337838 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56abdb48-ff7e-446c-8d0b-cecb78c5db96 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:28:01.338661 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56abdb48-ff7e-446c-8d0b-cecb78c5db96 None admin] RBAC: Adding query filter params (role.id=1a1c43cc97a0407eb7a7c7a1333a9d4a, scope.project.id=2ed55fc9a4d84768afc2d09810c040a2, user.id=2a0dfb982a7f4c3797f8200086ba367c) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:28:01.338968 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56abdb48-ff7e-446c-8d0b-cecb78c5db96 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:28:01.340436 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56abdb48-ff7e-446c-8d0b-cecb78c5db96 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:28:01.345958 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 585/1185] 10.222.0.36 () {56 vars in 1374 bytes} [Fri Jun 24 22:28:01 2022] GET /identity/v3/role_assignments?user.id=2a0dfb982a7f4c3797f8200086ba367c&scope.project.id=2ed55fc9a4d84768afc2d09810c040a2&role.id=1a1c43cc97a0407eb7a7c7a1333a9d4a => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:28:03.328152 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90223d30-34e0-4fc4-ab86-bedc35171cea None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:28:03.328997 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90223d30-34e0-4fc4-ab86-bedc35171cea None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:28:03.328997 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90223d30-34e0-4fc4-ab86-bedc35171cea None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:28:03.331147 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 601/1186] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:28:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:28:03.339976 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5772010-df60-4adf-ae39-2a77fbad5ae1 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:28:03.340386 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5772010-df60-4adf-ae39-2a77fbad5ae1 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:28:03.340597 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5772010-df60-4adf-ae39-2a77fbad5ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:28:03.361333 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-c5772010-df60-4adf-ae39-2a77fbad5ae1 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:28:03.362520 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-c5772010-df60-4adf-ae39-2a77fbad5ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:28:03.388427 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:28:03.433682 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 586/1187] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:28:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 22:28:03.456253 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90223d30-34e0-4fc4-ab86-bedc35171cea None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:28:03.569640 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90223d30-34e0-4fc4-ab86-bedc35171cea None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:28:03.605490 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d628ad6-211e-4810-b7f2-c474f6369b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:28:03.606289 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d628ad6-211e-4810-b7f2-c474f6369b24 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:28:03.606552 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d628ad6-211e-4810-b7f2-c474f6369b24 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:28:03.606822 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d628ad6-211e-4810-b7f2-c474f6369b24 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:28:03.614144 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:28:03.618381 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d628ad6-211e-4810-b7f2-c474f6369b24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 22:28:03.626472 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-0d628ad6-211e-4810-b7f2-c474f6369b24 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 22:28:03.626472 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:28:03.626472 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:28:03.626472 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:28:03.626472 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:28:03.626472 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:28:03.626472 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:28:03.626472 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:28:03.626472 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:28:03.626472 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:28:03.626472 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:28:03.626472 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:28:03.626472 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 22:28:03.626472 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 22:28:03.626472 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 22:28:03.626472 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 22:28:03.627531 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 22:28:03.627531 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 22:28:03.627531 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 22:28:03.627531 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 22:28:03.627531 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:28:03.627531 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:28:03.627531 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:28:03.627531 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:28:03.627531 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:28:03.627531 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:28:03.627531 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:28:03.627531 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:28:03.627531 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:28:03.627531 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:28:03.627531 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:28:03.627531 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:28:03.628581 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:28:03.628581 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:28:03.628581 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:28:03.628581 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:28:03.628581 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 22:28:03.628581 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 22:28:03.628581 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 22:28:03.628581 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 22:28:03.628581 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 22:28:03.628581 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 22:28:03.628581 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 22:28:03.628581 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:28:03.628581 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 602/1188] 10.222.0.36 () {56 vars in 1096 bytes} [Fri Jun 24 22:28:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:28:03.637090 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5772010-df60-4adf-ae39-2a77fbad5ae1 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:28:03.745569 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5772010-df60-4adf-ae39-2a77fbad5ae1 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:28:03.781543 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d101815e-e3e7-412c-b532-0916f9453691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:28:03.782200 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d101815e-e3e7-412c-b532-0916f9453691 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:28:03.782476 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d101815e-e3e7-412c-b532-0916f9453691 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:28:03.782746 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d101815e-e3e7-412c-b532-0916f9453691 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:28:03.783529 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d101815e-e3e7-412c-b532-0916f9453691 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:28:03.783834 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d101815e-e3e7-412c-b532-0916f9453691 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:28:03.785210 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d101815e-e3e7-412c-b532-0916f9453691 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:28:03.793490 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 587/1189] 10.222.0.36 () {56 vars in 1099 bytes} [Fri Jun 24 22:28:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:28:03.802644 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d628ad6-211e-4810-b7f2-c474f6369b24 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:28:03.922371 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d628ad6-211e-4810-b7f2-c474f6369b24 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:28:03.957651 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e7813b-ed0a-4948-b8e8-739cb73314f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:28:03.958541 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e7813b-ed0a-4948-b8e8-739cb73314f6 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:28:03.958821 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e7813b-ed0a-4948-b8e8-739cb73314f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:28:03.959094 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e7813b-ed0a-4948-b8e8-739cb73314f6 None admin] PATH_INFO: `/v3/users/2a0dfb982a7f4c3797f8200086ba367c` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:28:03.960425 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e7813b-ed0a-4948-b8e8-739cb73314f6 None admin] RBAC: Authorizing `identity:get_user(user_id=2a0dfb982a7f4c3797f8200086ba367c)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:28:03.961878 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e7813b-ed0a-4948-b8e8-739cb73314f6 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:28:03.963538 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 603/1190] 10.222.0.36 () {56 vars in 1177 bytes} [Fri Jun 24 22:28:03 2022] GET /identity/v3/users/2a0dfb982a7f4c3797f8200086ba367c => generated 311 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:28:03.969576 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d101815e-e3e7-412c-b532-0916f9453691 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:28:03.995562 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:28:04.076631 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d101815e-e3e7-412c-b532-0916f9453691 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:28:04.111367 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99421f3d-63a8-4684-8236-d2257a16a580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:28:04.112219 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99421f3d-63a8-4684-8236-d2257a16a580 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:28:04.112501 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99421f3d-63a8-4684-8236-d2257a16a580 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:28:04.112773 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99421f3d-63a8-4684-8236-d2257a16a580 None admin] PATH_INFO: `/v3/projects/2ed55fc9a4d84768afc2d09810c040a2` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:28:04.114079 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99421f3d-63a8-4684-8236-d2257a16a580 None admin] RBAC: Authorizing `identity:get_project(project_id=2ed55fc9a4d84768afc2d09810c040a2)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:28:04.115745 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99421f3d-63a8-4684-8236-d2257a16a580 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:28:04.117438 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 588/1191] 10.222.0.36 () {56 vars in 1186 bytes} [Fri Jun 24 22:28:03 2022] GET /identity/v3/projects/2ed55fc9a4d84768afc2d09810c040a2 => generated 361 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:28:04.124119 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e7813b-ed0a-4948-b8e8-739cb73314f6 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:28:04.199371 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:28:04.239650 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e7813b-ed0a-4948-b8e8-739cb73314f6 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:28:04.273836 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28a7c6d-6d22-489d-ba69-0b82ac897879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:28:04.274722 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28a7c6d-6d22-489d-ba69-0b82ac897879 None admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:28:04.274997 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28a7c6d-6d22-489d-ba69-0b82ac897879 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:28:04.275285 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28a7c6d-6d22-489d-ba69-0b82ac897879 None admin] PATH_INFO: `/v3/projects/2ed55fc9a4d84768afc2d09810c040a2/users/2a0dfb982a7f4c3797f8200086ba367c/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:28:04.277254 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28a7c6d-6d22-489d-ba69-0b82ac897879 None admin] RBAC: Authorizing `identity:create_grant(project_id=2ed55fc9a4d84768afc2d09810c040a2, user_id=2a0dfb982a7f4c3797f8200086ba367c, role_id=1a1c43cc97a0407eb7a7c7a1333a9d4a)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:28:04.278691 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28a7c6d-6d22-489d-ba69-0b82ac897879 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:28:04.299674 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 604/1192] 10.222.0.36 () {58 vars in 1439 bytes} [Fri Jun 24 22:28:04 2022] PUT /identity/v3/projects/2ed55fc9a4d84768afc2d09810c040a2/users/2a0dfb982a7f4c3797f8200086ba367c/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:28:06.286061 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06eb489-1de1-4c99-ad74-5245606b8fee None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:28:06.286670 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06eb489-1de1-4c99-ad74-5245606b8fee None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:28:06.286670 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06eb489-1de1-4c99-ad74-5245606b8fee None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:28:06.288179 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 589/1193] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:28:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:28:06.294657 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1986fd-6e41-4876-a46e-7319affab9f1 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:28:06.295427 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1986fd-6e41-4876-a46e-7319affab9f1 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:28:06.295597 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1986fd-6e41-4876-a46e-7319affab9f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:28:06.322194 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-2b1986fd-6e41-4876-a46e-7319affab9f1 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:28:06.323440 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-2b1986fd-6e41-4876-a46e-7319affab9f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:28:06.401779 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 605/1194] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:28:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 22:28:06.425374 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06eb489-1de1-4c99-ad74-5245606b8fee None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:28:06.533575 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:28:06.549281 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06eb489-1de1-4c99-ad74-5245606b8fee None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:28:06.588241 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cb132a-7021-4ff7-a93f-91f37062755b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:28:06.589023 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb132a-7021-4ff7-a93f-91f37062755b None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:28:06.589306 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb132a-7021-4ff7-a93f-91f37062755b None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:28:06.589578 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb132a-7021-4ff7-a93f-91f37062755b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:28:06.601473 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cb132a-7021-4ff7-a93f-91f37062755b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 22:28:06.608935 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-d3cb132a-7021-4ff7-a93f-91f37062755b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 22:28:06.608935 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:28:06.608935 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:28:06.608935 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:28:06.608935 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:28:06.608935 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:28:06.608935 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:28:06.608935 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:28:06.608935 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:28:06.608935 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:28:06.608935 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:28:06.608935 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:28:06.608935 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 22:28:06.608935 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 22:28:06.608935 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 22:28:06.608935 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 22:28:06.609935 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 22:28:06.609935 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 22:28:06.609935 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 22:28:06.609935 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 22:28:06.609935 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:28:06.609935 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:28:06.609935 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:28:06.609935 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:28:06.609935 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:28:06.609935 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:28:06.609935 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:28:06.609935 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:28:06.609935 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:28:06.609935 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:28:06.609935 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:28:06.609935 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:28:06.610793 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:28:06.610793 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:28:06.610793 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:28:06.610793 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:28:06.610793 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 22:28:06.610793 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 22:28:06.610793 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 22:28:06.610793 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 22:28:06.610793 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 22:28:06.610793 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 22:28:06.610793 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 22:28:06.610793 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:28:06.610793 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 590/1195] 10.222.0.36 () {56 vars in 1096 bytes} [Fri Jun 24 22:28:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:28:06.618140 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1986fd-6e41-4876-a46e-7319affab9f1 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:28:06.682650 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:28:06.730208 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1986fd-6e41-4876-a46e-7319affab9f1 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:28:06.766565 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3172ddb-dc1c-4250-93ec-336e5575bfc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:28:06.767221 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3172ddb-dc1c-4250-93ec-336e5575bfc1 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:28:06.767533 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3172ddb-dc1c-4250-93ec-336e5575bfc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:28:06.767811 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3172ddb-dc1c-4250-93ec-336e5575bfc1 None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:28:06.768570 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3172ddb-dc1c-4250-93ec-336e5575bfc1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:28:06.768878 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3172ddb-dc1c-4250-93ec-336e5575bfc1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:28:06.770271 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3172ddb-dc1c-4250-93ec-336e5575bfc1 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:28:06.778791 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 606/1196] 10.222.0.36 () {56 vars in 1099 bytes} [Fri Jun 24 22:28:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:28:06.785013 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cb132a-7021-4ff7-a93f-91f37062755b None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:28:06.895509 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cb132a-7021-4ff7-a93f-91f37062755b None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:28:06.931508 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0193d2d6-d822-45b0-8805-cf70995ac316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:28:06.932379 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0193d2d6-d822-45b0-8805-cf70995ac316 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:28:06.932629 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0193d2d6-d822-45b0-8805-cf70995ac316 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:28:06.932921 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0193d2d6-d822-45b0-8805-cf70995ac316 None admin] PATH_INFO: `/v3/users/2a0dfb982a7f4c3797f8200086ba367c` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:28:06.934226 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0193d2d6-d822-45b0-8805-cf70995ac316 None admin] RBAC: Authorizing `identity:get_user(user_id=2a0dfb982a7f4c3797f8200086ba367c)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:28:06.935715 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0193d2d6-d822-45b0-8805-cf70995ac316 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:28:06.937351 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 591/1197] 10.222.0.36 () {56 vars in 1177 bytes} [Fri Jun 24 22:28:06 2022] GET /identity/v3/users/2a0dfb982a7f4c3797f8200086ba367c => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:28:06.944399 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3172ddb-dc1c-4250-93ec-336e5575bfc1 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:28:07.047026 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3172ddb-dc1c-4250-93ec-336e5575bfc1 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:28:07.064551 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:28:07.085509 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235088dd-498e-44c9-8304-75d2d41827ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:28:07.086153 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235088dd-498e-44c9-8304-75d2d41827ea None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:28:07.086435 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235088dd-498e-44c9-8304-75d2d41827ea None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:28:07.086708 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235088dd-498e-44c9-8304-75d2d41827ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:28:07.173405 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235088dd-498e-44c9-8304-75d2d41827ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:28:07.174807 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235088dd-498e-44c9-8304-75d2d41827ea None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:28:07.282369 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 607/1198] 10.222.0.36 () {58 vars in 1282 bytes} [Fri Jun 24 22:28:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 24 22:28:07.288680 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0193d2d6-d822-45b0-8805-cf70995ac316 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:28:07.310731 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:28:07.397856 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0193d2d6-d822-45b0-8805-cf70995ac316 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:28:07.433486 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cf0b9f-d699-461b-957f-f2da509f59f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:28:07.434245 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cf0b9f-d699-461b-957f-f2da509f59f5 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:28:07.434529 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cf0b9f-d699-461b-957f-f2da509f59f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:28:07.434801 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cf0b9f-d699-461b-957f-f2da509f59f5 None admin] PATH_INFO: `/v3/projects/2ed55fc9a4d84768afc2d09810c040a2` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:28:07.436125 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cf0b9f-d699-461b-957f-f2da509f59f5 None admin] RBAC: Authorizing `identity:get_project(project_id=2ed55fc9a4d84768afc2d09810c040a2)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:28:07.437578 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cf0b9f-d699-461b-957f-f2da509f59f5 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:28:07.439271 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 592/1199] 10.222.0.36 () {56 vars in 1186 bytes} [Fri Jun 24 22:28:07 2022] GET /identity/v3/projects/2ed55fc9a4d84768afc2d09810c040a2 => generated 361 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:28:07.446320 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235088dd-498e-44c9-8304-75d2d41827ea None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:28:07.468824 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:28:07.554406 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235088dd-498e-44c9-8304-75d2d41827ea None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:28:07.588989 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f994bd-9f3c-4a73-882a-8973c0af3f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:28:07.589627 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f994bd-9f3c-4a73-882a-8973c0af3f18 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:28:07.589908 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f994bd-9f3c-4a73-882a-8973c0af3f18 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:28:07.590184 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f994bd-9f3c-4a73-882a-8973c0af3f18 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:28:07.591014 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f994bd-9f3c-4a73-882a-8973c0af3f18 None admin] RBAC: Adding query filter params (role.id=1a1c43cc97a0407eb7a7c7a1333a9d4a, scope.project.id=2ed55fc9a4d84768afc2d09810c040a2, user.id=2a0dfb982a7f4c3797f8200086ba367c) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:28:07.591351 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f994bd-9f3c-4a73-882a-8973c0af3f18 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:28:07.592791 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f994bd-9f3c-4a73-882a-8973c0af3f18 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:28:07.598708 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 608/1200] 10.222.0.36 () {56 vars in 1374 bytes} [Fri Jun 24 22:28:07 2022] GET /identity/v3/role_assignments?user.id=2a0dfb982a7f4c3797f8200086ba367c&scope.project.id=2ed55fc9a4d84768afc2d09810c040a2&role.id=1a1c43cc97a0407eb7a7c7a1333a9d4a => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:28:17.428923 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=57 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:28:17.596070 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=59 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:29:02.853683 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea57bc-0ed4-49e9-b731-9e11244e4db0 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:29:02.854330 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea57bc-0ed4-49e9-b731-9e11244e4db0 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:29:02.854330 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea57bc-0ed4-49e9-b731-9e11244e4db0 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:29:02.856331 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 593/1201] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:29:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:29:02.863344 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7edbf4-680e-4491-9321-41b34314bf90 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:29:02.863895 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7edbf4-680e-4491-9321-41b34314bf90 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:29:02.863993 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7edbf4-680e-4491-9321-41b34314bf90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:29:02.883896 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-1f7edbf4-680e-4491-9321-41b34314bf90 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:29:02.885409 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-1f7edbf4-680e-4491-9321-41b34314bf90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:29:02.973299 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 609/1202] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:29:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 22:29:02.999568 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ea57bc-0ed4-49e9-b731-9e11244e4db0 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:29:03.134805 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ea57bc-0ed4-49e9-b731-9e11244e4db0 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:29:03.177375 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a80958-0318-4468-906f-3f2232f50955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:29:03.178202 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a80958-0318-4468-906f-3f2232f50955 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:29:03.178491 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a80958-0318-4468-906f-3f2232f50955 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:29:03.178776 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a80958-0318-4468-906f-3f2232f50955 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:29:03.195040 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a80958-0318-4468-906f-3f2232f50955 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:29:03.197178 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a80958-0318-4468-906f-3f2232f50955 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:29:03.223599 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-37a80958-0318-4468-906f-3f2232f50955 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:29:03.223599 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:29:03.223599 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:29:03.223599 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:29:03.223599 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:29:03.223599 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:29:03.223599 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:29:03.223599 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:29:03.223599 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:29:03.223599 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:29:03.223599 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:29:03.223599 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:29:03.223599 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 22:29:03.223599 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 22:29:03.223599 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 22:29:03.224892 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 22:29:03.224892 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:29:03.224892 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:29:03.224892 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:29:03.224892 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:29:03.224892 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:29:03.224892 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:29:03.224892 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:29:03.224892 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:29:03.224892 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:29:03.224892 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:29:03.224892 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:29:03.224892 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:29:03.224892 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:29:03.224892 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:29:03.224892 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:29:03.224892 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:29:03.226047 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 22:29:03.226047 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 22:29:03.226047 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:29:03.226047 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:29:03.231166 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 594/1203] 10.222.0.36 () {56 vars in 1108 bytes} [Fri Jun 24 22:29:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:29:03.234458 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7edbf4-680e-4491-9321-41b34314bf90 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:29:03.358227 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7edbf4-680e-4491-9321-41b34314bf90 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:29:03.392003 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:29:03.401379 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3328b9e-08ea-423e-9deb-ed906e71ca19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:29:03.402167 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3328b9e-08ea-423e-9deb-ed906e71ca19 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:29:03.402479 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3328b9e-08ea-423e-9deb-ed906e71ca19 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:29:03.402731 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3328b9e-08ea-423e-9deb-ed906e71ca19 None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:29:03.403497 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3328b9e-08ea-423e-9deb-ed906e71ca19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:29:03.403829 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3328b9e-08ea-423e-9deb-ed906e71ca19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:29:03.405239 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3328b9e-08ea-423e-9deb-ed906e71ca19 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:29:03.421701 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 610/1204] 10.222.0.36 () {56 vars in 1109 bytes} [Fri Jun 24 22:29:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:29:03.424428 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a80958-0318-4468-906f-3f2232f50955 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:29:03.503407 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:29:03.577667 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a80958-0318-4468-906f-3f2232f50955 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:29:03.624780 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a46067-738f-42f0-85c3-b13b434f3485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:29:03.625907 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a46067-738f-42f0-85c3-b13b434f3485 None admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:29:03.626373 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a46067-738f-42f0-85c3-b13b434f3485 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:29:03.626851 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a46067-738f-42f0-85c3-b13b434f3485 None admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:29:03.627952 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a46067-738f-42f0-85c3-b13b434f3485 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:29:03.630358 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a46067-738f-42f0-85c3-b13b434f3485 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:29:03.653839 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 595/1205] 10.222.0.36 () {60 vars in 1132 bytes} [Fri Jun 24 22:29:03 2022] POST /identity/v3/users => generated 251 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:29:05.912095 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56e59a7-58b3-4efa-8971-4d5d1667fcc4 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:29:05.912697 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56e59a7-58b3-4efa-8971-4d5d1667fcc4 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:29:05.912697 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56e59a7-58b3-4efa-8971-4d5d1667fcc4 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:29:05.914004 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 611/1206] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:29:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:29:05.920946 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f99645-ba9c-4778-afd5-847d10726da1 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:29:05.921578 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f99645-ba9c-4778-afd5-847d10726da1 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:29:05.921578 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f99645-ba9c-4778-afd5-847d10726da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:29:05.943117 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-82f99645-ba9c-4778-afd5-847d10726da1 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:29:05.944391 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-82f99645-ba9c-4778-afd5-847d10726da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:29:06.033355 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 596/1207] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:29:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 22:29:06.057547 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56e59a7-58b3-4efa-8971-4d5d1667fcc4 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:29:06.180078 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56e59a7-58b3-4efa-8971-4d5d1667fcc4 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:29:06.225227 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b4b8e7-3018-4a74-86b0-eb569b2f3e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:29:06.226033 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b4b8e7-3018-4a74-86b0-eb569b2f3e3f None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:29:06.226590 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b4b8e7-3018-4a74-86b0-eb569b2f3e3f None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:29:06.226590 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b4b8e7-3018-4a74-86b0-eb569b2f3e3f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:29:06.238251 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b4b8e7-3018-4a74-86b0-eb569b2f3e3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 22:29:06.246121 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-d2b4b8e7-3018-4a74-86b0-eb569b2f3e3f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 22:29:06.246121 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:29:06.246121 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:29:06.246121 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:29:06.246121 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:29:06.246121 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:29:06.246121 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:29:06.246121 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:29:06.246121 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:29:06.246121 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:29:06.246121 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:29:06.246121 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:29:06.246121 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 22:29:06.246121 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 22:29:06.246121 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 22:29:06.246121 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 22:29:06.247202 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 22:29:06.247202 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 22:29:06.247202 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 22:29:06.247202 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 22:29:06.247202 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:29:06.247202 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:29:06.247202 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:29:06.247202 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:29:06.247202 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:29:06.247202 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:29:06.247202 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:29:06.247202 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:29:06.247202 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:29:06.247202 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:29:06.247202 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:29:06.247202 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:29:06.248093 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:29:06.248093 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:29:06.248093 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:29:06.248093 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:29:06.248093 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 22:29:06.248093 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 22:29:06.248093 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 22:29:06.248093 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 22:29:06.248093 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 22:29:06.248093 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 22:29:06.248093 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 22:29:06.248093 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:29:06.248093 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 612/1208] 10.222.0.36 () {56 vars in 1102 bytes} [Fri Jun 24 22:29:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:29:06.254329 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f99645-ba9c-4778-afd5-847d10726da1 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:29:06.298420 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:29:06.367891 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f99645-ba9c-4778-afd5-847d10726da1 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:29:06.416564 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e908365b-df64-4582-bfbc-6ce5f02097af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:29:06.417239 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e908365b-df64-4582-bfbc-6ce5f02097af None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:29:06.417547 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e908365b-df64-4582-bfbc-6ce5f02097af None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:29:06.417805 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e908365b-df64-4582-bfbc-6ce5f02097af None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:29:06.418562 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e908365b-df64-4582-bfbc-6ce5f02097af None admin] RBAC: Adding query filter params (name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:29:06.418877 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e908365b-df64-4582-bfbc-6ce5f02097af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:29:06.420309 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e908365b-df64-4582-bfbc-6ce5f02097af None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:29:06.440784 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 597/1209] 10.222.0.36 () {56 vars in 1103 bytes} [Fri Jun 24 22:29:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:29:06.442910 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b4b8e7-3018-4a74-86b0-eb569b2f3e3f None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:29:06.496767 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:29:06.553858 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b4b8e7-3018-4a74-86b0-eb569b2f3e3f None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:29:06.594635 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6319852-80ee-4732-8399-8d9db7cf77b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:29:06.595498 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6319852-80ee-4732-8399-8d9db7cf77b1 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:29:06.595786 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6319852-80ee-4732-8399-8d9db7cf77b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:29:06.596063 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6319852-80ee-4732-8399-8d9db7cf77b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:29:06.609833 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6319852-80ee-4732-8399-8d9db7cf77b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:29:06.611391 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6319852-80ee-4732-8399-8d9db7cf77b1 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:29:06.631116 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-d6319852-80ee-4732-8399-8d9db7cf77b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:29:06.631116 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:29:06.631116 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:29:06.631116 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:29:06.631116 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:29:06.631116 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:29:06.631116 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:29:06.631116 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:29:06.631116 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:29:06.631116 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:29:06.631116 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:29:06.631116 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:29:06.631116 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 22:29:06.631116 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 22:29:06.631116 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 22:29:06.632506 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 22:29:06.632506 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:29:06.632506 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:29:06.632506 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:29:06.632506 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:29:06.632506 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:29:06.632506 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:29:06.632506 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:29:06.632506 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:29:06.632506 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:29:06.632506 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:29:06.632506 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:29:06.632506 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:29:06.632506 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:29:06.632506 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:29:06.632506 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:29:06.632506 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:29:06.638722 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 22:29:06.638722 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 22:29:06.638722 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:29:06.638722 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:29:06.638722 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 613/1210] 10.222.0.36 () {56 vars in 1108 bytes} [Fri Jun 24 22:29:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:29:06.640780 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e908365b-df64-4582-bfbc-6ce5f02097af None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:29:06.754683 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:29:06.758225 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e908365b-df64-4582-bfbc-6ce5f02097af None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:29:06.796490 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c421a6-a871-4408-b9b7-cc203c0540f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:29:06.797236 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c421a6-a871-4408-b9b7-cc203c0540f7 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:29:06.797524 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c421a6-a871-4408-b9b7-cc203c0540f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:29:06.797831 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c421a6-a871-4408-b9b7-cc203c0540f7 None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:29:06.798620 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c421a6-a871-4408-b9b7-cc203c0540f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:29:06.798978 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c421a6-a871-4408-b9b7-cc203c0540f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:29:06.800734 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c421a6-a871-4408-b9b7-cc203c0540f7 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:29:06.813610 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 598/1211] 10.222.0.36 () {56 vars in 1109 bytes} [Fri Jun 24 22:29:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:29:06.820055 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6319852-80ee-4732-8399-8d9db7cf77b1 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:29:06.933585 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6319852-80ee-4732-8399-8d9db7cf77b1 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:29:06.935974 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:29:06.972364 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4921b84e-eaf4-4ba5-9836-9365b62ce021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:29:06.973469 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4921b84e-eaf4-4ba5-9836-9365b62ce021 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:29:06.973761 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4921b84e-eaf4-4ba5-9836-9365b62ce021 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:29:06.974036 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4921b84e-eaf4-4ba5-9836-9365b62ce021 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:29:06.983758 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4921b84e-eaf4-4ba5-9836-9365b62ce021 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:29:06.985517 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4921b84e-eaf4-4ba5-9836-9365b62ce021 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:29:07.003149 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-4921b84e-eaf4-4ba5-9836-9365b62ce021 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 24 22:29:07.003149 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:29:07.003149 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:29:07.003149 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:29:07.003149 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:29:07.003149 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:29:07.003149 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:29:07.003149 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:29:07.003149 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:29:07.003149 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:29:07.003149 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:29:07.003149 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:29:07.003149 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 22:29:07.003149 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 22:29:07.003149 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 22:29:07.003149 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 22:29:07.004878 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:29:07.004878 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:29:07.004878 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 22:29:07.004878 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 22:29:07.004878 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 22:29:07.004878 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 22:29:07.004878 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:29:07.004878 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:29:07.004878 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:29:07.004878 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:29:07.004878 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:29:07.004878 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:29:07.004878 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:29:07.004878 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:29:07.004878 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:29:07.004878 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:29:07.004878 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:29:07.004878 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:29:07.005841 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:29:07.005841 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:29:07.005841 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 22:29:07.005841 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 22:29:07.005841 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 22:29:07.005841 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 22:29:07.005841 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 22:29:07.005841 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 22:29:07.005841 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 24 22:29:07.005841 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:29:07.005841 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 614/1212] 10.222.0.36 () {56 vars in 1108 bytes} [Fri Jun 24 22:29:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:29:07.010693 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c421a6-a871-4408-b9b7-cc203c0540f7 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:29:07.131400 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c421a6-a871-4408-b9b7-cc203c0540f7 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:29:07.174889 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c1f1bc-061b-4440-9646-d01638a1dbee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:29:07.175700 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c1f1bc-061b-4440-9646-d01638a1dbee None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:29:07.175985 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c1f1bc-061b-4440-9646-d01638a1dbee None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:29:07.176274 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c1f1bc-061b-4440-9646-d01638a1dbee None admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:29:07.177175 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c1f1bc-061b-4440-9646-d01638a1dbee None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:29:07.177483 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c1f1bc-061b-4440-9646-d01638a1dbee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:29:07.178996 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c1f1bc-061b-4440-9646-d01638a1dbee None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:29:07.205645 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 599/1213] 10.222.0.36 () {56 vars in 1143 bytes} [Fri Jun 24 22:29:07 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:29:07.207209 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4921b84e-eaf4-4ba5-9836-9365b62ce021 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:29:07.316022 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4921b84e-eaf4-4ba5-9836-9365b62ce021 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:29:07.352701 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff825595-3f2c-4403-a76a-e3a00b9b7b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:29:07.353442 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff825595-3f2c-4403-a76a-e3a00b9b7b08 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:29:07.353810 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff825595-3f2c-4403-a76a-e3a00b9b7b08 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:29:07.354125 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff825595-3f2c-4403-a76a-e3a00b9b7b08 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:29:07.386680 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:29:07.430426 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff825595-3f2c-4403-a76a-e3a00b9b7b08 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:29:07.432028 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff825595-3f2c-4403-a76a-e3a00b9b7b08 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:29:07.552134 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 615/1214] 10.222.0.36 () {58 vars in 1282 bytes} [Fri Jun 24 22:29:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 22:29:07.553486 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c1f1bc-061b-4440-9646-d01638a1dbee None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:29:07.579473 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:29:07.670048 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c1f1bc-061b-4440-9646-d01638a1dbee None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:29:07.709081 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e639ecbd-4e4b-4dc0-ab65-d6fd440506fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:29:07.709864 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e639ecbd-4e4b-4dc0-ab65-d6fd440506fe None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:29:07.710146 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e639ecbd-4e4b-4dc0-ab65-d6fd440506fe None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:29:07.710419 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e639ecbd-4e4b-4dc0-ab65-d6fd440506fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:29:07.721151 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e639ecbd-4e4b-4dc0-ab65-d6fd440506fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:29:07.722883 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e639ecbd-4e4b-4dc0-ab65-d6fd440506fe None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:29:07.742294 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-e639ecbd-4e4b-4dc0-ab65-d6fd440506fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:29:07.742294 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:29:07.742294 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:29:07.742294 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:29:07.742294 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:29:07.742294 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:29:07.742294 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:29:07.742294 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:29:07.742294 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:29:07.742294 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:29:07.742294 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:29:07.742294 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:29:07.742294 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 22:29:07.742294 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 22:29:07.742294 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 22:29:07.743446 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 22:29:07.743446 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:29:07.743446 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:29:07.743446 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:29:07.743446 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:29:07.743446 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:29:07.743446 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:29:07.743446 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:29:07.743446 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:29:07.743446 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:29:07.743446 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:29:07.743446 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:29:07.743446 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:29:07.743446 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:29:07.743446 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:29:07.743446 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:29:07.743446 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:29:07.744633 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 22:29:07.744633 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 22:29:07.744633 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:29:07.744633 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:29:07.746382 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 600/1215] 10.222.0.36 () {56 vars in 1108 bytes} [Fri Jun 24 22:29:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:29:07.752743 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff825595-3f2c-4403-a76a-e3a00b9b7b08 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:29:07.823094 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:29:07.867307 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff825595-3f2c-4403-a76a-e3a00b9b7b08 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:29:07.906829 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421a0d0e-81d9-4432-8b78-11a4bd461631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:29:07.907575 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421a0d0e-81d9-4432-8b78-11a4bd461631 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:29:07.907821 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421a0d0e-81d9-4432-8b78-11a4bd461631 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:29:07.908114 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421a0d0e-81d9-4432-8b78-11a4bd461631 None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:29:07.909081 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421a0d0e-81d9-4432-8b78-11a4bd461631 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:29:07.909475 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421a0d0e-81d9-4432-8b78-11a4bd461631 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:29:07.910902 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421a0d0e-81d9-4432-8b78-11a4bd461631 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:29:07.923540 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 616/1216] 10.222.0.36 () {56 vars in 1109 bytes} [Fri Jun 24 22:29:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:29:07.929758 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e639ecbd-4e4b-4dc0-ab65-d6fd440506fe None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:29:08.012069 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:29:08.051592 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e639ecbd-4e4b-4dc0-ab65-d6fd440506fe None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:29:08.092654 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57769250-1b7a-4e85-9453-0649f601b125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:29:08.093456 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57769250-1b7a-4e85-9453-0649f601b125 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:29:08.093750 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57769250-1b7a-4e85-9453-0649f601b125 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:29:08.094011 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57769250-1b7a-4e85-9453-0649f601b125 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:29:08.102901 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57769250-1b7a-4e85-9453-0649f601b125 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:29:08.104401 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57769250-1b7a-4e85-9453-0649f601b125 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:29:08.118473 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-57769250-1b7a-4e85-9453-0649f601b125 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 22:29:08.118473 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:29:08.118473 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:29:08.118473 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:29:08.118473 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:29:08.118473 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:29:08.118473 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:29:08.118473 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:29:08.118473 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:29:08.118473 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:29:08.118473 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:29:08.118473 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:29:08.118473 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 22:29:08.118473 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 22:29:08.118473 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 22:29:08.119388 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 22:29:08.119388 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:29:08.119388 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:29:08.119388 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:29:08.119388 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:29:08.119388 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:29:08.119388 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:29:08.119388 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:29:08.119388 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:29:08.119388 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:29:08.119388 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:29:08.119388 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:29:08.119388 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:29:08.119388 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:29:08.119388 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:29:08.119388 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:29:08.119388 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:29:08.125224 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 22:29:08.125224 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 22:29:08.125224 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 22:29:08.125224 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 22:29:08.125224 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 22:29:08.125224 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 22:29:08.125224 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 22:29:08.125224 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:29:08.125224 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 601/1217] 10.222.0.36 () {56 vars in 1111 bytes} [Fri Jun 24 22:29:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:29:08.127539 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421a0d0e-81d9-4432-8b78-11a4bd461631 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:29:08.254392 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421a0d0e-81d9-4432-8b78-11a4bd461631 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:29:08.280612 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:29:08.293491 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33d95d6-c39d-4753-a85c-9d779203326f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:29:08.294140 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d95d6-c39d-4753-a85c-9d779203326f None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:29:08.294426 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d95d6-c39d-4753-a85c-9d779203326f None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:29:08.294719 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d95d6-c39d-4753-a85c-9d779203326f None admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:29:08.295591 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33d95d6-c39d-4753-a85c-9d779203326f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:29:08.295901 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33d95d6-c39d-4753-a85c-9d779203326f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:29:08.297358 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33d95d6-c39d-4753-a85c-9d779203326f None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:29:08.310515 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 617/1218] 10.222.0.36 () {56 vars in 1148 bytes} [Fri Jun 24 22:29:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:29:08.316780 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57769250-1b7a-4e85-9453-0649f601b125 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:29:08.447219 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57769250-1b7a-4e85-9453-0649f601b125 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:29:08.484200 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:29:08.491131 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6d0fe9-f276-47d5-8fa0-785a483788a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:29:08.492135 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6d0fe9-f276-47d5-8fa0-785a483788a5 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:29:08.492583 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6d0fe9-f276-47d5-8fa0-785a483788a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:29:08.493315 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6d0fe9-f276-47d5-8fa0-785a483788a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:29:08.494336 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6d0fe9-f276-47d5-8fa0-785a483788a5 None admin] RBAC: Adding query filter params (role.id=3265c7c44fb144a0a56467ded2a39413, scope.project.id=d189b31bbec0469381292d2cde3cb420, user.id=0233b357708643be94c0ade17ac1fb3f) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:29:08.496370 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6d0fe9-f276-47d5-8fa0-785a483788a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:29:08.498030 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6d0fe9-f276-47d5-8fa0-785a483788a5 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:29:08.505271 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 602/1219] 10.222.0.36 () {56 vars in 1374 bytes} [Fri Jun 24 22:29:08 2022] GET /identity/v3/role_assignments?user.id=0233b357708643be94c0ade17ac1fb3f&scope.project.id=d189b31bbec0469381292d2cde3cb420&role.id=3265c7c44fb144a0a56467ded2a39413 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:29:10.808845 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1eb932-9435-4bda-a30f-520e4f416433 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:29:10.809372 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1eb932-9435-4bda-a30f-520e4f416433 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:29:10.809372 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1eb932-9435-4bda-a30f-520e4f416433 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:29:10.810807 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 618/1220] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:29:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:29:10.816427 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feb8d5b-b0d0-4e35-b9b4-7a76213402dc None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:29:10.816954 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feb8d5b-b0d0-4e35-b9b4-7a76213402dc None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:29:10.816954 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feb8d5b-b0d0-4e35-b9b4-7a76213402dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:29:10.835346 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-6feb8d5b-b0d0-4e35-b9b4-7a76213402dc None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:29:10.836556 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-6feb8d5b-b0d0-4e35-b9b4-7a76213402dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:29:10.905980 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 603/1221] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:29:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 22:29:10.928542 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1eb932-9435-4bda-a30f-520e4f416433 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:29:11.038522 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1eb932-9435-4bda-a30f-520e4f416433 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:29:11.076016 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa63b5a7-8440-4321-bf06-b1685a3f37b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:29:11.076746 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa63b5a7-8440-4321-bf06-b1685a3f37b7 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:29:11.077025 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa63b5a7-8440-4321-bf06-b1685a3f37b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:29:11.077299 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa63b5a7-8440-4321-bf06-b1685a3f37b7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:29:11.088004 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa63b5a7-8440-4321-bf06-b1685a3f37b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 22:29:11.095663 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-fa63b5a7-8440-4321-bf06-b1685a3f37b7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 22:29:11.095663 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:29:11.095663 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:29:11.095663 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:29:11.095663 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:29:11.095663 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:29:11.095663 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:29:11.095663 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:29:11.095663 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:29:11.095663 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:29:11.095663 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:29:11.095663 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:29:11.095663 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 22:29:11.095663 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 22:29:11.095663 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 22:29:11.095663 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 22:29:11.096732 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 22:29:11.096732 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 22:29:11.096732 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 22:29:11.096732 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 22:29:11.096732 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:29:11.096732 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:29:11.096732 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:29:11.096732 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:29:11.096732 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:29:11.096732 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:29:11.096732 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:29:11.096732 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:29:11.096732 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:29:11.096732 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:29:11.096732 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:29:11.096732 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:29:11.097645 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:29:11.097645 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:29:11.097645 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:29:11.097645 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:29:11.097645 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 22:29:11.097645 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 22:29:11.097645 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 22:29:11.097645 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 22:29:11.097645 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 22:29:11.097645 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 22:29:11.097645 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 22:29:11.097645 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:29:11.097645 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 619/1222] 10.222.0.36 () {56 vars in 1102 bytes} [Fri Jun 24 22:29:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 22:29:11.103623 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feb8d5b-b0d0-4e35-b9b4-7a76213402dc None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:29:11.208722 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feb8d5b-b0d0-4e35-b9b4-7a76213402dc None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:29:11.232234 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:29:11.244190 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0712f3d-0399-4d06-b461-b956bdadb9e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:29:11.244858 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0712f3d-0399-4d06-b461-b956bdadb9e5 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:29:11.245136 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0712f3d-0399-4d06-b461-b956bdadb9e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:29:11.245408 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0712f3d-0399-4d06-b461-b956bdadb9e5 None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:29:11.246151 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0712f3d-0399-4d06-b461-b956bdadb9e5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:29:11.246456 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0712f3d-0399-4d06-b461-b956bdadb9e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:29:11.247939 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0712f3d-0399-4d06-b461-b956bdadb9e5 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:29:11.256439 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 604/1223] 10.222.0.36 () {56 vars in 1103 bytes} [Fri Jun 24 22:29:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 22:29:11.262256 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa63b5a7-8440-4321-bf06-b1685a3f37b7 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:29:11.306414 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:29:11.373621 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa63b5a7-8440-4321-bf06-b1685a3f37b7 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:29:11.408868 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a75b590-0cd4-44c3-8845-d96be2617d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:29:11.409802 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a75b590-0cd4-44c3-8845-d96be2617d58 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:29:11.410106 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a75b590-0cd4-44c3-8845-d96be2617d58 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:29:11.410367 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a75b590-0cd4-44c3-8845-d96be2617d58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:29:11.421278 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a75b590-0cd4-44c3-8845-d96be2617d58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:29:11.422742 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a75b590-0cd4-44c3-8845-d96be2617d58 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:29:11.440375 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-2a75b590-0cd4-44c3-8845-d96be2617d58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:29:11.440375 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:29:11.440375 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:29:11.440375 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:29:11.440375 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:29:11.440375 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:29:11.440375 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:29:11.440375 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:29:11.440375 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:29:11.440375 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:29:11.440375 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:29:11.440375 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:29:11.440375 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 22:29:11.440375 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 22:29:11.440375 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 22:29:11.441287 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 22:29:11.441287 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:29:11.441287 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:29:11.441287 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:29:11.441287 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:29:11.441287 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:29:11.441287 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:29:11.441287 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:29:11.441287 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:29:11.441287 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:29:11.441287 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:29:11.441287 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:29:11.441287 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:29:11.441287 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:29:11.441287 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:29:11.441287 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:29:11.441287 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:29:11.442613 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 22:29:11.442613 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 22:29:11.442613 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:29:11.442613 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:29:11.442613 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 620/1224] 10.222.0.36 () {56 vars in 1108 bytes} [Fri Jun 24 22:29:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:29:11.447805 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0712f3d-0399-4d06-b461-b956bdadb9e5 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:29:11.556467 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0712f3d-0399-4d06-b461-b956bdadb9e5 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:29:11.591940 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a09181-9235-493f-a0c2-7bbd61f47249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:29:11.592606 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a09181-9235-493f-a0c2-7bbd61f47249 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:29:11.592889 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a09181-9235-493f-a0c2-7bbd61f47249 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:29:11.593165 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a09181-9235-493f-a0c2-7bbd61f47249 None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:29:11.593888 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a09181-9235-493f-a0c2-7bbd61f47249 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:29:11.594223 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a09181-9235-493f-a0c2-7bbd61f47249 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:29:11.595633 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a09181-9235-493f-a0c2-7bbd61f47249 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:29:11.607723 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 605/1225] 10.222.0.36 () {56 vars in 1109 bytes} [Fri Jun 24 22:29:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:29:11.613872 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a75b590-0cd4-44c3-8845-d96be2617d58 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:29:11.713215 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:29:11.720256 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a75b590-0cd4-44c3-8845-d96be2617d58 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:29:11.757545 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d537ca-ceb8-4ba5-b126-58ae408e5d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:29:11.758378 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d537ca-ceb8-4ba5-b126-58ae408e5d94 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:29:11.758661 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d537ca-ceb8-4ba5-b126-58ae408e5d94 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:29:11.758938 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d537ca-ceb8-4ba5-b126-58ae408e5d94 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:29:11.766626 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d537ca-ceb8-4ba5-b126-58ae408e5d94 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:29:11.768188 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d537ca-ceb8-4ba5-b126-58ae408e5d94 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:29:11.782881 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-91d537ca-ceb8-4ba5-b126-58ae408e5d94 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 24 22:29:11.782881 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:29:11.782881 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:29:11.782881 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:29:11.782881 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:29:11.782881 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:29:11.782881 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:29:11.782881 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:29:11.782881 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:29:11.782881 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:29:11.782881 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:29:11.782881 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:29:11.782881 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 22:29:11.782881 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 22:29:11.782881 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 22:29:11.782881 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 22:29:11.784445 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:29:11.784445 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:29:11.784445 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 22:29:11.784445 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 22:29:11.784445 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 22:29:11.784445 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 22:29:11.784445 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:29:11.784445 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:29:11.784445 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:29:11.784445 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:29:11.784445 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:29:11.784445 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:29:11.784445 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:29:11.784445 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:29:11.784445 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:29:11.784445 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:29:11.784445 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:29:11.784445 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:29:11.785467 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:29:11.785467 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:29:11.785467 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 22:29:11.785467 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 22:29:11.785467 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 22:29:11.785467 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 22:29:11.785467 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 22:29:11.785467 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 22:29:11.785467 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 24 22:29:11.785467 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:29:11.785467 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 621/1226] 10.222.0.36 () {56 vars in 1108 bytes} [Fri Jun 24 22:29:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:29:11.792478 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a09181-9235-493f-a0c2-7bbd61f47249 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:29:11.848096 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:29:11.911907 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a09181-9235-493f-a0c2-7bbd61f47249 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:29:11.948562 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240e3cb2-478e-4057-a2e0-fe201dcc655e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:29:11.949228 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240e3cb2-478e-4057-a2e0-fe201dcc655e None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:29:11.949503 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240e3cb2-478e-4057-a2e0-fe201dcc655e None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:29:11.949776 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240e3cb2-478e-4057-a2e0-fe201dcc655e None admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:29:11.950599 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240e3cb2-478e-4057-a2e0-fe201dcc655e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:29:11.950905 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240e3cb2-478e-4057-a2e0-fe201dcc655e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:29:11.952613 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240e3cb2-478e-4057-a2e0-fe201dcc655e None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:29:11.973605 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 606/1227] 10.222.0.36 () {56 vars in 1143 bytes} [Fri Jun 24 22:29:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 22:29:11.977939 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d537ca-ceb8-4ba5-b126-58ae408e5d94 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:29:12.080753 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d537ca-ceb8-4ba5-b126-58ae408e5d94 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:29:12.119963 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084d2ba5-6c50-4585-a923-93cefd050a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:29:12.120949 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084d2ba5-6c50-4585-a923-93cefd050a66 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:29:12.121363 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084d2ba5-6c50-4585-a923-93cefd050a66 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:29:12.121722 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084d2ba5-6c50-4585-a923-93cefd050a66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:29:12.133186 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084d2ba5-6c50-4585-a923-93cefd050a66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:29:12.134650 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084d2ba5-6c50-4585-a923-93cefd050a66 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:29:12.155692 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-084d2ba5-6c50-4585-a923-93cefd050a66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:29:12.155692 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:29:12.155692 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:29:12.155692 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:29:12.155692 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:29:12.155692 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:29:12.155692 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:29:12.155692 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:29:12.155692 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:29:12.155692 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:29:12.155692 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:29:12.155692 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:29:12.155692 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 22:29:12.155692 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 22:29:12.155692 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 22:29:12.156879 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 22:29:12.156879 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:29:12.156879 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:29:12.156879 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:29:12.156879 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:29:12.156879 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:29:12.156879 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:29:12.156879 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:29:12.156879 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:29:12.156879 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:29:12.156879 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:29:12.156879 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:29:12.156879 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:29:12.156879 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:29:12.156879 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:29:12.156879 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:29:12.156879 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:29:12.157888 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 22:29:12.157888 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 22:29:12.157888 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:29:12.157888 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:29:12.157888 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 622/1228] 10.222.0.36 () {56 vars in 1108 bytes} [Fri Jun 24 22:29:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:29:12.163558 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240e3cb2-478e-4057-a2e0-fe201dcc655e None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:29:12.281003 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240e3cb2-478e-4057-a2e0-fe201dcc655e None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:29:12.283334 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:29:12.320251 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4310b94b-f474-4934-99ca-ea9693bfada3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:29:12.321015 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4310b94b-f474-4934-99ca-ea9693bfada3 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:29:12.321405 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4310b94b-f474-4934-99ca-ea9693bfada3 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:29:12.321788 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4310b94b-f474-4934-99ca-ea9693bfada3 None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:29:12.322614 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4310b94b-f474-4934-99ca-ea9693bfada3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:29:12.322930 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4310b94b-f474-4934-99ca-ea9693bfada3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:29:12.324613 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4310b94b-f474-4934-99ca-ea9693bfada3 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:29:12.337586 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 607/1229] 10.222.0.36 () {56 vars in 1109 bytes} [Fri Jun 24 22:29:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:29:12.343625 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084d2ba5-6c50-4585-a923-93cefd050a66 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:29:12.355402 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:29:12.467167 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084d2ba5-6c50-4585-a923-93cefd050a66 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:29:12.505309 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea79e533-05e1-4fc4-83c0-e441801b0660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:29:12.506109 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea79e533-05e1-4fc4-83c0-e441801b0660 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:29:12.506388 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea79e533-05e1-4fc4-83c0-e441801b0660 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:29:12.506661 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea79e533-05e1-4fc4-83c0-e441801b0660 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:29:12.514119 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea79e533-05e1-4fc4-83c0-e441801b0660 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:29:12.515725 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea79e533-05e1-4fc4-83c0-e441801b0660 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:29:12.532067 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-ea79e533-05e1-4fc4-83c0-e441801b0660 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 22:29:12.532067 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:29:12.532067 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:29:12.532067 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:29:12.532067 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:29:12.532067 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:29:12.532067 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:29:12.532067 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:29:12.532067 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:29:12.532067 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:29:12.532067 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:29:12.532067 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:29:12.532067 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 22:29:12.532067 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 22:29:12.532067 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 22:29:12.532974 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 22:29:12.532974 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:29:12.532974 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:29:12.532974 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:29:12.532974 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:29:12.532974 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:29:12.532974 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:29:12.532974 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:29:12.532974 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:29:12.532974 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:29:12.532974 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:29:12.532974 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:29:12.532974 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:29:12.532974 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:29:12.532974 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:29:12.532974 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:29:12.532974 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:29:12.534058 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 22:29:12.534058 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 22:29:12.534058 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 22:29:12.534058 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 22:29:12.534058 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 22:29:12.534058 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 22:29:12.534058 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 22:29:12.534058 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:29:12.534058 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 623/1230] 10.222.0.36 () {56 vars in 1111 bytes} [Fri Jun 24 22:29:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:29:12.540262 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4310b94b-f474-4934-99ca-ea9693bfada3 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:29:12.649973 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4310b94b-f474-4934-99ca-ea9693bfada3 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:29:12.686203 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9948c294-6572-4c3c-8293-bfe94f88fcd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:29:12.687164 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9948c294-6572-4c3c-8293-bfe94f88fcd3 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:29:12.687477 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9948c294-6572-4c3c-8293-bfe94f88fcd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:29:12.687797 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9948c294-6572-4c3c-8293-bfe94f88fcd3 None admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:29:12.688622 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9948c294-6572-4c3c-8293-bfe94f88fcd3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:29:12.688932 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9948c294-6572-4c3c-8293-bfe94f88fcd3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:29:12.690410 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9948c294-6572-4c3c-8293-bfe94f88fcd3 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:29:12.702855 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 608/1231] 10.222.0.36 () {56 vars in 1148 bytes} [Fri Jun 24 22:29:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:29:12.709780 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea79e533-05e1-4fc4-83c0-e441801b0660 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:29:12.781540 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:29:12.826471 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea79e533-05e1-4fc4-83c0-e441801b0660 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:29:12.863861 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c9ea92-0396-4710-b6eb-185ef0eff7a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:29:12.864769 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c9ea92-0396-4710-b6eb-185ef0eff7a1 None admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:29:12.865050 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c9ea92-0396-4710-b6eb-185ef0eff7a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:29:12.865327 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c9ea92-0396-4710-b6eb-185ef0eff7a1 None admin] PATH_INFO: `/v3/projects/d189b31bbec0469381292d2cde3cb420/users/0233b357708643be94c0ade17ac1fb3f/roles/3265c7c44fb144a0a56467ded2a39413` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:29:12.880473 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c9ea92-0396-4710-b6eb-185ef0eff7a1 None admin] RBAC: Authorizing `identity:create_grant(project_id=d189b31bbec0469381292d2cde3cb420, user_id=0233b357708643be94c0ade17ac1fb3f, role_id=3265c7c44fb144a0a56467ded2a39413)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:29:12.881970 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c9ea92-0396-4710-b6eb-185ef0eff7a1 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:29:12.896608 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 624/1232] 10.222.0.36 () {58 vars in 1439 bytes} [Fri Jun 24 22:29:12 2022] PUT /identity/v3/projects/d189b31bbec0469381292d2cde3cb420/users/0233b357708643be94c0ade17ac1fb3f/roles/3265c7c44fb144a0a56467ded2a39413 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 22:29:14.901072 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1508f0-b666-4fd3-a70d-903965e9e4e7 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:29:14.901645 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1508f0-b666-4fd3-a70d-903965e9e4e7 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:29:14.901645 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1508f0-b666-4fd3-a70d-903965e9e4e7 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:29:14.903141 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 609/1233] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:29:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:29:14.908477 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1592e703-8f51-4b4c-9bf2-06d2ed8a344c None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:29:14.908978 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1592e703-8f51-4b4c-9bf2-06d2ed8a344c None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:29:14.909057 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1592e703-8f51-4b4c-9bf2-06d2ed8a344c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:29:14.928970 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-1592e703-8f51-4b4c-9bf2-06d2ed8a344c None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:29:14.930179 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-1592e703-8f51-4b4c-9bf2-06d2ed8a344c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:29:15.006561 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 625/1234] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:29:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 22:29:15.031900 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1508f0-b666-4fd3-a70d-903965e9e4e7 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:29:15.058477 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:29:15.137951 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1508f0-b666-4fd3-a70d-903965e9e4e7 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:29:15.178408 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c737443-8b98-43d4-b313-1bff3db1e6ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:29:15.179185 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c737443-8b98-43d4-b313-1bff3db1e6ef None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:29:15.179488 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c737443-8b98-43d4-b313-1bff3db1e6ef None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:29:15.179870 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c737443-8b98-43d4-b313-1bff3db1e6ef None admin] PATH_INFO: `/v3/roles/service` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:29:15.195319 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c737443-8b98-43d4-b313-1bff3db1e6ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 22:29:15.207107 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-1c737443-8b98-43d4-b313-1bff3db1e6ef None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 22:29:15.207107 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:29:15.207107 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:29:15.207107 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:29:15.207107 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:29:15.207107 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:29:15.207107 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:29:15.207107 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:29:15.207107 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:29:15.207107 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:29:15.207107 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:29:15.207107 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:29:15.207107 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 22:29:15.207107 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 22:29:15.207107 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 22:29:15.207107 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 22:29:15.208149 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 22:29:15.208149 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 22:29:15.208149 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 22:29:15.208149 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 22:29:15.208149 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:29:15.208149 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:29:15.208149 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:29:15.208149 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:29:15.208149 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:29:15.208149 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:29:15.208149 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:29:15.208149 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:29:15.208149 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:29:15.208149 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:29:15.208149 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:29:15.208149 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:29:15.208970 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:29:15.208970 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:29:15.208970 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:29:15.208970 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:29:15.208970 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 22:29:15.208970 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 22:29:15.208970 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 22:29:15.208970 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 22:29:15.208970 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 22:29:15.208970 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 22:29:15.208970 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 22:29:15.208970 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:29:15.211424 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 610/1235] 10.222.0.36 () {56 vars in 1102 bytes} [Fri Jun 24 22:29:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:29:15.215690 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1592e703-8f51-4b4c-9bf2-06d2ed8a344c None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:29:15.267902 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:29:15.323435 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1592e703-8f51-4b4c-9bf2-06d2ed8a344c None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:29:15.357621 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7101438-4598-46fa-96f3-3c043c892a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:29:15.358218 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7101438-4598-46fa-96f3-3c043c892a57 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:29:15.358484 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7101438-4598-46fa-96f3-3c043c892a57 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:29:15.358762 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7101438-4598-46fa-96f3-3c043c892a57 None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:29:15.359532 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7101438-4598-46fa-96f3-3c043c892a57 None admin] RBAC: Adding query filter params (name=service) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:29:15.359869 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7101438-4598-46fa-96f3-3c043c892a57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:29:15.361233 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7101438-4598-46fa-96f3-3c043c892a57 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:29:15.370800 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 626/1236] 10.222.0.36 () {56 vars in 1103 bytes} [Fri Jun 24 22:29:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:29:15.376299 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c737443-8b98-43d4-b313-1bff3db1e6ef None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:29:15.465427 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:29:15.483562 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c737443-8b98-43d4-b313-1bff3db1e6ef None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:29:15.521051 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd57f7ee-c2ab-4499-a645-fb5c9572b0c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:29:15.521847 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd57f7ee-c2ab-4499-a645-fb5c9572b0c2 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:29:15.522130 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd57f7ee-c2ab-4499-a645-fb5c9572b0c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:29:15.522405 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd57f7ee-c2ab-4499-a645-fb5c9572b0c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:29:15.534117 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd57f7ee-c2ab-4499-a645-fb5c9572b0c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:29:15.536772 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd57f7ee-c2ab-4499-a645-fb5c9572b0c2 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:29:15.558118 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-fd57f7ee-c2ab-4499-a645-fb5c9572b0c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:29:15.558118 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:29:15.558118 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:29:15.558118 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:29:15.558118 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:29:15.558118 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:29:15.558118 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:29:15.558118 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:29:15.558118 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:29:15.558118 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:29:15.558118 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:29:15.558118 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:29:15.558118 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 22:29:15.558118 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 22:29:15.558118 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 22:29:15.559116 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 22:29:15.559116 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:29:15.559116 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:29:15.559116 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:29:15.559116 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:29:15.559116 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:29:15.559116 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:29:15.559116 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:29:15.559116 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:29:15.559116 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:29:15.559116 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:29:15.559116 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:29:15.559116 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:29:15.559116 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:29:15.559116 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:29:15.559116 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:29:15.559116 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:29:15.560045 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 22:29:15.560045 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 22:29:15.560045 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:29:15.560045 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:29:15.560045 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 611/1237] 10.222.0.36 () {56 vars in 1108 bytes} [Fri Jun 24 22:29:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:29:15.565420 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7101438-4598-46fa-96f3-3c043c892a57 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:29:15.669741 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7101438-4598-46fa-96f3-3c043c892a57 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:29:15.680114 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:29:15.708650 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178e4445-25ad-4c80-bc38-09001bc0b836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:29:15.709242 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e4445-25ad-4c80-bc38-09001bc0b836 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:29:15.709520 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e4445-25ad-4c80-bc38-09001bc0b836 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:29:15.709790 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e4445-25ad-4c80-bc38-09001bc0b836 None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:29:15.710534 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178e4445-25ad-4c80-bc38-09001bc0b836 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:29:15.710835 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178e4445-25ad-4c80-bc38-09001bc0b836 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:29:15.712245 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178e4445-25ad-4c80-bc38-09001bc0b836 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:29:15.724673 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 627/1238] 10.222.0.36 () {56 vars in 1109 bytes} [Fri Jun 24 22:29:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:29:15.730516 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd57f7ee-c2ab-4499-a645-fb5c9572b0c2 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:29:15.850664 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd57f7ee-c2ab-4499-a645-fb5c9572b0c2 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:29:15.887870 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51ae7c9-1af8-40cd-b841-50f3632e3635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:29:15.888799 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ae7c9-1af8-40cd-b841-50f3632e3635 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:29:15.889081 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ae7c9-1af8-40cd-b841-50f3632e3635 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:29:15.889350 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ae7c9-1af8-40cd-b841-50f3632e3635 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:29:15.892376 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:29:15.898341 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51ae7c9-1af8-40cd-b841-50f3632e3635 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:29:15.900303 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51ae7c9-1af8-40cd-b841-50f3632e3635 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:29:15.914845 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-e51ae7c9-1af8-40cd-b841-50f3632e3635 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 24 22:29:15.914845 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:29:15.914845 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:29:15.914845 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:29:15.914845 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:29:15.914845 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:29:15.914845 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:29:15.914845 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:29:15.914845 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:29:15.914845 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:29:15.914845 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:29:15.914845 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:29:15.914845 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 22:29:15.914845 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 22:29:15.914845 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 22:29:15.914845 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 22:29:15.916473 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:29:15.916473 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:29:15.916473 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 22:29:15.916473 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 22:29:15.916473 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 22:29:15.916473 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 22:29:15.916473 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:29:15.916473 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:29:15.916473 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:29:15.916473 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:29:15.916473 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:29:15.916473 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:29:15.916473 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:29:15.916473 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:29:15.916473 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:29:15.916473 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:29:15.916473 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:29:15.916473 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:29:15.917625 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:29:15.917625 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:29:15.917625 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 22:29:15.917625 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 22:29:15.917625 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 22:29:15.917625 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 22:29:15.917625 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 22:29:15.917625 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 22:29:15.917625 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 24 22:29:15.917625 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:29:15.920891 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 612/1239] 10.222.0.36 () {56 vars in 1108 bytes} [Fri Jun 24 22:29:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:29:15.922115 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178e4445-25ad-4c80-bc38-09001bc0b836 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:29:16.037266 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178e4445-25ad-4c80-bc38-09001bc0b836 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:29:16.075127 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f369af-67d0-40a5-9311-5fb0bdf264c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:29:16.075833 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f369af-67d0-40a5-9311-5fb0bdf264c4 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:29:16.076114 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f369af-67d0-40a5-9311-5fb0bdf264c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:29:16.076384 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f369af-67d0-40a5-9311-5fb0bdf264c4 None admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:29:16.077208 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f369af-67d0-40a5-9311-5fb0bdf264c4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:29:16.077515 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f369af-67d0-40a5-9311-5fb0bdf264c4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:29:16.078958 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f369af-67d0-40a5-9311-5fb0bdf264c4 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:29:16.100366 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 628/1240] 10.222.0.36 () {56 vars in 1143 bytes} [Fri Jun 24 22:29:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:29:16.106113 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51ae7c9-1af8-40cd-b841-50f3632e3635 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:29:16.221691 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51ae7c9-1af8-40cd-b841-50f3632e3635 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:29:16.263699 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7121b9b-4f15-4b50-95c3-fd63c36835ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:29:16.264362 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7121b9b-4f15-4b50-95c3-fd63c36835ac None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:29:16.264648 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7121b9b-4f15-4b50-95c3-fd63c36835ac None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:29:16.264924 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7121b9b-4f15-4b50-95c3-fd63c36835ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:29:16.335270 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:29:16.342807 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7121b9b-4f15-4b50-95c3-fd63c36835ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:29:16.344812 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7121b9b-4f15-4b50-95c3-fd63c36835ac None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:29:16.457462 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 613/1241] 10.222.0.36 () {58 vars in 1282 bytes} [Fri Jun 24 22:29:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 22:29:16.463567 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f369af-67d0-40a5-9311-5fb0bdf264c4 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:29:16.496954 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:29:16.578593 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f369af-67d0-40a5-9311-5fb0bdf264c4 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:29:16.614347 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f989ce0c-3267-4813-8b02-28b64e83c17d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:29:16.615213 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f989ce0c-3267-4813-8b02-28b64e83c17d None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:29:16.615525 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f989ce0c-3267-4813-8b02-28b64e83c17d None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:29:16.615814 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f989ce0c-3267-4813-8b02-28b64e83c17d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:29:16.627383 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f989ce0c-3267-4813-8b02-28b64e83c17d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:29:16.629380 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f989ce0c-3267-4813-8b02-28b64e83c17d None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:29:16.647917 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-f989ce0c-3267-4813-8b02-28b64e83c17d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:29:16.647917 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:29:16.647917 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:29:16.647917 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:29:16.647917 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:29:16.647917 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:29:16.647917 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:29:16.647917 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:29:16.647917 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:29:16.647917 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:29:16.647917 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:29:16.647917 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:29:16.647917 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 22:29:16.647917 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 22:29:16.647917 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 22:29:16.649014 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 22:29:16.649014 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:29:16.649014 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:29:16.649014 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:29:16.649014 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:29:16.649014 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:29:16.649014 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:29:16.649014 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:29:16.649014 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:29:16.649014 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:29:16.649014 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:29:16.649014 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:29:16.649014 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:29:16.649014 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:29:16.649014 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:29:16.649014 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:29:16.649014 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:29:16.650016 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 22:29:16.650016 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 22:29:16.650016 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:29:16.650016 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:29:16.650016 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 629/1242] 10.222.0.36 () {56 vars in 1108 bytes} [Fri Jun 24 22:29:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:29:16.655223 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7121b9b-4f15-4b50-95c3-fd63c36835ac None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:29:16.759913 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:29:16.766189 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7121b9b-4f15-4b50-95c3-fd63c36835ac None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:29:16.810049 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccc18cb-e667-484f-ab12-f690f213d6d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:29:16.810912 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccc18cb-e667-484f-ab12-f690f213d6d9 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:29:16.811193 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccc18cb-e667-484f-ab12-f690f213d6d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:29:16.811499 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccc18cb-e667-484f-ab12-f690f213d6d9 None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:29:16.812249 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccc18cb-e667-484f-ab12-f690f213d6d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:29:16.812553 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccc18cb-e667-484f-ab12-f690f213d6d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:29:16.814023 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccc18cb-e667-484f-ab12-f690f213d6d9 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:29:16.826468 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 614/1243] 10.222.0.36 () {56 vars in 1109 bytes} [Fri Jun 24 22:29:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:29:16.832495 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f989ce0c-3267-4813-8b02-28b64e83c17d None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:29:16.919654 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:29:16.949279 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f989ce0c-3267-4813-8b02-28b64e83c17d None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:29:16.986722 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c820ab-413a-4f93-8979-5d59507d296e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:29:16.987724 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c820ab-413a-4f93-8979-5d59507d296e None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:29:16.988005 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c820ab-413a-4f93-8979-5d59507d296e None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:29:16.988274 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c820ab-413a-4f93-8979-5d59507d296e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:29:16.996179 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c820ab-413a-4f93-8979-5d59507d296e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:29:16.998085 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c820ab-413a-4f93-8979-5d59507d296e None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:29:17.013531 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-60c820ab-413a-4f93-8979-5d59507d296e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 22:29:17.013531 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:29:17.013531 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:29:17.013531 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:29:17.013531 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:29:17.013531 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:29:17.013531 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:29:17.013531 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:29:17.013531 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:29:17.013531 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:29:17.013531 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:29:17.013531 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:29:17.013531 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 22:29:17.013531 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 22:29:17.013531 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 22:29:17.014635 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 22:29:17.014635 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:29:17.014635 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:29:17.014635 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:29:17.014635 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:29:17.014635 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:29:17.014635 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:29:17.014635 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:29:17.014635 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:29:17.014635 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:29:17.014635 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:29:17.014635 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:29:17.014635 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:29:17.014635 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:29:17.014635 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:29:17.014635 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:29:17.014635 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:29:17.015779 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 22:29:17.015779 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 22:29:17.015779 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 22:29:17.015779 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 22:29:17.015779 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 22:29:17.015779 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 22:29:17.015779 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 22:29:17.015779 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:29:17.015779 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 630/1244] 10.222.0.36 () {56 vars in 1111 bytes} [Fri Jun 24 22:29:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 22:29:17.021031 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccc18cb-e667-484f-ab12-f690f213d6d9 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:29:17.127843 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccc18cb-e667-484f-ab12-f690f213d6d9 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:29:17.170561 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166880e7-3a2b-4bb3-9d66-ad693f4e08d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:29:17.171529 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166880e7-3a2b-4bb3-9d66-ad693f4e08d3 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:29:17.171913 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166880e7-3a2b-4bb3-9d66-ad693f4e08d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:29:17.172226 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166880e7-3a2b-4bb3-9d66-ad693f4e08d3 None admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:29:17.173162 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166880e7-3a2b-4bb3-9d66-ad693f4e08d3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:29:17.173504 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166880e7-3a2b-4bb3-9d66-ad693f4e08d3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:29:17.175639 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166880e7-3a2b-4bb3-9d66-ad693f4e08d3 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:29:17.191273 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 615/1245] 10.222.0.36 () {56 vars in 1148 bytes} [Fri Jun 24 22:29:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 22:29:17.204491 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c820ab-413a-4f93-8979-5d59507d296e None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:29:17.336077 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c820ab-413a-4f93-8979-5d59507d296e None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:29:17.373573 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa4ecb4-c28b-4779-92ea-f36845d87e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:29:17.374421 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa4ecb4-c28b-4779-92ea-f36845d87e3f None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:29:17.374823 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa4ecb4-c28b-4779-92ea-f36845d87e3f None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:29:17.375124 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa4ecb4-c28b-4779-92ea-f36845d87e3f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:29:17.376110 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa4ecb4-c28b-4779-92ea-f36845d87e3f None admin] RBAC: Adding query filter params (role.id=3265c7c44fb144a0a56467ded2a39413, scope.project.id=d189b31bbec0469381292d2cde3cb420, user.id=0233b357708643be94c0ade17ac1fb3f) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:29:17.376427 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa4ecb4-c28b-4779-92ea-f36845d87e3f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:29:17.378645 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa4ecb4-c28b-4779-92ea-f36845d87e3f None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:29:17.391464 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 631/1246] 10.222.0.36 () {56 vars in 1374 bytes} [Fri Jun 24 22:29:17 2022] GET /identity/v3/role_assignments?user.id=0233b357708643be94c0ade17ac1fb3f&scope.project.id=d189b31bbec0469381292d2cde3cb420&role.id=3265c7c44fb144a0a56467ded2a39413 => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:29:19.525471 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccbd97a-7449-4cd0-8b81-7f1170a93ca4 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:29:19.526026 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccbd97a-7449-4cd0-8b81-7f1170a93ca4 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:29:19.526026 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccbd97a-7449-4cd0-8b81-7f1170a93ca4 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:29:19.527627 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 616/1247] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:29:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:29:19.534462 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48df63c8-9f24-4193-a5d5-568f794de70c None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:29:19.537036 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48df63c8-9f24-4193-a5d5-568f794de70c None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:29:19.537036 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48df63c8-9f24-4193-a5d5-568f794de70c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:29:19.541296 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:29:19.555668 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-48df63c8-9f24-4193-a5d5-568f794de70c None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:29:19.556863 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-48df63c8-9f24-4193-a5d5-568f794de70c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:29:19.629530 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 632/1248] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:29:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 22:29:19.654640 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccbd97a-7449-4cd0-8b81-7f1170a93ca4 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:29:19.673892 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:29:19.774975 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccbd97a-7449-4cd0-8b81-7f1170a93ca4 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:29:19.812476 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b8db60-9e30-4a4b-a29d-7aa1e56fb6f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:29:19.813404 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b8db60-9e30-4a4b-a29d-7aa1e56fb6f1 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:29:19.813763 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b8db60-9e30-4a4b-a29d-7aa1e56fb6f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:29:19.814041 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b8db60-9e30-4a4b-a29d-7aa1e56fb6f1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:29:19.826120 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b8db60-9e30-4a4b-a29d-7aa1e56fb6f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 22:29:19.834046 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-c3b8db60-9e30-4a4b-a29d-7aa1e56fb6f1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 22:29:19.834046 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:29:19.834046 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:29:19.834046 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:29:19.834046 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:29:19.834046 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:29:19.834046 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:29:19.834046 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:29:19.834046 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:29:19.834046 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:29:19.834046 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:29:19.834046 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:29:19.834046 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 22:29:19.834046 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 22:29:19.834046 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 22:29:19.834046 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 22:29:19.835181 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 22:29:19.835181 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 22:29:19.835181 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 22:29:19.835181 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 22:29:19.835181 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:29:19.835181 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:29:19.835181 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:29:19.835181 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:29:19.835181 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:29:19.835181 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:29:19.835181 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:29:19.835181 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:29:19.835181 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:29:19.835181 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:29:19.835181 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:29:19.835181 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:29:19.836295 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:29:19.836295 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:29:19.836295 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:29:19.836295 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:29:19.836295 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 22:29:19.836295 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 22:29:19.836295 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 22:29:19.836295 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 22:29:19.836295 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 22:29:19.836295 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 22:29:19.836295 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 22:29:19.836295 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:29:19.836295 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 617/1249] 10.222.0.36 () {56 vars in 1096 bytes} [Fri Jun 24 22:29:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:29:19.841790 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48df63c8-9f24-4193-a5d5-568f794de70c None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:29:19.958873 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48df63c8-9f24-4193-a5d5-568f794de70c None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:29:19.991389 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:29:19.997340 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c5aee6-87bd-4c79-b82a-db436d99719b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:29:19.998031 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c5aee6-87bd-4c79-b82a-db436d99719b None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:29:19.998310 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c5aee6-87bd-4c79-b82a-db436d99719b None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:29:19.998582 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c5aee6-87bd-4c79-b82a-db436d99719b None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:29:19.999361 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c5aee6-87bd-4c79-b82a-db436d99719b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:29:19.999667 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c5aee6-87bd-4c79-b82a-db436d99719b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:29:20.001058 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c5aee6-87bd-4c79-b82a-db436d99719b None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:29:20.010359 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 633/1250] 10.222.0.36 () {56 vars in 1099 bytes} [Fri Jun 24 22:29:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:29:20.016733 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b8db60-9e30-4a4b-a29d-7aa1e56fb6f1 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:29:20.101936 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:29:20.127557 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b8db60-9e30-4a4b-a29d-7aa1e56fb6f1 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:29:20.166697 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032345eb-0e3e-4bf6-a4b6-8b07e3fa9ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:29:20.167692 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032345eb-0e3e-4bf6-a4b6-8b07e3fa9ae4 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:29:20.167970 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032345eb-0e3e-4bf6-a4b6-8b07e3fa9ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:29:20.168385 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032345eb-0e3e-4bf6-a4b6-8b07e3fa9ae4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:29:20.181439 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032345eb-0e3e-4bf6-a4b6-8b07e3fa9ae4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:29:20.183386 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032345eb-0e3e-4bf6-a4b6-8b07e3fa9ae4 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:29:20.204824 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-032345eb-0e3e-4bf6-a4b6-8b07e3fa9ae4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:29:20.204824 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:29:20.204824 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:29:20.204824 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:29:20.204824 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:29:20.204824 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:29:20.204824 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:29:20.204824 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:29:20.204824 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:29:20.204824 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:29:20.204824 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:29:20.204824 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:29:20.204824 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 22:29:20.204824 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 22:29:20.204824 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 22:29:20.206325 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 22:29:20.206325 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:29:20.206325 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:29:20.206325 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:29:20.206325 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:29:20.206325 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:29:20.206325 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:29:20.206325 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:29:20.206325 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:29:20.206325 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:29:20.206325 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:29:20.206325 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:29:20.206325 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:29:20.206325 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:29:20.206325 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:29:20.206325 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:29:20.206325 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:29:20.208271 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 22:29:20.208271 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 22:29:20.208271 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:29:20.208271 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:29:20.208271 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 618/1251] 10.222.0.36 () {56 vars in 1108 bytes} [Fri Jun 24 22:29:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 22:29:20.212887 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c5aee6-87bd-4c79-b82a-db436d99719b None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:29:20.328401 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c5aee6-87bd-4c79-b82a-db436d99719b None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:29:20.367141 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb2d3eb-d209-4933-a7f5-b355d672e27f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:29:20.367852 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb2d3eb-d209-4933-a7f5-b355d672e27f None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:29:20.368136 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb2d3eb-d209-4933-a7f5-b355d672e27f None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:29:20.368412 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb2d3eb-d209-4933-a7f5-b355d672e27f None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:29:20.369138 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb2d3eb-d209-4933-a7f5-b355d672e27f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:29:20.369442 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb2d3eb-d209-4933-a7f5-b355d672e27f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:29:20.370892 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb2d3eb-d209-4933-a7f5-b355d672e27f None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:29:20.385168 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 634/1252] 10.222.0.36 () {56 vars in 1109 bytes} [Fri Jun 24 22:29:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 22:29:20.391599 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032345eb-0e3e-4bf6-a4b6-8b07e3fa9ae4 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:29:20.508424 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032345eb-0e3e-4bf6-a4b6-8b07e3fa9ae4 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:29:20.537198 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:29:20.545938 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f966022-2663-40b7-b523-2e25f6960a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:29:20.546755 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f966022-2663-40b7-b523-2e25f6960a0c None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:29:20.547040 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f966022-2663-40b7-b523-2e25f6960a0c None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:29:20.547342 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f966022-2663-40b7-b523-2e25f6960a0c None admin] PATH_INFO: `/v3/users/placement` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:29:20.555726 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f966022-2663-40b7-b523-2e25f6960a0c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:29:20.557329 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f966022-2663-40b7-b523-2e25f6960a0c None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:29:20.573652 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-1f966022-2663-40b7-b523-2e25f6960a0c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 24 22:29:20.573652 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:29:20.573652 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:29:20.573652 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:29:20.573652 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:29:20.573652 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:29:20.573652 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:29:20.573652 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:29:20.573652 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:29:20.573652 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:29:20.573652 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:29:20.573652 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:29:20.573652 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 22:29:20.573652 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 22:29:20.573652 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 22:29:20.573652 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 22:29:20.574966 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:29:20.574966 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:29:20.574966 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 22:29:20.574966 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 22:29:20.574966 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 22:29:20.574966 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 22:29:20.574966 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:29:20.574966 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:29:20.574966 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:29:20.574966 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:29:20.574966 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:29:20.574966 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:29:20.574966 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:29:20.574966 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:29:20.574966 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:29:20.574966 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:29:20.574966 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:29:20.574966 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:29:20.575946 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:29:20.575946 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:29:20.575946 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 22:29:20.575946 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 22:29:20.575946 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 22:29:20.575946 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 22:29:20.575946 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 22:29:20.575946 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 22:29:20.575946 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 24 22:29:20.575946 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:29:20.575946 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 619/1253] 10.222.0.36 () {56 vars in 1108 bytes} [Fri Jun 24 22:29:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 22:29:20.581108 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb2d3eb-d209-4933-a7f5-b355d672e27f None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:29:20.644182 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:29:20.692894 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb2d3eb-d209-4933-a7f5-b355d672e27f None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:29:20.739441 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8409cc08-7143-4cf4-b0b8-1052541cb0c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:29:20.740233 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8409cc08-7143-4cf4-b0b8-1052541cb0c8 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:29:20.740588 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8409cc08-7143-4cf4-b0b8-1052541cb0c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:29:20.740874 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8409cc08-7143-4cf4-b0b8-1052541cb0c8 None admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:29:20.741786 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8409cc08-7143-4cf4-b0b8-1052541cb0c8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:29:20.742127 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8409cc08-7143-4cf4-b0b8-1052541cb0c8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:29:20.743597 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8409cc08-7143-4cf4-b0b8-1052541cb0c8 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:29:20.766119 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 635/1254] 10.222.0.36 () {56 vars in 1143 bytes} [Fri Jun 24 22:29:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:29:20.772221 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f966022-2663-40b7-b523-2e25f6960a0c None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:29:20.886356 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f966022-2663-40b7-b523-2e25f6960a0c None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:29:20.922123 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2047cd-9dda-4d3c-a93d-9762f9782d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:29:20.922694 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2047cd-9dda-4d3c-a93d-9762f9782d66 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:29:20.922972 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2047cd-9dda-4d3c-a93d-9762f9782d66 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:29:20.923281 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2047cd-9dda-4d3c-a93d-9762f9782d66 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:29:20.988202 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:29:21.002585 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2047cd-9dda-4d3c-a93d-9762f9782d66 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:29:21.004418 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2047cd-9dda-4d3c-a93d-9762f9782d66 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:29:21.119939 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 620/1255] 10.222.0.36 () {58 vars in 1282 bytes} [Fri Jun 24 22:29:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 22:29:21.126170 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8409cc08-7143-4cf4-b0b8-1052541cb0c8 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:29:21.250009 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8409cc08-7143-4cf4-b0b8-1052541cb0c8 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:29:21.266298 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:29:21.292504 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faa773c-eeaf-476b-9cc8-ee0f8fe16798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:29:21.293428 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faa773c-eeaf-476b-9cc8-ee0f8fe16798 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:29:21.293720 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faa773c-eeaf-476b-9cc8-ee0f8fe16798 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:29:21.294045 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faa773c-eeaf-476b-9cc8-ee0f8fe16798 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:29:21.306682 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faa773c-eeaf-476b-9cc8-ee0f8fe16798 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:29:21.308488 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faa773c-eeaf-476b-9cc8-ee0f8fe16798 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:29:21.328731 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-4faa773c-eeaf-476b-9cc8-ee0f8fe16798 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:29:21.328731 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:29:21.328731 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:29:21.328731 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:29:21.328731 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:29:21.328731 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:29:21.328731 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:29:21.328731 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:29:21.328731 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:29:21.328731 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:29:21.328731 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:29:21.328731 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:29:21.328731 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 22:29:21.328731 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 22:29:21.328731 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 22:29:21.329777 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 22:29:21.329777 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:29:21.329777 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:29:21.329777 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:29:21.329777 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:29:21.329777 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:29:21.329777 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:29:21.329777 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:29:21.329777 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:29:21.329777 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:29:21.329777 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:29:21.329777 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:29:21.329777 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:29:21.329777 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:29:21.329777 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:29:21.329777 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:29:21.329777 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:29:21.330704 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 22:29:21.330704 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 22:29:21.330704 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:29:21.330704 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:29:21.331592 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 636/1256] 10.222.0.36 () {56 vars in 1108 bytes} [Fri Jun 24 22:29:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:29:21.338272 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2047cd-9dda-4d3c-a93d-9762f9782d66 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:29:21.432927 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:29:21.446275 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2047cd-9dda-4d3c-a93d-9762f9782d66 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:29:21.482470 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce757cc-b57e-4e04-8471-dbfd8c1227e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:29:21.483353 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce757cc-b57e-4e04-8471-dbfd8c1227e4 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:29:21.483681 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce757cc-b57e-4e04-8471-dbfd8c1227e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:29:21.483999 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce757cc-b57e-4e04-8471-dbfd8c1227e4 None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:29:21.485016 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce757cc-b57e-4e04-8471-dbfd8c1227e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:29:21.485446 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce757cc-b57e-4e04-8471-dbfd8c1227e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:29:21.487563 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce757cc-b57e-4e04-8471-dbfd8c1227e4 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:29:21.503038 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 621/1257] 10.222.0.36 () {56 vars in 1109 bytes} [Fri Jun 24 22:29:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:29:21.509209 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faa773c-eeaf-476b-9cc8-ee0f8fe16798 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:29:21.616244 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faa773c-eeaf-476b-9cc8-ee0f8fe16798 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:29:21.655736 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae51a2f-abcd-4ac7-b1cb-d7ac4b6fe896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:29:21.656616 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae51a2f-abcd-4ac7-b1cb-d7ac4b6fe896 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:29:21.656967 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae51a2f-abcd-4ac7-b1cb-d7ac4b6fe896 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:29:21.657273 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae51a2f-abcd-4ac7-b1cb-d7ac4b6fe896 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:29:21.665864 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae51a2f-abcd-4ac7-b1cb-d7ac4b6fe896 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:29:21.667613 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae51a2f-abcd-4ac7-b1cb-d7ac4b6fe896 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:29:21.682924 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-fae51a2f-abcd-4ac7-b1cb-d7ac4b6fe896 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 22:29:21.682924 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:29:21.682924 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:29:21.682924 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:29:21.682924 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:29:21.682924 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:29:21.682924 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:29:21.682924 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:29:21.682924 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:29:21.682924 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:29:21.682924 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:29:21.682924 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:29:21.682924 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 22:29:21.682924 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 22:29:21.682924 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 22:29:21.683928 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 22:29:21.683928 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:29:21.683928 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:29:21.683928 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:29:21.683928 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:29:21.683928 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:29:21.683928 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:29:21.683928 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:29:21.683928 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:29:21.683928 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:29:21.683928 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:29:21.683928 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:29:21.683928 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:29:21.683928 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:29:21.683928 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:29:21.683928 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:29:21.683928 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:29:21.684799 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 22:29:21.684799 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 22:29:21.684799 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 22:29:21.684799 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 22:29:21.684799 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 22:29:21.684799 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 22:29:21.684799 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 22:29:21.684799 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:29:21.684799 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 637/1258] 10.222.0.36 () {56 vars in 1111 bytes} [Fri Jun 24 22:29:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:29:21.690808 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce757cc-b57e-4e04-8471-dbfd8c1227e4 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:29:21.795305 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce757cc-b57e-4e04-8471-dbfd8c1227e4 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:29:21.838616 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4826b87-affe-406e-9661-9a39b0f30ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:29:21.839289 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4826b87-affe-406e-9661-9a39b0f30ad0 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:29:21.839575 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4826b87-affe-406e-9661-9a39b0f30ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:29:21.839850 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4826b87-affe-406e-9661-9a39b0f30ad0 None admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:29:21.840642 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4826b87-affe-406e-9661-9a39b0f30ad0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:29:21.840947 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4826b87-affe-406e-9661-9a39b0f30ad0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:29:21.842494 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4826b87-affe-406e-9661-9a39b0f30ad0 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:29:21.855757 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 622/1259] 10.222.0.36 () {56 vars in 1148 bytes} [Fri Jun 24 22:29:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:29:21.862907 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae51a2f-abcd-4ac7-b1cb-d7ac4b6fe896 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:29:21.893500 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:29:21.981972 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae51a2f-abcd-4ac7-b1cb-d7ac4b6fe896 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:29:22.020692 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd833be-8fad-4425-a3ac-292ba918b8d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:29:22.021379 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd833be-8fad-4425-a3ac-292ba918b8d1 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:29:22.021669 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd833be-8fad-4425-a3ac-292ba918b8d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:29:22.021942 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd833be-8fad-4425-a3ac-292ba918b8d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:29:22.022807 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd833be-8fad-4425-a3ac-292ba918b8d1 None admin] RBAC: Adding query filter params (role.id=1a1c43cc97a0407eb7a7c7a1333a9d4a, scope.project.id=d189b31bbec0469381292d2cde3cb420, user.id=0233b357708643be94c0ade17ac1fb3f) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:29:22.023085 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd833be-8fad-4425-a3ac-292ba918b8d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:29:22.024585 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd833be-8fad-4425-a3ac-292ba918b8d1 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:29:22.030266 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 638/1260] 10.222.0.36 () {56 vars in 1374 bytes} [Fri Jun 24 22:29:21 2022] GET /identity/v3/role_assignments?user.id=0233b357708643be94c0ade17ac1fb3f&scope.project.id=d189b31bbec0469381292d2cde3cb420&role.id=1a1c43cc97a0407eb7a7c7a1333a9d4a => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 22:29:24.023233 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a068b895-83a2-43bc-9888-0fef163869cd None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:29:24.023865 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a068b895-83a2-43bc-9888-0fef163869cd None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:29:24.023865 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a068b895-83a2-43bc-9888-0fef163869cd None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:29:24.025180 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 623/1261] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:29:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:29:24.031062 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc0fa9b-bbfb-41fd-95a6-9031f702d2d8 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:29:24.031516 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc0fa9b-bbfb-41fd-95a6-9031f702d2d8 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:29:24.031655 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc0fa9b-bbfb-41fd-95a6-9031f702d2d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:29:24.049980 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-0bc0fa9b-bbfb-41fd-95a6-9031f702d2d8 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:29:24.051222 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-0bc0fa9b-bbfb-41fd-95a6-9031f702d2d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:29:24.120776 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 639/1262] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:29:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 22:29:24.146844 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a068b895-83a2-43bc-9888-0fef163869cd None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:29:24.158164 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:29:24.262972 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a068b895-83a2-43bc-9888-0fef163869cd None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:29:24.297020 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514a0d88-df46-4421-8618-6a690cfe80e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:29:24.297747 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514a0d88-df46-4421-8618-6a690cfe80e8 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:29:24.298025 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514a0d88-df46-4421-8618-6a690cfe80e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:29:24.298281 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514a0d88-df46-4421-8618-6a690cfe80e8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:29:24.309566 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514a0d88-df46-4421-8618-6a690cfe80e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 22:29:24.317186 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-514a0d88-df46-4421-8618-6a690cfe80e8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 22:29:24.317186 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:29:24.317186 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:29:24.317186 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:29:24.317186 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:29:24.317186 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:29:24.317186 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:29:24.317186 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:29:24.317186 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:29:24.317186 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:29:24.317186 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:29:24.317186 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:29:24.317186 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 22:29:24.317186 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 22:29:24.317186 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 22:29:24.317186 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 22:29:24.318260 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 22:29:24.318260 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 22:29:24.318260 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 22:29:24.318260 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 22:29:24.318260 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:29:24.318260 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:29:24.318260 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:29:24.318260 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:29:24.318260 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:29:24.318260 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:29:24.318260 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:29:24.318260 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:29:24.318260 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:29:24.318260 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:29:24.318260 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:29:24.318260 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:29:24.319289 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:29:24.319289 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:29:24.319289 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:29:24.319289 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:29:24.319289 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 22:29:24.319289 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 22:29:24.319289 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 22:29:24.319289 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 22:29:24.319289 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 22:29:24.319289 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 22:29:24.319289 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 22:29:24.319289 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:29:24.319289 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 624/1263] 10.222.0.36 () {56 vars in 1096 bytes} [Fri Jun 24 22:29:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:29:24.327715 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc0fa9b-bbfb-41fd-95a6-9031f702d2d8 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:29:24.350115 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:29:24.439016 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc0fa9b-bbfb-41fd-95a6-9031f702d2d8 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:29:24.476317 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca0a6f1-cda0-4896-ae51-41d91cafd403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:29:24.476987 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca0a6f1-cda0-4896-ae51-41d91cafd403 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:29:24.477269 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca0a6f1-cda0-4896-ae51-41d91cafd403 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:29:24.477540 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca0a6f1-cda0-4896-ae51-41d91cafd403 None admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:29:24.478269 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca0a6f1-cda0-4896-ae51-41d91cafd403 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:29:24.478571 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca0a6f1-cda0-4896-ae51-41d91cafd403 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:29:24.479990 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca0a6f1-cda0-4896-ae51-41d91cafd403 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:29:24.488323 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 640/1264] 10.222.0.36 () {56 vars in 1099 bytes} [Fri Jun 24 22:29:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:29:24.494977 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514a0d88-df46-4421-8618-6a690cfe80e8 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:29:24.562823 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:29:24.596878 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514a0d88-df46-4421-8618-6a690cfe80e8 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:29:24.632242 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dae9d29-911a-4879-8fbc-1a2ffbeba836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:29:24.633017 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dae9d29-911a-4879-8fbc-1a2ffbeba836 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:29:24.633297 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dae9d29-911a-4879-8fbc-1a2ffbeba836 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:29:24.633573 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dae9d29-911a-4879-8fbc-1a2ffbeba836 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:29:24.646203 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dae9d29-911a-4879-8fbc-1a2ffbeba836 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:29:24.647688 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dae9d29-911a-4879-8fbc-1a2ffbeba836 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:29:24.665273 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-8dae9d29-911a-4879-8fbc-1a2ffbeba836 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:29:24.665273 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:29:24.665273 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:29:24.665273 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:29:24.665273 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:29:24.665273 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:29:24.665273 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:29:24.665273 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:29:24.665273 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:29:24.665273 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:29:24.665273 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:29:24.665273 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:29:24.665273 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 22:29:24.665273 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 22:29:24.665273 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 22:29:24.666391 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 22:29:24.666391 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:29:24.666391 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:29:24.666391 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:29:24.666391 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:29:24.666391 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:29:24.666391 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:29:24.666391 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:29:24.666391 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:29:24.666391 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:29:24.666391 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:29:24.666391 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:29:24.666391 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:29:24.666391 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:29:24.666391 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:29:24.666391 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:29:24.666391 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:29:24.667563 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 22:29:24.667563 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 22:29:24.667563 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:29:24.667563 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:29:24.667563 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 625/1265] 10.222.0.36 () {56 vars in 1108 bytes} [Fri Jun 24 22:29:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:29:24.672524 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca0a6f1-cda0-4896-ae51-41d91cafd403 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:29:24.758530 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:29:24.777443 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca0a6f1-cda0-4896-ae51-41d91cafd403 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:29:24.811210 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484ee25c-4793-4044-b90d-6e24c806e17c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:29:24.811882 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484ee25c-4793-4044-b90d-6e24c806e17c None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:29:24.812143 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484ee25c-4793-4044-b90d-6e24c806e17c None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:29:24.812410 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484ee25c-4793-4044-b90d-6e24c806e17c None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:29:24.813183 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484ee25c-4793-4044-b90d-6e24c806e17c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:29:24.813420 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484ee25c-4793-4044-b90d-6e24c806e17c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:29:24.814872 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484ee25c-4793-4044-b90d-6e24c806e17c None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:29:24.826201 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 641/1266] 10.222.0.36 () {56 vars in 1109 bytes} [Fri Jun 24 22:29:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:29:24.832204 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dae9d29-911a-4879-8fbc-1a2ffbeba836 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:29:24.944106 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dae9d29-911a-4879-8fbc-1a2ffbeba836 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:29:24.968399 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:29:24.991626 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e0e28f-8291-4d32-9ad6-3eef38ee64d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:29:24.992829 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e0e28f-8291-4d32-9ad6-3eef38ee64d9 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:29:24.993249 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e0e28f-8291-4d32-9ad6-3eef38ee64d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:29:24.993639 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e0e28f-8291-4d32-9ad6-3eef38ee64d9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:29:25.005311 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e0e28f-8291-4d32-9ad6-3eef38ee64d9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:29:25.006765 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e0e28f-8291-4d32-9ad6-3eef38ee64d9 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:29:25.022134 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-87e0e28f-8291-4d32-9ad6-3eef38ee64d9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 24 22:29:25.022134 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:29:25.022134 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:29:25.022134 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:29:25.022134 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:29:25.022134 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:29:25.022134 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:29:25.022134 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:29:25.022134 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:29:25.022134 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:29:25.022134 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:29:25.022134 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:29:25.022134 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 22:29:25.022134 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 22:29:25.022134 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 22:29:25.022134 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 22:29:25.023174 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:29:25.023174 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:29:25.023174 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 22:29:25.023174 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 22:29:25.023174 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 22:29:25.023174 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 22:29:25.023174 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:29:25.023174 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:29:25.023174 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:29:25.023174 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:29:25.023174 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:29:25.023174 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:29:25.023174 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:29:25.023174 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:29:25.023174 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:29:25.023174 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:29:25.023174 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:29:25.023174 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:29:25.024805 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:29:25.024805 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:29:25.024805 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 22:29:25.024805 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 22:29:25.024805 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 22:29:25.024805 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 22:29:25.024805 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 22:29:25.024805 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 22:29:25.024805 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 24 22:29:25.024805 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:29:25.024805 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 626/1267] 10.222.0.36 () {56 vars in 1108 bytes} [Fri Jun 24 22:29:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:29:25.029837 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484ee25c-4793-4044-b90d-6e24c806e17c None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:29:25.140488 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484ee25c-4793-4044-b90d-6e24c806e17c None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:29:25.179354 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b1aad2-2c3a-45eb-b47a-ee5c04f5119a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:29:25.180066 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b1aad2-2c3a-45eb-b47a-ee5c04f5119a None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:29:25.180313 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b1aad2-2c3a-45eb-b47a-ee5c04f5119a None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:29:25.180591 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b1aad2-2c3a-45eb-b47a-ee5c04f5119a None admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:29:25.181430 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b1aad2-2c3a-45eb-b47a-ee5c04f5119a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:29:25.181742 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b1aad2-2c3a-45eb-b47a-ee5c04f5119a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:29:25.183200 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b1aad2-2c3a-45eb-b47a-ee5c04f5119a None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:29:25.193619 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:29:25.207026 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 642/1268] 10.222.0.36 () {56 vars in 1143 bytes} [Fri Jun 24 22:29:25 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:29:25.215309 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e0e28f-8291-4d32-9ad6-3eef38ee64d9 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:29:25.320858 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e0e28f-8291-4d32-9ad6-3eef38ee64d9 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:29:25.356877 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e035089b-491c-46ab-87b9-408430f59d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:29:25.357659 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e035089b-491c-46ab-87b9-408430f59d5a None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:29:25.357939 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e035089b-491c-46ab-87b9-408430f59d5a None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:29:25.358207 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e035089b-491c-46ab-87b9-408430f59d5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:29:25.369949 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e035089b-491c-46ab-87b9-408430f59d5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:29:25.371428 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e035089b-491c-46ab-87b9-408430f59d5a None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:29:25.389289 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-e035089b-491c-46ab-87b9-408430f59d5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:29:25.389289 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:29:25.389289 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:29:25.389289 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:29:25.389289 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:29:25.389289 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:29:25.389289 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:29:25.389289 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:29:25.389289 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:29:25.389289 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:29:25.389289 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:29:25.389289 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:29:25.389289 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 22:29:25.389289 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 22:29:25.389289 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 22:29:25.390301 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 22:29:25.390301 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:29:25.390301 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:29:25.390301 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:29:25.390301 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:29:25.390301 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:29:25.390301 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:29:25.390301 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:29:25.390301 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:29:25.390301 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:29:25.390301 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:29:25.390301 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:29:25.390301 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:29:25.390301 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:29:25.390301 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:29:25.390301 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:29:25.390301 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:29:25.391369 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 22:29:25.391369 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 22:29:25.391369 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:29:25.391369 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:29:25.391369 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 627/1269] 10.222.0.36 () {56 vars in 1108 bytes} [Fri Jun 24 22:29:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:29:25.397068 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b1aad2-2c3a-45eb-b47a-ee5c04f5119a None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:29:25.508606 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b1aad2-2c3a-45eb-b47a-ee5c04f5119a None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:29:25.544099 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecccfad-415c-41df-9a52-b4ac0872a94b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:29:25.544759 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecccfad-415c-41df-9a52-b4ac0872a94b None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:29:25.545044 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecccfad-415c-41df-9a52-b4ac0872a94b None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:29:25.545319 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecccfad-415c-41df-9a52-b4ac0872a94b None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:29:25.546043 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecccfad-415c-41df-9a52-b4ac0872a94b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:29:25.546356 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecccfad-415c-41df-9a52-b4ac0872a94b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:29:25.547840 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecccfad-415c-41df-9a52-b4ac0872a94b None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:29:25.559162 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 643/1270] 10.222.0.36 () {56 vars in 1109 bytes} [Fri Jun 24 22:29:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:29:25.567032 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e035089b-491c-46ab-87b9-408430f59d5a None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:29:25.599898 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:29:25.671837 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e035089b-491c-46ab-87b9-408430f59d5a None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:29:25.722955 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55edef50-d8d8-4a41-b551-da55f1d69c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:29:25.724061 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55edef50-d8d8-4a41-b551-da55f1d69c1a None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:29:25.724349 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55edef50-d8d8-4a41-b551-da55f1d69c1a None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:29:25.724628 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55edef50-d8d8-4a41-b551-da55f1d69c1a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:29:25.735211 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55edef50-d8d8-4a41-b551-da55f1d69c1a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:29:25.737883 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55edef50-d8d8-4a41-b551-da55f1d69c1a None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:29:25.758203 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-55edef50-d8d8-4a41-b551-da55f1d69c1a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 22:29:25.758203 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:29:25.758203 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:29:25.758203 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:29:25.758203 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:29:25.758203 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:29:25.758203 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:29:25.758203 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:29:25.758203 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:29:25.758203 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:29:25.758203 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:29:25.758203 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:29:25.758203 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 22:29:25.758203 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 22:29:25.758203 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 22:29:25.759205 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 22:29:25.759205 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:29:25.759205 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:29:25.759205 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:29:25.759205 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:29:25.759205 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:29:25.759205 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:29:25.759205 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:29:25.759205 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:29:25.759205 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:29:25.759205 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:29:25.759205 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:29:25.759205 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:29:25.759205 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:29:25.759205 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:29:25.759205 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:29:25.759205 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:29:25.760157 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 22:29:25.760157 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 22:29:25.760157 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 22:29:25.760157 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 22:29:25.760157 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 22:29:25.760157 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 22:29:25.760157 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 22:29:25.760157 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:29:25.760157 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 628/1271] 10.222.0.36 () {56 vars in 1111 bytes} [Fri Jun 24 22:29:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:29:25.767994 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecccfad-415c-41df-9a52-b4ac0872a94b None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:29:25.835813 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:29:25.882766 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecccfad-415c-41df-9a52-b4ac0872a94b None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:29:25.918744 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cfb0cd-0c5c-4b41-ba07-c59444ebc6de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:29:25.919510 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cfb0cd-0c5c-4b41-ba07-c59444ebc6de None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:29:25.919790 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cfb0cd-0c5c-4b41-ba07-c59444ebc6de None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:29:25.920061 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cfb0cd-0c5c-4b41-ba07-c59444ebc6de None admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:29:25.920838 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cfb0cd-0c5c-4b41-ba07-c59444ebc6de None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:29:25.921150 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cfb0cd-0c5c-4b41-ba07-c59444ebc6de None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:29:25.922648 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cfb0cd-0c5c-4b41-ba07-c59444ebc6de None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:29:25.934870 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 644/1272] 10.222.0.36 () {56 vars in 1148 bytes} [Fri Jun 24 22:29:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:29:25.943884 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55edef50-d8d8-4a41-b551-da55f1d69c1a None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:29:26.048268 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:29:26.059547 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55edef50-d8d8-4a41-b551-da55f1d69c1a None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:29:26.097992 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80f5318-1bd4-4358-97b6-5c389dcb894f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:29:26.098873 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80f5318-1bd4-4358-97b6-5c389dcb894f None admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:29:26.099154 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80f5318-1bd4-4358-97b6-5c389dcb894f None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:29:26.099471 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80f5318-1bd4-4358-97b6-5c389dcb894f None admin] PATH_INFO: `/v3/projects/d189b31bbec0469381292d2cde3cb420/users/0233b357708643be94c0ade17ac1fb3f/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:29:26.101673 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80f5318-1bd4-4358-97b6-5c389dcb894f None admin] RBAC: Authorizing `identity:create_grant(project_id=d189b31bbec0469381292d2cde3cb420, user_id=0233b357708643be94c0ade17ac1fb3f, role_id=1a1c43cc97a0407eb7a7c7a1333a9d4a)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:29:26.103115 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80f5318-1bd4-4358-97b6-5c389dcb894f None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:29:26.118873 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 629/1273] 10.222.0.36 () {58 vars in 1439 bytes} [Fri Jun 24 22:29:25 2022] PUT /identity/v3/projects/d189b31bbec0469381292d2cde3cb420/users/0233b357708643be94c0ade17ac1fb3f/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:29:28.253364 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8f7415-a399-4dc9-aff1-0f358b3fe94a None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:29:28.254019 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8f7415-a399-4dc9-aff1-0f358b3fe94a None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:29:28.254019 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8f7415-a399-4dc9-aff1-0f358b3fe94a None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:29:28.255440 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 645/1274] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:29:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:29:28.261959 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c73cb-89ea-4f97-9bb8-9f2e8da6337f None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:29:28.262435 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c73cb-89ea-4f97-9bb8-9f2e8da6337f None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:29:28.262642 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c73cb-89ea-4f97-9bb8-9f2e8da6337f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:29:28.281098 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-473c73cb-89ea-4f97-9bb8-9f2e8da6337f None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:29:28.282284 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-473c73cb-89ea-4f97-9bb8-9f2e8da6337f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:29:28.364389 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 630/1275] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:29:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 22:29:28.398068 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8f7415-a399-4dc9-aff1-0f358b3fe94a None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:29:28.533321 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8f7415-a399-4dc9-aff1-0f358b3fe94a None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:29:28.550588 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:29:28.573804 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd7e600-927b-4347-9a54-07426b973a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:29:28.574598 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd7e600-927b-4347-9a54-07426b973a36 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:29:28.574885 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd7e600-927b-4347-9a54-07426b973a36 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:29:28.575163 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd7e600-927b-4347-9a54-07426b973a36 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:29:28.586010 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd7e600-927b-4347-9a54-07426b973a36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 22:29:28.593539 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-8cd7e600-927b-4347-9a54-07426b973a36 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 22:29:28.593539 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:29:28.593539 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:29:28.593539 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:29:28.593539 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:29:28.593539 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:29:28.593539 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:29:28.593539 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:29:28.593539 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:29:28.593539 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:29:28.593539 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:29:28.593539 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:29:28.593539 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 22:29:28.593539 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 22:29:28.593539 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 22:29:28.593539 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 22:29:28.594628 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 22:29:28.594628 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 22:29:28.594628 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 22:29:28.594628 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 22:29:28.594628 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:29:28.594628 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:29:28.594628 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:29:28.594628 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:29:28.594628 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:29:28.594628 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:29:28.594628 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:29:28.594628 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:29:28.594628 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:29:28.594628 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:29:28.594628 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:29:28.594628 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:29:28.595693 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:29:28.595693 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:29:28.595693 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:29:28.595693 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:29:28.595693 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 22:29:28.595693 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 22:29:28.595693 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 22:29:28.595693 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 22:29:28.595693 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 22:29:28.595693 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 22:29:28.595693 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 22:29:28.595693 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:29:28.595693 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 646/1276] 10.222.0.36 () {56 vars in 1096 bytes} [Fri Jun 24 22:29:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:29:28.603422 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473c73cb-89ea-4f97-9bb8-9f2e8da6337f None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:29:28.701332 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:29:28.725733 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473c73cb-89ea-4f97-9bb8-9f2e8da6337f None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:29:28.760462 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317b6272-fb5a-47cf-be18-89bb9f21e7ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:29:28.761127 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b6272-fb5a-47cf-be18-89bb9f21e7ca None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:29:28.761424 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b6272-fb5a-47cf-be18-89bb9f21e7ca None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:29:28.761678 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b6272-fb5a-47cf-be18-89bb9f21e7ca None admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:29:28.762445 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317b6272-fb5a-47cf-be18-89bb9f21e7ca None admin] RBAC: Adding query filter params (name=admin) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:29:28.762727 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317b6272-fb5a-47cf-be18-89bb9f21e7ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:29:28.764128 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317b6272-fb5a-47cf-be18-89bb9f21e7ca None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:29:28.773155 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 631/1277] 10.222.0.36 () {56 vars in 1099 bytes} [Fri Jun 24 22:29:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:29:28.782235 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd7e600-927b-4347-9a54-07426b973a36 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:29:28.889836 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd7e600-927b-4347-9a54-07426b973a36 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:29:28.928452 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e314a47d-83f1-47a0-b5b8-82f397e97fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:29:28.929265 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e314a47d-83f1-47a0-b5b8-82f397e97fac None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:29:28.929546 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e314a47d-83f1-47a0-b5b8-82f397e97fac None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:29:28.929822 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e314a47d-83f1-47a0-b5b8-82f397e97fac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:29:28.941037 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e314a47d-83f1-47a0-b5b8-82f397e97fac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:29:28.942507 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e314a47d-83f1-47a0-b5b8-82f397e97fac None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:29:28.959834 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-e314a47d-83f1-47a0-b5b8-82f397e97fac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:29:28.959834 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:29:28.959834 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:29:28.959834 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:29:28.959834 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:29:28.959834 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:29:28.959834 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:29:28.959834 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:29:28.959834 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:29:28.959834 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:29:28.959834 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:29:28.959834 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:29:28.959834 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 22:29:28.959834 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 22:29:28.959834 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 22:29:28.960838 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 22:29:28.960838 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:29:28.960838 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:29:28.960838 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:29:28.960838 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:29:28.960838 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:29:28.960838 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:29:28.960838 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:29:28.960838 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:29:28.960838 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:29:28.960838 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:29:28.960838 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:29:28.960838 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:29:28.960838 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:29:28.960838 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:29:28.960838 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:29:28.960838 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:29:28.961747 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 22:29:28.961747 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 22:29:28.961747 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:29:28.961747 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:29:28.961747 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 647/1278] 10.222.0.36 () {56 vars in 1108 bytes} [Fri Jun 24 22:29:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:29:28.967076 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317b6272-fb5a-47cf-be18-89bb9f21e7ca None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:29:29.074451 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317b6272-fb5a-47cf-be18-89bb9f21e7ca None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:29:29.109515 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cac20b7-4b90-4e60-8bb5-2d0b36bbe3c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:29:29.110155 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac20b7-4b90-4e60-8bb5-2d0b36bbe3c2 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:29:29.110428 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac20b7-4b90-4e60-8bb5-2d0b36bbe3c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:29:29.110700 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac20b7-4b90-4e60-8bb5-2d0b36bbe3c2 None admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:29:29.111486 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cac20b7-4b90-4e60-8bb5-2d0b36bbe3c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:29:29.111780 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cac20b7-4b90-4e60-8bb5-2d0b36bbe3c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:29:29.113126 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cac20b7-4b90-4e60-8bb5-2d0b36bbe3c2 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:29:29.125165 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 632/1279] 10.222.0.36 () {56 vars in 1109 bytes} [Fri Jun 24 22:29:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:29:29.131721 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e314a47d-83f1-47a0-b5b8-82f397e97fac None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:29:29.163896 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:29:29.255966 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e314a47d-83f1-47a0-b5b8-82f397e97fac None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:29:29.291394 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd6ae69-6d44-4c1f-93fb-de71d9f370a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:29:29.292186 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd6ae69-6d44-4c1f-93fb-de71d9f370a9 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:29:29.292463 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd6ae69-6d44-4c1f-93fb-de71d9f370a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:29:29.292732 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd6ae69-6d44-4c1f-93fb-de71d9f370a9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:29:29.300426 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd6ae69-6d44-4c1f-93fb-de71d9f370a9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:29:29.301873 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd6ae69-6d44-4c1f-93fb-de71d9f370a9 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:29:29.316363 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-abd6ae69-6d44-4c1f-93fb-de71d9f370a9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 24 22:29:29.316363 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:29:29.316363 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:29:29.316363 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:29:29.316363 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:29:29.316363 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:29:29.316363 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:29:29.316363 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:29:29.316363 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:29:29.316363 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:29:29.316363 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:29:29.316363 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:29:29.316363 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 22:29:29.316363 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 22:29:29.316363 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 22:29:29.316363 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 22:29:29.317341 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:29:29.317341 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:29:29.317341 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 22:29:29.317341 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 22:29:29.317341 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 22:29:29.317341 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 22:29:29.317341 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:29:29.317341 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:29:29.317341 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:29:29.317341 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:29:29.317341 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:29:29.317341 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:29:29.317341 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:29:29.317341 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:29:29.317341 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:29:29.317341 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:29:29.317341 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:29:29.317341 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:29:29.318590 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:29:29.318590 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:29:29.318590 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 22:29:29.318590 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 22:29:29.318590 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 22:29:29.318590 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 22:29:29.318590 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 22:29:29.318590 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 22:29:29.318590 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 24 22:29:29.318590 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:29:29.318590 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 648/1280] 10.222.0.36 () {56 vars in 1108 bytes} [Fri Jun 24 22:29:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:29:29.329214 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cac20b7-4b90-4e60-8bb5-2d0b36bbe3c2 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:29:29.333827 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:29:29.438275 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cac20b7-4b90-4e60-8bb5-2d0b36bbe3c2 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:29:29.476519 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca7d81d-cc4c-4409-a95b-e7e5e2629e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:29:29.477183 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca7d81d-cc4c-4409-a95b-e7e5e2629e55 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:29:29.477465 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca7d81d-cc4c-4409-a95b-e7e5e2629e55 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:29:29.477738 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca7d81d-cc4c-4409-a95b-e7e5e2629e55 None admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:29:29.478564 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca7d81d-cc4c-4409-a95b-e7e5e2629e55 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:29:29.478873 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca7d81d-cc4c-4409-a95b-e7e5e2629e55 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:29:29.480355 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca7d81d-cc4c-4409-a95b-e7e5e2629e55 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:29:29.497397 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 633/1281] 10.222.0.36 () {56 vars in 1143 bytes} [Fri Jun 24 22:29:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:29:29.503899 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd6ae69-6d44-4c1f-93fb-de71d9f370a9 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:29:29.595809 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:29:29.606191 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd6ae69-6d44-4c1f-93fb-de71d9f370a9 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:29:29.641164 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d9278b-5958-4e16-b184-7a565e9de280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:29:29.641800 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d9278b-5958-4e16-b184-7a565e9de280 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:29:29.642084 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d9278b-5958-4e16-b184-7a565e9de280 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:29:29.642388 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d9278b-5958-4e16-b184-7a565e9de280 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:29:29.710718 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d9278b-5958-4e16-b184-7a565e9de280 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:29:29.712137 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d9278b-5958-4e16-b184-7a565e9de280 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:29:29.807999 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:29:29.820079 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 649/1282] 10.222.0.36 () {58 vars in 1282 bytes} [Fri Jun 24 22:29:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 24 22:29:29.826297 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca7d81d-cc4c-4409-a95b-e7e5e2629e55 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:29:29.902555 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:29:29.947433 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca7d81d-cc4c-4409-a95b-e7e5e2629e55 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:29:29.984843 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6619328f-df26-4ce0-9866-3a786570cf7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:29:29.985558 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6619328f-df26-4ce0-9866-3a786570cf7e None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:29:29.985836 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6619328f-df26-4ce0-9866-3a786570cf7e None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:29:29.986298 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6619328f-df26-4ce0-9866-3a786570cf7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:29:29.996657 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6619328f-df26-4ce0-9866-3a786570cf7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:29:29.998089 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6619328f-df26-4ce0-9866-3a786570cf7e None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:29:30.016144 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-6619328f-df26-4ce0-9866-3a786570cf7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:29:30.016144 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:29:30.016144 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:29:30.016144 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:29:30.016144 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:29:30.016144 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:29:30.016144 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:29:30.016144 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:29:30.016144 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:29:30.016144 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:29:30.016144 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:29:30.016144 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:29:30.016144 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 22:29:30.016144 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 22:29:30.016144 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 22:29:30.017142 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 22:29:30.017142 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:29:30.017142 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:29:30.017142 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:29:30.017142 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:29:30.017142 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:29:30.017142 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:29:30.017142 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:29:30.017142 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:29:30.017142 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:29:30.017142 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:29:30.017142 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:29:30.017142 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:29:30.017142 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:29:30.017142 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:29:30.017142 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:29:30.017142 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:29:30.023062 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 22:29:30.023062 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 22:29:30.023062 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 22:29:30.023062 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:29:30.023062 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 634/1283] 10.222.0.36 () {56 vars in 1108 bytes} [Fri Jun 24 22:29:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:29:30.023672 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d9278b-5958-4e16-b184-7a565e9de280 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:29:30.130126 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d9278b-5958-4e16-b184-7a565e9de280 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:29:30.165492 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e545a3ec-4278-4b63-ba53-7281c9b41545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:29:30.166146 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e545a3ec-4278-4b63-ba53-7281c9b41545 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:29:30.166423 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e545a3ec-4278-4b63-ba53-7281c9b41545 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:29:30.166695 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e545a3ec-4278-4b63-ba53-7281c9b41545 None admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:29:30.167447 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e545a3ec-4278-4b63-ba53-7281c9b41545 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:29:30.167759 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e545a3ec-4278-4b63-ba53-7281c9b41545 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:29:30.169108 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e545a3ec-4278-4b63-ba53-7281c9b41545 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:29:30.182113 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 650/1284] 10.222.0.36 () {56 vars in 1109 bytes} [Fri Jun 24 22:29:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:29:30.190163 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6619328f-df26-4ce0-9866-3a786570cf7e None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:29:30.309597 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6619328f-df26-4ce0-9866-3a786570cf7e None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:29:30.325377 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:29:30.350276 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97e56bf-4ab6-4bdf-b0e7-ac6708b82408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:29:30.351061 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97e56bf-4ab6-4bdf-b0e7-ac6708b82408 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:29:30.351382 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97e56bf-4ab6-4bdf-b0e7-ac6708b82408 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:29:30.351649 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97e56bf-4ab6-4bdf-b0e7-ac6708b82408 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:29:30.358549 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97e56bf-4ab6-4bdf-b0e7-ac6708b82408 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:29:30.360033 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97e56bf-4ab6-4bdf-b0e7-ac6708b82408 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:29:30.374220 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-a97e56bf-4ab6-4bdf-b0e7-ac6708b82408 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 22:29:30.374220 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:29:30.374220 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:29:30.374220 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:29:30.374220 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:29:30.374220 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:29:30.374220 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:29:30.374220 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:29:30.374220 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:29:30.374220 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:29:30.374220 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:29:30.374220 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:29:30.374220 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 22:29:30.374220 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 22:29:30.374220 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 22:29:30.375239 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 22:29:30.375239 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:29:30.375239 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:29:30.375239 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:29:30.375239 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:29:30.375239 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:29:30.375239 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:29:30.375239 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:29:30.375239 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 22:29:30.375239 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:29:30.375239 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:29:30.375239 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:29:30.375239 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:29:30.375239 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:29:30.375239 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:29:30.375239 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:29:30.375239 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:29:30.376207 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 22:29:30.376207 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 22:29:30.376207 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 22:29:30.376207 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 22:29:30.376207 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 22:29:30.376207 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 22:29:30.376207 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 22:29:30.376207 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 22:29:30.376207 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 635/1285] 10.222.0.36 () {56 vars in 1111 bytes} [Fri Jun 24 22:29:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:29:30.381929 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e545a3ec-4278-4b63-ba53-7281c9b41545 None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:29:30.440843 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:29:30.499987 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e545a3ec-4278-4b63-ba53-7281c9b41545 None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:29:30.537150 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95f0230-4cc6-42aa-af97-3630c9ebd9ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:29:30.537914 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95f0230-4cc6-42aa-af97-3630c9ebd9ef None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:29:30.538193 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95f0230-4cc6-42aa-af97-3630c9ebd9ef None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:29:30.538490 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95f0230-4cc6-42aa-af97-3630c9ebd9ef None admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:29:30.539295 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95f0230-4cc6-42aa-af97-3630c9ebd9ef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:29:30.539605 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95f0230-4cc6-42aa-af97-3630c9ebd9ef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:29:30.541063 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95f0230-4cc6-42aa-af97-3630c9ebd9ef None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:29:30.560188 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 651/1286] 10.222.0.36 () {56 vars in 1148 bytes} [Fri Jun 24 22:29:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:29:30.566556 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97e56bf-4ab6-4bdf-b0e7-ac6708b82408 None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:29:30.670234 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97e56bf-4ab6-4bdf-b0e7-ac6708b82408 None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:29:30.704826 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f7a073-10a3-4b23-ad33-08f2100c275a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:29:30.705596 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f7a073-10a3-4b23-ad33-08f2100c275a None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:29:30.705877 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f7a073-10a3-4b23-ad33-08f2100c275a None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:29:30.706153 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f7a073-10a3-4b23-ad33-08f2100c275a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:29:30.706955 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f7a073-10a3-4b23-ad33-08f2100c275a None admin] RBAC: Adding query filter params (role.id=1a1c43cc97a0407eb7a7c7a1333a9d4a, scope.project.id=d189b31bbec0469381292d2cde3cb420, user.id=0233b357708643be94c0ade17ac1fb3f) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:29:30.707297 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f7a073-10a3-4b23-ad33-08f2100c275a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:29:30.708769 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f7a073-10a3-4b23-ad33-08f2100c275a None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:29:30.714616 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 636/1287] 10.222.0.36 () {56 vars in 1374 bytes} [Fri Jun 24 22:29:30 2022] GET /identity/v3/role_assignments?user.id=0233b357708643be94c0ade17ac1fb3f&scope.project.id=d189b31bbec0469381292d2cde3cb420&role.id=1a1c43cc97a0407eb7a7c7a1333a9d4a => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 22:29:32.725936 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a94c9c-6613-4986-9224-f1c374008c6f None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:29:32.726777 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a94c9c-6613-4986-9224-f1c374008c6f None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:29:32.726777 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a94c9c-6613-4986-9224-f1c374008c6f None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:29:32.728892 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 652/1288] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:29:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:29:32.737182 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca64c5a5-4fd0-454f-b1b8-089a24a2ea23 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:29:32.737586 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca64c5a5-4fd0-454f-b1b8-089a24a2ea23 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:29:32.737732 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca64c5a5-4fd0-454f-b1b8-089a24a2ea23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:29:32.757409 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-ca64c5a5-4fd0-454f-b1b8-089a24a2ea23 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:29:32.758586 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-ca64c5a5-4fd0-454f-b1b8-089a24a2ea23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:29:32.792310 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:29:32.836912 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 637/1289] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:29:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 22:29:32.868365 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a94c9c-6613-4986-9224-f1c374008c6f None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:29:32.974344 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a94c9c-6613-4986-9224-f1c374008c6f None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:29:32.985044 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:29:33.010131 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d28c8d2-bd87-4069-9c5b-fa1b4e74d53a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:29:33.010904 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d28c8d2-bd87-4069-9c5b-fa1b4e74d53a None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:29:33.011183 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d28c8d2-bd87-4069-9c5b-fa1b4e74d53a None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:29:33.011468 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d28c8d2-bd87-4069-9c5b-fa1b4e74d53a None admin] PATH_INFO: `/v3/services/placement` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:29:33.012113 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d28c8d2-bd87-4069-9c5b-fa1b4e74d53a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:29:33.013490 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d28c8d2-bd87-4069-9c5b-fa1b4e74d53a None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:29:33.025496 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-8d28c8d2-bd87-4069-9c5b-fa1b4e74d53a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 24 22:29:33.025496 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:29:33.025496 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 22:29:33.025496 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 22:29:33.025496 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 22:29:33.025496 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 22:29:33.025496 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 22:29:33.025496 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 22:29:33.025496 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 24 22:29:33.025496 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:29:33.025496 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 22:29:33.025496 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:29:33.025496 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:29:33.025496 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:29:33.025496 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:29:33.025496 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:29:33.025496 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:29:33.026623 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:29:33.026623 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:29:33.026623 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:29:33.026623 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:29:33.026623 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:29:33.026623 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:29:33.026623 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 22:29:33.026623 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 22:29:33.026623 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 22:29:33.026623 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 22:29:33.026623 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:29:33.026623 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:29:33.026623 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:29:33.026623 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:29:33.026623 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:29:33.026623 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:29:33.027587 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:29:33.027587 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:29:33.027587 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:29:33.027587 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:29:33.027587 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:29:33.027587 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:29:33.027587 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:29:33.027587 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:29:33.027587 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:29:33.027587 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:29:33.027587 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 22:29:33.027587 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 22:29:33.027587 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 24 22:29:33.027587 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:29:33.027587 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 653/1290] 10.222.0.36 () {56 vars in 1117 bytes} [Fri Jun 24 22:29:32 2022] GET /identity/v3/services/placement => generated 90 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:29:33.032799 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca64c5a5-4fd0-454f-b1b8-089a24a2ea23 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:29:33.138167 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca64c5a5-4fd0-454f-b1b8-089a24a2ea23 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:29:33.173313 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e836358c-5941-4aff-b890-b20d3161a69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:29:33.173988 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e836358c-5941-4aff-b890-b20d3161a69f None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:29:33.174445 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e836358c-5941-4aff-b890-b20d3161a69f None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:29:33.174729 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e836358c-5941-4aff-b890-b20d3161a69f None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:29:33.175465 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e836358c-5941-4aff-b890-b20d3161a69f None admin] RBAC: Adding query filter params (name=placement) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:29:33.175782 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e836358c-5941-4aff-b890-b20d3161a69f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:29:33.177155 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e836358c-5941-4aff-b890-b20d3161a69f None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:29:33.182419 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 638/1291] 10.222.0.36 () {56 vars in 1116 bytes} [Fri Jun 24 22:29:33 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 22:29:33.190968 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d28c8d2-bd87-4069-9c5b-fa1b4e74d53a None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:29:33.302647 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d28c8d2-bd87-4069-9c5b-fa1b4e74d53a None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:29:33.341256 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef95ac1-247a-4514-8733-045c144d7772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:29:33.341918 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef95ac1-247a-4514-8733-045c144d7772 None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:29:33.342195 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef95ac1-247a-4514-8733-045c144d7772 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:29:33.342469 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef95ac1-247a-4514-8733-045c144d7772 None admin] PATH_INFO: `/v3/services` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:29:33.343174 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef95ac1-247a-4514-8733-045c144d7772 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:29:33.343512 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef95ac1-247a-4514-8733-045c144d7772 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:29:33.344900 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef95ac1-247a-4514-8733-045c144d7772 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:29:33.349791 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 654/1292] 10.222.0.36 () {56 vars in 1116 bytes} [Fri Jun 24 22:29:33 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:29:35.344002 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f15e236-0761-4aaf-8857-7ce12502f1cc None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:29:35.344926 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f15e236-0761-4aaf-8857-7ce12502f1cc None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:29:35.344926 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f15e236-0761-4aaf-8857-7ce12502f1cc None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:29:35.346872 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 639/1293] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:29:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:29:35.354832 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04492577-8c5b-459d-91a3-29db083e5c5e None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:29:35.355660 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04492577-8c5b-459d-91a3-29db083e5c5e None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:29:35.355816 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04492577-8c5b-459d-91a3-29db083e5c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:29:35.385671 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-04492577-8c5b-459d-91a3-29db083e5c5e None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:29:35.386861 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-04492577-8c5b-459d-91a3-29db083e5c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:29:35.418957 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:29:35.458133 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 655/1294] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:29:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 22:29:35.481477 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f15e236-0761-4aaf-8857-7ce12502f1cc None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:29:35.518300 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:29:35.596531 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f15e236-0761-4aaf-8857-7ce12502f1cc None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:29:35.633956 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4aa0d1-5984-4043-9e91-40e9ac4782aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:29:35.634611 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4aa0d1-5984-4043-9e91-40e9ac4782aa None admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:29:35.634892 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4aa0d1-5984-4043-9e91-40e9ac4782aa None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:29:35.635164 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4aa0d1-5984-4043-9e91-40e9ac4782aa None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:29:35.635939 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4aa0d1-5984-4043-9e91-40e9ac4782aa None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:29:35.637314 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4aa0d1-5984-4043-9e91-40e9ac4782aa None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:29:35.654154 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 640/1295] 10.222.0.36 () {60 vars in 1141 bytes} [Fri Jun 24 22:29:35 2022] POST /identity/v3/services => generated 246 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:29:37.653941 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce55d66-dcee-4e15-8acd-73eed5a6b323 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:29:37.654517 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce55d66-dcee-4e15-8acd-73eed5a6b323 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:29:37.654517 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce55d66-dcee-4e15-8acd-73eed5a6b323 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:29:37.655891 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 656/1296] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:29:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:29:37.662179 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c4de85-c275-4a2f-8aa1-43da5ec68389 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:29:37.662897 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c4de85-c275-4a2f-8aa1-43da5ec68389 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:29:37.663052 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c4de85-c275-4a2f-8aa1-43da5ec68389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:29:37.691427 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-c8c4de85-c275-4a2f-8aa1-43da5ec68389 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:29:37.692549 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-c8c4de85-c275-4a2f-8aa1-43da5ec68389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:29:37.771478 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 641/1297] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:29:37 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 22:29:37.800118 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce55d66-dcee-4e15-8acd-73eed5a6b323 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:29:37.902604 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce55d66-dcee-4e15-8acd-73eed5a6b323 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:29:37.935208 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c9b838-42cb-402d-9b9f-27d70642d43a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:29:37.936026 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c9b838-42cb-402d-9b9f-27d70642d43a None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:29:37.936308 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c9b838-42cb-402d-9b9f-27d70642d43a None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:29:37.936579 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c9b838-42cb-402d-9b9f-27d70642d43a None admin] PATH_INFO: `/v3/services/placement` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:29:37.937268 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c9b838-42cb-402d-9b9f-27d70642d43a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:29:37.938609 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c9b838-42cb-402d-9b9f-27d70642d43a None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:29:37.950097 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-b8c9b838-42cb-402d-9b9f-27d70642d43a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 24 22:29:37.950097 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:29:37.950097 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 22:29:37.950097 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 22:29:37.950097 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 22:29:37.950097 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 22:29:37.950097 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 22:29:37.950097 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 22:29:37.950097 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 24 22:29:37.950097 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:29:37.950097 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 22:29:37.950097 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:29:37.950097 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:29:37.950097 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:29:37.950097 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:29:37.950097 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:29:37.950097 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:29:37.951174 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:29:37.951174 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:29:37.951174 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:29:37.951174 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:29:37.951174 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:29:37.951174 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:29:37.951174 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 22:29:37.951174 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 22:29:37.951174 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 22:29:37.951174 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 22:29:37.951174 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:29:37.951174 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:29:37.951174 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:29:37.951174 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:29:37.951174 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:29:37.951174 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:29:37.952189 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:29:37.952189 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:29:37.952189 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:29:37.952189 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:29:37.952189 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:29:37.952189 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:29:37.952189 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:29:37.952189 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:29:37.952189 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:29:37.952189 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:29:37.952189 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 22:29:37.952189 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 22:29:37.952189 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 24 22:29:37.952189 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:29:37.955474 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 657/1298] 10.222.0.36 () {56 vars in 1117 bytes} [Fri Jun 24 22:29:37 2022] GET /identity/v3/services/placement => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:29:37.958343 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c4de85-c275-4a2f-8aa1-43da5ec68389 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:29:37.988922 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:29:38.073007 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c4de85-c275-4a2f-8aa1-43da5ec68389 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:29:38.108857 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5debf8b-861a-43c6-9850-408c04b8c3de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:29:38.109484 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5debf8b-861a-43c6-9850-408c04b8c3de None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:29:38.109760 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5debf8b-861a-43c6-9850-408c04b8c3de None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:29:38.110031 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5debf8b-861a-43c6-9850-408c04b8c3de None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:29:38.110729 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5debf8b-861a-43c6-9850-408c04b8c3de None admin] RBAC: Adding query filter params (name=placement) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:29:38.111199 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5debf8b-861a-43c6-9850-408c04b8c3de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:29:38.112468 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5debf8b-861a-43c6-9850-408c04b8c3de None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:29:38.117600 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 642/1299] 10.222.0.36 () {56 vars in 1116 bytes} [Fri Jun 24 22:29:37 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:29:38.123925 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c9b838-42cb-402d-9b9f-27d70642d43a None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:29:38.158202 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:29:38.240318 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c9b838-42cb-402d-9b9f-27d70642d43a None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:29:38.284306 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0539004c-3b13-4808-ac2c-35f1f094be3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:29:38.284954 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0539004c-3b13-4808-ac2c-35f1f094be3b None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:29:38.285235 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0539004c-3b13-4808-ac2c-35f1f094be3b None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:29:38.285509 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0539004c-3b13-4808-ac2c-35f1f094be3b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:29:38.286297 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0539004c-3b13-4808-ac2c-35f1f094be3b None admin] RBAC: Adding query filter params (interface=public, service_id=a82244dd10814f28a70ff6ba870c1b42, region_id=RegionOne) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:29:38.286609 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0539004c-3b13-4808-ac2c-35f1f094be3b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:29:38.288052 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0539004c-3b13-4808-ac2c-35f1f094be3b None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:29:38.293185 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 658/1300] 10.222.0.36 () {56 vars in 1251 bytes} [Fri Jun 24 22:29:38 2022] GET /identity/v3/endpoints?service_id=a82244dd10814f28a70ff6ba870c1b42&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 22:29:38.299536 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5debf8b-861a-43c6-9850-408c04b8c3de None admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:29:38.385990 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:29:38.407393 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5debf8b-861a-43c6-9850-408c04b8c3de None admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:29:38.441738 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbd710c-7362-4fa8-a43d-436c50e1f685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:29:38.442412 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd710c-7362-4fa8-a43d-436c50e1f685 None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:29:38.442695 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd710c-7362-4fa8-a43d-436c50e1f685 None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:29:38.442968 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd710c-7362-4fa8-a43d-436c50e1f685 None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:29:38.443689 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbd710c-7362-4fa8-a43d-436c50e1f685 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:29:38.445080 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbd710c-7362-4fa8-a43d-436c50e1f685 None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:29:38.452532 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 643/1301] 10.222.0.36 () {56 vars in 1087 bytes} [Fri Jun 24 22:29:38 2022] GET /identity/v3/services => generated 2191 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:29:40.469290 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ef32cf-fa7d-4c81-bbc9-aed1bc9f9057 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:29:40.469829 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ef32cf-fa7d-4c81-bbc9-aed1bc9f9057 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:29:40.469829 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ef32cf-fa7d-4c81-bbc9-aed1bc9f9057 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:29:40.471413 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 659/1302] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:29:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:29:40.477759 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbf614e-86bc-411f-b8b2-9ddba1f2e6dc None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:29:40.478538 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbf614e-86bc-411f-b8b2-9ddba1f2e6dc None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:29:40.478686 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbf614e-86bc-411f-b8b2-9ddba1f2e6dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:29:40.506779 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-ddbf614e-86bc-411f-b8b2-9ddba1f2e6dc None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:29:40.508004 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-ddbf614e-86bc-411f-b8b2-9ddba1f2e6dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:29:40.586556 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 644/1303] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:29:40 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 22:29:40.609756 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ef32cf-fa7d-4c81-bbc9-aed1bc9f9057 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:29:40.716450 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:29:40.724087 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ef32cf-fa7d-4c81-bbc9-aed1bc9f9057 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:29:40.761788 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac880964-bf57-4e0e-9bf8-35abcda98b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:29:40.762582 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac880964-bf57-4e0e-9bf8-35abcda98b2a None admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:29:40.762865 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac880964-bf57-4e0e-9bf8-35abcda98b2a None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:29:40.763138 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac880964-bf57-4e0e-9bf8-35abcda98b2a None admin] PATH_INFO: `/v3/services/placement` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:29:40.763818 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac880964-bf57-4e0e-9bf8-35abcda98b2a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:29:40.765203 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac880964-bf57-4e0e-9bf8-35abcda98b2a None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:29:40.777534 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-ac880964-bf57-4e0e-9bf8-35abcda98b2a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 24 22:29:40.777534 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:29:40.777534 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 22:29:40.777534 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 22:29:40.777534 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 22:29:40.777534 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 22:29:40.777534 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 22:29:40.777534 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 22:29:40.777534 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 24 22:29:40.777534 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:29:40.777534 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 22:29:40.777534 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:29:40.777534 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 22:29:40.777534 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 22:29:40.777534 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 22:29:40.777534 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 22:29:40.777534 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 22:29:40.778629 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 22:29:40.778629 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 22:29:40.778629 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 22:29:40.778629 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 22:29:40.778629 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 22:29:40.778629 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 22:29:40.778629 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 22:29:40.778629 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 22:29:40.778629 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 22:29:40.778629 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 22:29:40.778629 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 22:29:40.778629 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 22:29:40.778629 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 22:29:40.778629 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 22:29:40.778629 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 22:29:40.778629 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 22:29:40.779990 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 22:29:40.779990 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 22:29:40.779990 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 22:29:40.779990 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 22:29:40.779990 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 22:29:40.779990 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 22:29:40.779990 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 22:29:40.779990 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 22:29:40.779990 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 22:29:40.779990 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 22:29:40.779990 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 22:29:40.779990 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 22:29:40.779990 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 24 22:29:40.779990 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 22:29:40.779990 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 660/1304] 10.222.0.36 () {56 vars in 1117 bytes} [Fri Jun 24 22:29:40 2022] GET /identity/v3/services/placement => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 22:29:40.786406 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbf614e-86bc-411f-b8b2-9ddba1f2e6dc None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:29:40.874228 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:29:40.898888 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbf614e-86bc-411f-b8b2-9ddba1f2e6dc None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:29:40.932654 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b294068-507f-47ba-9f3d-80f802f6bf9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:29:40.933299 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b294068-507f-47ba-9f3d-80f802f6bf9a None admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:29:40.933574 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b294068-507f-47ba-9f3d-80f802f6bf9a None admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:29:40.933846 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b294068-507f-47ba-9f3d-80f802f6bf9a None admin] PATH_INFO: `/v3/services` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:29:40.934544 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b294068-507f-47ba-9f3d-80f802f6bf9a None admin] RBAC: Adding query filter params (name=placement) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:29:40.934851 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b294068-507f-47ba-9f3d-80f802f6bf9a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:29:40.936336 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b294068-507f-47ba-9f3d-80f802f6bf9a None admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:29:40.941599 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 645/1305] 10.222.0.36 () {56 vars in 1116 bytes} [Fri Jun 24 22:29:40 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:29:40.947468 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac880964-bf57-4e0e-9bf8-35abcda98b2a None admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:29:41.065673 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac880964-bf57-4e0e-9bf8-35abcda98b2a None admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:29:41.099979 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c98352-8608-41b9-b92e-6459b1033442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:29:41.100622 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c98352-8608-41b9-b92e-6459b1033442 None admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:29:41.100904 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c98352-8608-41b9-b92e-6459b1033442 None admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:29:41.101181 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c98352-8608-41b9-b92e-6459b1033442 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:29:41.101912 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c98352-8608-41b9-b92e-6459b1033442 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:29:41.103303 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c98352-8608-41b9-b92e-6459b1033442 None admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:29:41.125116 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 661/1306] 10.222.0.36 () {60 vars in 1144 bytes} [Fri Jun 24 22:29:40 2022] POST /identity/v3/endpoints => generated 331 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:29:50.939514 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=30 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:29:51.120604 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:30:44.560667 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d55951b-611a-47ad-a168-29a3618095fa None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:30:44.561219 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d55951b-611a-47ad-a168-29a3618095fa None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:30:44.561219 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d55951b-611a-47ad-a168-29a3618095fa None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:30:44.567350 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 646/1307] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:30:44 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:30:44.569066 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97318afa-8c88-4ece-aa6d-54780d3b2896 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:30:44.570084 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97318afa-8c88-4ece-aa6d-54780d3b2896 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:30:44.570558 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97318afa-8c88-4ece-aa6d-54780d3b2896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:30:44.687588 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-97318afa-8c88-4ece-aa6d-54780d3b2896 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:30:44.688902 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-97318afa-8c88-4ece-aa6d-54780d3b2896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:30:44.815897 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 662/1308] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:30:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:30:44.867356 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d52866-63fc-4b3c-b474-38710eab9577 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:30:44.868070 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d52866-63fc-4b3c-b474-38710eab9577 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:30:44.868748 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d52866-63fc-4b3c-b474-38710eab9577 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:30:44.872181 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 647/1309] 10.222.0.36 () {54 vars in 964 bytes} [Fri Jun 24 22:30:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:30:44.878125 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1153602e-a6d1-426b-8b6a-6fc18b7e0aca None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:30:44.878311 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1153602e-a6d1-426b-8b6a-6fc18b7e0aca None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:30:44.878592 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1153602e-a6d1-426b-8b6a-6fc18b7e0aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:30:44.989640 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-1153602e-a6d1-426b-8b6a-6fc18b7e0aca None None] MFA Rules not processed for user `b78f1fcce4174d1a931453d930d306f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:30:44.994743 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-1153602e-a6d1-426b-8b6a-6fc18b7e0aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:30:45.022669 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:30:45.099581 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 663/1310] 10.222.0.36 () {58 vars in 1061 bytes} [Fri Jun 24 22:30:44 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 22:30:45.100635 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d52866-63fc-4b3c-b474-38710eab9577 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:30:45.102477 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-59d52866-63fc-4b3c-b474-38710eab9577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:30:45.227670 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d52866-63fc-4b3c-b474-38710eab9577 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:30:45.309255 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f2150d-220e-46e3-a6f8-95a679da6108 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:30:45.309879 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f2150d-220e-46e3-a6f8-95a679da6108 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:30:45.310169 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f2150d-220e-46e3-a6f8-95a679da6108 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:30:45.310489 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f2150d-220e-46e3-a6f8-95a679da6108 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:30:45.313150 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-21f2150d-220e-46e3-a6f8-95a679da6108 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:30:45.370873 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:30:45.435303 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f2150d-220e-46e3-a6f8-95a679da6108 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:30:45.439019 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f2150d-220e-46e3-a6f8-95a679da6108 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:30:45.459433 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 648/1311] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:30:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 22:30:47.813314 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7decc5-6759-442c-bf64-b46274225c80 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:30:47.813876 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7decc5-6759-442c-bf64-b46274225c80 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:30:47.813876 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7decc5-6759-442c-bf64-b46274225c80 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:30:47.815279 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 664/1312] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:30:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:30:47.820563 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d8047-7655-4928-8468-744db47b2345 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:30:47.820990 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d8047-7655-4928-8468-744db47b2345 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:30:47.821176 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d8047-7655-4928-8468-744db47b2345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:30:47.908386 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-269d8047-7655-4928-8468-744db47b2345 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:30:47.909611 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-269d8047-7655-4928-8468-744db47b2345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:30:48.018710 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 649/1313] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:30:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:30:48.058199 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7decc5-6759-442c-bf64-b46274225c80 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:30:48.059852 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-ea7decc5-6759-442c-bf64-b46274225c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:30:48.176855 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7decc5-6759-442c-bf64-b46274225c80 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:30:48.249962 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:30:48.252717 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d85bc8-348b-4374-89fc-087015c0e395 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:30:48.253417 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d85bc8-348b-4374-89fc-087015c0e395 service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:30:48.253683 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d85bc8-348b-4374-89fc-087015c0e395 service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:30:48.253954 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d85bc8-348b-4374-89fc-087015c0e395 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:30:48.256065 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-f3d85bc8-348b-4374-89fc-087015c0e395 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:30:48.375845 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d85bc8-348b-4374-89fc-087015c0e395 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:30:48.378405 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d85bc8-348b-4374-89fc-087015c0e395 service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:30:48.399583 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 665/1314] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:30:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:30:50.879929 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ddc3cb-674d-40c0-a584-ae74870e7583 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:30:50.880500 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ddc3cb-674d-40c0-a584-ae74870e7583 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:30:50.880500 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ddc3cb-674d-40c0-a584-ae74870e7583 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:30:50.882289 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 650/1315] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:30:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:30:50.887713 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adf507d-2989-4656-bc23-78ce3ba557f4 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:30:50.888141 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adf507d-2989-4656-bc23-78ce3ba557f4 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:30:50.888231 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adf507d-2989-4656-bc23-78ce3ba557f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:30:50.961766 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-0adf507d-2989-4656-bc23-78ce3ba557f4 None None] MFA Rules not processed for user `c78d1ddf23904cb0b88c39812174a04e`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:30:50.963003 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-0adf507d-2989-4656-bc23-78ce3ba557f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:30:51.024090 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:30:51.072505 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 666/1316] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:30:50 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:30:51.120044 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ddc3cb-674d-40c0-a584-ae74870e7583 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:30:51.121644 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-f5ddc3cb-674d-40c0-a584-ae74870e7583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:30:51.133543 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:30:51.246034 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ddc3cb-674d-40c0-a584-ae74870e7583 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:30:51.324286 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c090b920-3e66-4fc9-9ac0-4b011fe6249b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:30:51.324933 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c090b920-3e66-4fc9-9ac0-4b011fe6249b service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:30:51.325184 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c090b920-3e66-4fc9-9ac0-4b011fe6249b service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:30:51.325484 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c090b920-3e66-4fc9-9ac0-4b011fe6249b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:30:51.327281 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-c090b920-3e66-4fc9-9ac0-4b011fe6249b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:30:51.394232 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:30:51.447003 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c090b920-3e66-4fc9-9ac0-4b011fe6249b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:30:51.448536 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c090b920-3e66-4fc9-9ac0-4b011fe6249b service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:30:51.470581 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 651/1317] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:30:51 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:30:54.089030 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5a135e-857b-42dc-9a16-ed50622b8109 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:30:54.089894 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5a135e-857b-42dc-9a16-ed50622b8109 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:30:54.089894 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5a135e-857b-42dc-9a16-ed50622b8109 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:30:54.092267 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 667/1318] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:30:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:30:54.099521 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2836f37-7fc0-4f50-b24b-2380aa7205b4 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:30:54.099982 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2836f37-7fc0-4f50-b24b-2380aa7205b4 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:30:54.100093 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2836f37-7fc0-4f50-b24b-2380aa7205b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:30:54.168947 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-e2836f37-7fc0-4f50-b24b-2380aa7205b4 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:30:54.170167 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-e2836f37-7fc0-4f50-b24b-2380aa7205b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:30:54.287653 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 652/1319] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:30:54 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 22:30:54.337830 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5a135e-857b-42dc-9a16-ed50622b8109 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:30:54.340403 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-4f5a135e-857b-42dc-9a16-ed50622b8109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:30:54.453966 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5a135e-857b-42dc-9a16-ed50622b8109 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:30:54.532153 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f076887-92cc-41f0-8617-2fd4499c8c7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:30:54.532812 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f076887-92cc-41f0-8617-2fd4499c8c7a service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:30:54.533090 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f076887-92cc-41f0-8617-2fd4499c8c7a service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:30:54.533365 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f076887-92cc-41f0-8617-2fd4499c8c7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:30:54.535022 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-4f076887-92cc-41f0-8617-2fd4499c8c7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:30:54.543019 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:30:54.656471 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f076887-92cc-41f0-8617-2fd4499c8c7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:30:54.657941 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f076887-92cc-41f0-8617-2fd4499c8c7a service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:30:54.679418 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 668/1320] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:30:54 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:30:57.526130 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badff541-eafc-461d-bc19-9988197e49f4 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:30:57.526696 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badff541-eafc-461d-bc19-9988197e49f4 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:30:57.526696 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badff541-eafc-461d-bc19-9988197e49f4 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:30:57.528093 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 653/1321] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:30:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:30:57.533800 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212e98a8-d55b-4e53-bbc4-56496ea214c7 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:30:57.534276 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212e98a8-d55b-4e53-bbc4-56496ea214c7 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:30:57.534370 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212e98a8-d55b-4e53-bbc4-56496ea214c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:30:57.602875 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-212e98a8-d55b-4e53-bbc4-56496ea214c7 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:30:57.604126 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-212e98a8-d55b-4e53-bbc4-56496ea214c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:30:57.672212 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:30:57.715695 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 669/1322] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:30:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:30:57.755716 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badff541-eafc-461d-bc19-9988197e49f4 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:30:57.757702 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-badff541-eafc-461d-bc19-9988197e49f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:30:57.781041 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:30:57.886706 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badff541-eafc-461d-bc19-9988197e49f4 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:30:57.961973 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6faa9a8-5181-41ac-8892-168316318c43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:30:57.962634 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6faa9a8-5181-41ac-8892-168316318c43 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:30:57.962917 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6faa9a8-5181-41ac-8892-168316318c43 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:30:57.963191 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6faa9a8-5181-41ac-8892-168316318c43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:30:57.964910 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-d6faa9a8-5181-41ac-8892-168316318c43 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:30:58.042406 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:30:58.084344 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6faa9a8-5181-41ac-8892-168316318c43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:30:58.085812 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6faa9a8-5181-41ac-8892-168316318c43 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:30:58.106158 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 654/1323] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:30:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:31:00.218264 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e056621b-7b6b-4507-8d30-de9eb9484798 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:31:00.218843 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e056621b-7b6b-4507-8d30-de9eb9484798 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:31:00.218843 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e056621b-7b6b-4507-8d30-de9eb9484798 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:31:00.220258 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 670/1324] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:31:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:31:00.226750 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95863e5a-a27d-4998-8191-85e12e3f0ec7 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:31:00.227323 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95863e5a-a27d-4998-8191-85e12e3f0ec7 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:31:00.227740 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95863e5a-a27d-4998-8191-85e12e3f0ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:31:00.298775 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-95863e5a-a27d-4998-8191-85e12e3f0ec7 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:31:00.300046 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-95863e5a-a27d-4998-8191-85e12e3f0ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:31:00.403177 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 655/1325] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:31:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:31:00.456145 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc49b0-5c39-439d-81e9-8ba2e959b0b2 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:31:00.456411 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc49b0-5c39-439d-81e9-8ba2e959b0b2 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:31:00.456697 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc49b0-5c39-439d-81e9-8ba2e959b0b2 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:31:00.458121 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 671/1326] 10.222.0.36 () {54 vars in 964 bytes} [Fri Jun 24 22:31:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:31:00.464502 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65288b0c-d375-4216-bb0c-1ef468e788f1 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:31:00.464796 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65288b0c-d375-4216-bb0c-1ef468e788f1 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:31:00.465072 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65288b0c-d375-4216-bb0c-1ef468e788f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:31:00.499189 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:31:00.547921 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-65288b0c-d375-4216-bb0c-1ef468e788f1 None None] MFA Rules not processed for user `b78f1fcce4174d1a931453d930d306f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:31:00.549168 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-65288b0c-d375-4216-bb0c-1ef468e788f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:31:00.633756 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 656/1327] 10.222.0.36 () {58 vars in 1061 bytes} [Fri Jun 24 22:31:00 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:31:00.643040 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dc49b0-5c39-439d-81e9-8ba2e959b0b2 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:31:00.644623 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-a9dc49b0-5c39-439d-81e9-8ba2e959b0b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:31:00.769824 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dc49b0-5c39-439d-81e9-8ba2e959b0b2 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:31:00.853890 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e690b0e-65a7-4f7b-94a5-1044ebe2215a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:31:00.854534 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e690b0e-65a7-4f7b-94a5-1044ebe2215a service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:31:00.854814 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e690b0e-65a7-4f7b-94a5-1044ebe2215a service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:31:00.855087 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e690b0e-65a7-4f7b-94a5-1044ebe2215a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:31:00.856760 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-9e690b0e-65a7-4f7b-94a5-1044ebe2215a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:31:00.876261 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:31:00.974418 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e690b0e-65a7-4f7b-94a5-1044ebe2215a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:31:00.975922 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e690b0e-65a7-4f7b-94a5-1044ebe2215a service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:31:00.994729 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 672/1328] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:31:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:31:03.357112 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40edc8a1-bb65-40ab-a33b-22722e69e99e None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:31:03.358293 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40edc8a1-bb65-40ab-a33b-22722e69e99e None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:31:03.358293 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40edc8a1-bb65-40ab-a33b-22722e69e99e None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:31:03.360297 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 657/1329] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:31:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 22:31:03.366079 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544805cd-a2ee-42fe-8e10-10444500988e None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:31:03.366525 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544805cd-a2ee-42fe-8e10-10444500988e None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:31:03.366759 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544805cd-a2ee-42fe-8e10-10444500988e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:31:03.453069 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-544805cd-a2ee-42fe-8e10-10444500988e None None] MFA Rules not processed for user `c78d1ddf23904cb0b88c39812174a04e`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:31:03.454288 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-544805cd-a2ee-42fe-8e10-10444500988e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:31:03.532444 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:31:03.580819 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 673/1330] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:31:03 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:31:03.623412 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40edc8a1-bb65-40ab-a33b-22722e69e99e None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:31:03.624966 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-40edc8a1-bb65-40ab-a33b-22722e69e99e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:31:03.737759 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40edc8a1-bb65-40ab-a33b-22722e69e99e None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:31:03.757520 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:31:03.822197 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43985a5-df45-4e45-83d4-dba1dbc5d26c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:31:03.822792 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43985a5-df45-4e45-83d4-dba1dbc5d26c service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:31:03.823061 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43985a5-df45-4e45-83d4-dba1dbc5d26c service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:31:03.823371 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43985a5-df45-4e45-83d4-dba1dbc5d26c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:31:03.825028 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-c43985a5-df45-4e45-83d4-dba1dbc5d26c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:31:03.944737 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43985a5-df45-4e45-83d4-dba1dbc5d26c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:31:03.946112 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43985a5-df45-4e45-83d4-dba1dbc5d26c service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:31:03.964816 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 658/1331] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:31:03 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:31:06.438807 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2dd916-a051-4142-9059-cc63fbb0dad7 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:31:06.439330 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2dd916-a051-4142-9059-cc63fbb0dad7 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:31:06.439417 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2dd916-a051-4142-9059-cc63fbb0dad7 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:31:06.441167 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 674/1332] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:31:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:31:06.446146 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4891b647-3340-4e4f-ab9d-c0f1448f5a92 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:31:06.446610 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4891b647-3340-4e4f-ab9d-c0f1448f5a92 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:31:06.446716 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4891b647-3340-4e4f-ab9d-c0f1448f5a92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:31:06.522097 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:31:06.525899 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-4891b647-3340-4e4f-ab9d-c0f1448f5a92 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:31:06.527947 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-4891b647-3340-4e4f-ab9d-c0f1448f5a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:31:06.630979 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 659/1333] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:31:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:31:06.671310 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2dd916-a051-4142-9059-cc63fbb0dad7 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:31:06.672853 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-6e2dd916-a051-4142-9059-cc63fbb0dad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:31:06.793773 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2dd916-a051-4142-9059-cc63fbb0dad7 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:31:06.879421 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e93bc6-f77e-4f9d-87f0-bd5b3ba41b89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:31:06.880075 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e93bc6-f77e-4f9d-87f0-bd5b3ba41b89 service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:31:06.880359 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e93bc6-f77e-4f9d-87f0-bd5b3ba41b89 service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:31:06.880632 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e93bc6-f77e-4f9d-87f0-bd5b3ba41b89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:31:06.882291 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-f1e93bc6-f77e-4f9d-87f0-bd5b3ba41b89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:31:06.910046 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:31:06.996487 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e93bc6-f77e-4f9d-87f0-bd5b3ba41b89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:31:06.998019 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e93bc6-f77e-4f9d-87f0-bd5b3ba41b89 service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:31:07.016686 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 675/1334] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:31:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 22:31:09.152262 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110cfdb7-5d63-4fab-b7a8-985e08713cbc None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:31:09.153127 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110cfdb7-5d63-4fab-b7a8-985e08713cbc None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:31:09.153127 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110cfdb7-5d63-4fab-b7a8-985e08713cbc None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:31:09.155151 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 660/1335] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:31:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:31:09.161467 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a42c2f5-9c61-4a68-9729-7ae28ba743aa None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:31:09.161889 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a42c2f5-9c61-4a68-9729-7ae28ba743aa None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:31:09.162036 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a42c2f5-9c61-4a68-9729-7ae28ba743aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:31:09.237662 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-6a42c2f5-9c61-4a68-9729-7ae28ba743aa None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:31:09.238882 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-6a42c2f5-9c61-4a68-9729-7ae28ba743aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:31:09.321898 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:31:09.346256 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 676/1336] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:31:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:31:09.390972 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110cfdb7-5d63-4fab-b7a8-985e08713cbc None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:31:09.393566 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-110cfdb7-5d63-4fab-b7a8-985e08713cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:31:09.519988 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110cfdb7-5d63-4fab-b7a8-985e08713cbc None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:31:09.552595 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:31:09.611144 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fcac87-df2a-4364-99d2-b3d0c0405125 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:31:09.611839 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fcac87-df2a-4364-99d2-b3d0c0405125 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:31:09.612120 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fcac87-df2a-4364-99d2-b3d0c0405125 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:31:09.612391 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fcac87-df2a-4364-99d2-b3d0c0405125 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:31:09.614058 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-b1fcac87-df2a-4364-99d2-b3d0c0405125 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:31:09.733405 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fcac87-df2a-4364-99d2-b3d0c0405125 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:31:09.734761 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fcac87-df2a-4364-99d2-b3d0c0405125 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:31:09.754795 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 661/1337] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:31:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 22:31:12.245218 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89935a3a-8142-4e2b-953a-21e7ea2b4281 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:31:12.245865 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89935a3a-8142-4e2b-953a-21e7ea2b4281 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:31:12.245865 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89935a3a-8142-4e2b-953a-21e7ea2b4281 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:31:12.247156 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 677/1338] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:31:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:31:12.253281 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50a7f80-6ed2-48ef-97c3-9af3a96715a8 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:31:12.254125 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50a7f80-6ed2-48ef-97c3-9af3a96715a8 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:31:12.254125 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50a7f80-6ed2-48ef-97c3-9af3a96715a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:31:12.330496 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-e50a7f80-6ed2-48ef-97c3-9af3a96715a8 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:31:12.331769 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-e50a7f80-6ed2-48ef-97c3-9af3a96715a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:31:12.340250 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:31:12.440485 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 662/1339] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:31:12 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:31:12.476395 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89935a3a-8142-4e2b-953a-21e7ea2b4281 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:31:12.477947 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-89935a3a-8142-4e2b-953a-21e7ea2b4281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:31:12.593081 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89935a3a-8142-4e2b-953a-21e7ea2b4281 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:31:12.679208 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9e66fb-cadc-49cd-8b60-eebef70821c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:31:12.679885 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e66fb-cadc-49cd-8b60-eebef70821c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:31:12.680167 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e66fb-cadc-49cd-8b60-eebef70821c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:31:12.680439 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e66fb-cadc-49cd-8b60-eebef70821c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:31:12.682095 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-0e9e66fb-cadc-49cd-8b60-eebef70821c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:31:12.719504 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:31:12.797872 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9e66fb-cadc-49cd-8b60-eebef70821c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:31:12.799364 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9e66fb-cadc-49cd-8b60-eebef70821c0 service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:31:12.818720 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 678/1340] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:31:12 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:31:16.962767 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71020b09-a977-4280-876b-d002c790161a None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:31:16.963329 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71020b09-a977-4280-876b-d002c790161a None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:31:16.963447 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71020b09-a977-4280-876b-d002c790161a None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:31:16.964875 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 663/1341] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:31:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:31:16.971127 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d118bf90-64d5-4896-859f-f5589811272d None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:31:16.971576 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d118bf90-64d5-4896-859f-f5589811272d None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:31:16.971979 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d118bf90-64d5-4896-859f-f5589811272d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:31:17.045644 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-d118bf90-64d5-4896-859f-f5589811272d None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:31:17.047421 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-d118bf90-64d5-4896-859f-f5589811272d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:31:17.147624 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:31:17.161255 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 679/1342] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:31:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:31:17.200769 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71020b09-a977-4280-876b-d002c790161a None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:31:17.203238 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-71020b09-a977-4280-876b-d002c790161a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:31:17.306963 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71020b09-a977-4280-876b-d002c790161a None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:31:17.310465 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1fb771-3d0f-4aae-8cf5-ea49c0d34e2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:31:17.311148 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1fb771-3d0f-4aae-8cf5-ea49c0d34e2d service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:31:17.311462 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1fb771-3d0f-4aae-8cf5-ea49c0d34e2d service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:31:17.311740 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1fb771-3d0f-4aae-8cf5-ea49c0d34e2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:31:17.321054 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1fb771-3d0f-4aae-8cf5-ea49c0d34e2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:31:17.322499 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1fb771-3d0f-4aae-8cf5-ea49c0d34e2d service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:31:17.333452 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 664/1343] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:31:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:31:20.016152 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15531f3e-982a-4868-bc95-3bc8eb6e880b None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:31:20.016731 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15531f3e-982a-4868-bc95-3bc8eb6e880b None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:31:20.016731 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15531f3e-982a-4868-bc95-3bc8eb6e880b None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:31:20.018070 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 680/1344] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:31:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:31:20.023795 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dcc967-ca38-498f-9a09-9f2a05b84eb4 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:31:20.024249 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dcc967-ca38-498f-9a09-9f2a05b84eb4 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:31:20.024463 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dcc967-ca38-498f-9a09-9f2a05b84eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:31:20.054231 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-98dcc967-ca38-498f-9a09-9f2a05b84eb4 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:31:20.055463 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-98dcc967-ca38-498f-9a09-9f2a05b84eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:31:20.086994 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:31:20.138565 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 665/1345] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:31:20 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:31:20.180254 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15531f3e-982a-4868-bc95-3bc8eb6e880b None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:31:20.194600 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15531f3e-982a-4868-bc95-3bc8eb6e880b None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:31:20.198964 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eef18c-3b9d-4b92-932f-2566f0cd96da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:31:20.199927 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eef18c-3b9d-4b92-932f-2566f0cd96da service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:31:20.200244 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eef18c-3b9d-4b92-932f-2566f0cd96da service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:31:20.200678 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eef18c-3b9d-4b92-932f-2566f0cd96da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:31:20.213181 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9eef18c-3b9d-4b92-932f-2566f0cd96da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:31:20.215117 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9eef18c-3b9d-4b92-932f-2566f0cd96da service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:31:20.228320 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 681/1346] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:31:20 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:31:24.553451 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1131f43a-eb85-428d-9c6d-31b0a4667441 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:31:24.554014 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1131f43a-eb85-428d-9c6d-31b0a4667441 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:31:24.554106 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1131f43a-eb85-428d-9c6d-31b0a4667441 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:31:24.555908 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 666/1347] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:31:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:31:24.561436 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849bf02f-2a1b-423f-b2ce-f08954e5d498 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:31:24.562302 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849bf02f-2a1b-423f-b2ce-f08954e5d498 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:31:24.562783 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849bf02f-2a1b-423f-b2ce-f08954e5d498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:31:24.581890 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-849bf02f-2a1b-423f-b2ce-f08954e5d498 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:31:24.583331 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-849bf02f-2a1b-423f-b2ce-f08954e5d498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:31:24.595654 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 682/1348] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:31:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:31:24.630425 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1131f43a-eb85-428d-9c6d-31b0a4667441 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:31:24.642430 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1131f43a-eb85-428d-9c6d-31b0a4667441 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:31:24.646408 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e075bac-5856-4513-ad8a-3a39c57d296e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:31:24.647076 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e075bac-5856-4513-ad8a-3a39c57d296e service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:31:24.647415 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e075bac-5856-4513-ad8a-3a39c57d296e service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:31:24.647730 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e075bac-5856-4513-ad8a-3a39c57d296e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:31:24.657894 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e075bac-5856-4513-ad8a-3a39c57d296e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:31:24.659382 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e075bac-5856-4513-ad8a-3a39c57d296e service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:31:24.669622 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 667/1349] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:31:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:31:29.699138 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194019ae-9eca-42b7-bd70-30c9cf2a8d38 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:31:29.701547 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194019ae-9eca-42b7-bd70-30c9cf2a8d38 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:31:29.701930 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194019ae-9eca-42b7-bd70-30c9cf2a8d38 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:31:29.703454 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 683/1350] 10.222.0.36 () {54 vars in 921 bytes} [Fri Jun 24 22:31:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:31:29.710396 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad6d6c-ec8d-4048-9d16-87c7d7f74281 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:31:29.710904 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad6d6c-ec8d-4048-9d16-87c7d7f74281 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:31:29.710986 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad6d6c-ec8d-4048-9d16-87c7d7f74281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:31:29.813134 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-cfad6d6c-ec8d-4048-9d16-87c7d7f74281 None None] MFA Rules not processed for user `0233b357708643be94c0ade17ac1fb3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:31:29.814433 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-cfad6d6c-ec8d-4048-9d16-87c7d7f74281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:31:29.938657 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 668/1351] 10.222.0.36 () {58 vars in 1018 bytes} [Fri Jun 24 22:31:29 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:31:34.097295 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d7d412-ca85-44bf-9036-0a72fd0d017e None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:31:34.097944 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d7d412-ca85-44bf-9036-0a72fd0d017e None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:31:34.097944 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d7d412-ca85-44bf-9036-0a72fd0d017e None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:31:34.099480 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 684/1352] 10.222.0.36 () {54 vars in 921 bytes} [Fri Jun 24 22:31:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:31:34.104419 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82471f4f-34c1-4f83-9b10-b601a2287e83 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:31:34.104892 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82471f4f-34c1-4f83-9b10-b601a2287e83 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:31:34.105025 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82471f4f-34c1-4f83-9b10-b601a2287e83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:31:34.124688 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-82471f4f-34c1-4f83-9b10-b601a2287e83 None None] MFA Rules not processed for user `0233b357708643be94c0ade17ac1fb3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:31:34.126238 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-82471f4f-34c1-4f83-9b10-b601a2287e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:31:34.135022 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 669/1353] 10.222.0.36 () {58 vars in 1018 bytes} [Fri Jun 24 22:31:34 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 22:31:34.576466 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=13 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:31:35.791732 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d5bda1-46b7-4dd6-9a60-9e89f513a8f1 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:31:35.792396 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d5bda1-46b7-4dd6-9a60-9e89f513a8f1 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:31:35.792396 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d5bda1-46b7-4dd6-9a60-9e89f513a8f1 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:31:35.793800 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 685/1354] 10.222.0.36 () {54 vars in 921 bytes} [Fri Jun 24 22:31:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:31:35.799308 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce03acf-9a6b-449b-a700-deb531834d07 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:31:35.799736 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce03acf-9a6b-449b-a700-deb531834d07 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:31:35.799908 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce03acf-9a6b-449b-a700-deb531834d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:31:35.819192 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-1ce03acf-9a6b-449b-a700-deb531834d07 None None] MFA Rules not processed for user `0233b357708643be94c0ade17ac1fb3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:31:35.820469 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-1ce03acf-9a6b-449b-a700-deb531834d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:31:35.829990 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 670/1355] 10.222.0.36 () {58 vars in 1018 bytes} [Fri Jun 24 22:31:35 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:31:39.263592 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2059227-b6ed-480e-956f-7618d8ee9006 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:31:39.264842 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2059227-b6ed-480e-956f-7618d8ee9006 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:31:39.265133 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2059227-b6ed-480e-956f-7618d8ee9006 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:31:39.266523 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 686/1356] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:31:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:31:39.272258 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290956c7-1cf0-4afb-a42c-9a1c70283d80 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:31:39.272744 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290956c7-1cf0-4afb-a42c-9a1c70283d80 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:31:39.272861 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290956c7-1cf0-4afb-a42c-9a1c70283d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:31:39.290704 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-290956c7-1cf0-4afb-a42c-9a1c70283d80 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:31:39.291934 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-290956c7-1cf0-4afb-a42c-9a1c70283d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:31:39.300208 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 671/1357] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:31:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 22:31:39.353612 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08696214-1b6e-427d-b704-f42c99d8d0a0 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:31:39.354091 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08696214-1b6e-427d-b704-f42c99d8d0a0 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:31:39.354518 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08696214-1b6e-427d-b704-f42c99d8d0a0 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:31:39.356417 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 687/1358] 10.222.0.36 () {54 vars in 961 bytes} [Fri Jun 24 22:31:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:31:39.365583 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4175d710-c71d-4a2f-bf69-ec0ef642295c None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:31:39.366114 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4175d710-c71d-4a2f-bf69-ec0ef642295c None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:31:39.366535 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4175d710-c71d-4a2f-bf69-ec0ef642295c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:31:39.412515 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:31:39.421530 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-4175d710-c71d-4a2f-bf69-ec0ef642295c None None] MFA Rules not processed for user `214d9071042c4bad886bf060a079b6e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:31:39.422816 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-4175d710-c71d-4a2f-bf69-ec0ef642295c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:31:39.514174 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 672/1359] 10.222.0.36 () {58 vars in 1058 bytes} [Fri Jun 24 22:31:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 22:31:39.522145 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08696214-1b6e-427d-b704-f42c99d8d0a0 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:31:39.536963 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08696214-1b6e-427d-b704-f42c99d8d0a0 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:31:39.542782 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f55896-5d33-4c42-b339-65ec45a3b866 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214d9071042c4bad886bf060a079b6e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:31:39.543677 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f55896-5d33-4c42-b339-65ec45a3b866 service nova] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:31:39.544200 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f55896-5d33-4c42-b339-65ec45a3b866 service nova] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:31:39.544721 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f55896-5d33-4c42-b339-65ec45a3b866 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:31:39.554191 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f55896-5d33-4c42-b339-65ec45a3b866 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:31:39.555922 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f55896-5d33-4c42-b339-65ec45a3b866 service nova] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:31:39.566115 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 688/1360] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:31:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:31:41.813671 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515bac1e-7ed9-44e7-9daf-4257733a086f None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:31:41.814284 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515bac1e-7ed9-44e7-9daf-4257733a086f None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:31:41.814284 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515bac1e-7ed9-44e7-9daf-4257733a086f None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:31:41.815625 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 673/1361] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:31:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:31:41.820986 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf66c8-9c10-48a5-ac71-77c1362ca6af None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:31:41.821424 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf66c8-9c10-48a5-ac71-77c1362ca6af None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:31:41.821531 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf66c8-9c10-48a5-ac71-77c1362ca6af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:31:41.839788 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-edbf66c8-9c10-48a5-ac71-77c1362ca6af None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:31:41.841066 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-edbf66c8-9c10-48a5-ac71-77c1362ca6af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:31:41.849432 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 689/1362] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:31:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:31:41.894119 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515bac1e-7ed9-44e7-9daf-4257733a086f None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:31:41.909796 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515bac1e-7ed9-44e7-9daf-4257733a086f None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:31:41.915838 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730b53a3-da16-4cad-8408-5547a0ff1b31 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214d9071042c4bad886bf060a079b6e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:31:41.916553 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b53a3-da16-4cad-8408-5547a0ff1b31 service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:31:41.916907 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b53a3-da16-4cad-8408-5547a0ff1b31 service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:31:41.917264 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b53a3-da16-4cad-8408-5547a0ff1b31 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:31:41.926396 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730b53a3-da16-4cad-8408-5547a0ff1b31 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:31:41.928139 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730b53a3-da16-4cad-8408-5547a0ff1b31 service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:31:41.938623 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 674/1363] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:31:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:31:44.334936 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d13dbf-1903-49ca-97e3-cdc722393721 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:31:44.334936 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d13dbf-1903-49ca-97e3-cdc722393721 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:31:44.334936 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d13dbf-1903-49ca-97e3-cdc722393721 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:31:44.334936 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 690/1364] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:31:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:31:44.340648 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd83bd-e441-4680-a69f-6b02d66a2a89 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:31:44.341115 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd83bd-e441-4680-a69f-6b02d66a2a89 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:31:44.341221 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd83bd-e441-4680-a69f-6b02d66a2a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:31:44.362189 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-00cd83bd-e441-4680-a69f-6b02d66a2a89 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:31:44.363570 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-00cd83bd-e441-4680-a69f-6b02d66a2a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:31:44.371965 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 675/1365] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:31:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:31:44.416237 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9ff75c-f6ea-4932-b93e-272f3b385bd6 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:31:44.416555 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9ff75c-f6ea-4932-b93e-272f3b385bd6 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:31:44.416834 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9ff75c-f6ea-4932-b93e-272f3b385bd6 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:31:44.418229 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 691/1366] 10.222.0.36 () {54 vars in 961 bytes} [Fri Jun 24 22:31:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:31:44.423495 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6156cb8-602e-4441-a520-1e86515b87a8 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:31:44.423909 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6156cb8-602e-4441-a520-1e86515b87a8 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:31:44.424194 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6156cb8-602e-4441-a520-1e86515b87a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:31:44.448883 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-c6156cb8-602e-4441-a520-1e86515b87a8 None None] MFA Rules not processed for user `214d9071042c4bad886bf060a079b6e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:31:44.450151 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-c6156cb8-602e-4441-a520-1e86515b87a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:31:44.461185 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 676/1367] 10.222.0.36 () {58 vars in 1058 bytes} [Fri Jun 24 22:31:44 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:31:44.470287 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9ff75c-f6ea-4932-b93e-272f3b385bd6 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:31:44.484379 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9ff75c-f6ea-4932-b93e-272f3b385bd6 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:31:44.489827 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e43809-5097-44e5-8753-527fc8d1f0f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214d9071042c4bad886bf060a079b6e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:31:44.490447 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e43809-5097-44e5-8753-527fc8d1f0f5 service nova] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:31:44.490731 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e43809-5097-44e5-8753-527fc8d1f0f5 service nova] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:31:44.491006 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e43809-5097-44e5-8753-527fc8d1f0f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:31:44.499385 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e43809-5097-44e5-8753-527fc8d1f0f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:31:44.501342 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e43809-5097-44e5-8753-527fc8d1f0f5 service nova] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:31:44.510874 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 692/1368] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:31:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 22:31:46.677061 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581f24de-ec22-411f-973d-6ea12825758c None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:31:46.677698 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581f24de-ec22-411f-973d-6ea12825758c None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:31:46.677804 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581f24de-ec22-411f-973d-6ea12825758c None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:31:46.679357 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 677/1369] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:31:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:31:46.685047 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb77bdb-4906-4488-841d-9d984c0d6a81 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:31:46.685499 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb77bdb-4906-4488-841d-9d984c0d6a81 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:31:46.685499 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb77bdb-4906-4488-841d-9d984c0d6a81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:31:46.703632 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-9eb77bdb-4906-4488-841d-9d984c0d6a81 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:31:46.704880 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-9eb77bdb-4906-4488-841d-9d984c0d6a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:31:46.713073 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 693/1370] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:31:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:31:46.760768 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581f24de-ec22-411f-973d-6ea12825758c None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:31:46.777891 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581f24de-ec22-411f-973d-6ea12825758c None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:31:46.783792 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84da9f07-c880-450c-abe6-9a2b4eb83155 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214d9071042c4bad886bf060a079b6e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:31:46.784550 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84da9f07-c880-450c-abe6-9a2b4eb83155 service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:31:46.784935 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84da9f07-c880-450c-abe6-9a2b4eb83155 service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:31:46.785311 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84da9f07-c880-450c-abe6-9a2b4eb83155 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:31:46.794335 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84da9f07-c880-450c-abe6-9a2b4eb83155 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:31:46.796315 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84da9f07-c880-450c-abe6-9a2b4eb83155 service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:31:46.806666 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 678/1371] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:31:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:31:47.257962 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f535a04-0093-4770-a6fc-dd802e8bb9a9 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:31:47.258234 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f535a04-0093-4770-a6fc-dd802e8bb9a9 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:31:47.258485 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f535a04-0093-4770-a6fc-dd802e8bb9a9 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:31:47.260117 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 694/1372] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:31:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:31:47.265809 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cd7b13-2b86-4f24-98c7-846b3e859fab None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:31:47.266079 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cd7b13-2b86-4f24-98c7-846b3e859fab None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:31:47.266548 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cd7b13-2b86-4f24-98c7-846b3e859fab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:31:47.285785 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-43cd7b13-2b86-4f24-98c7-846b3e859fab None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:31:47.286971 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-43cd7b13-2b86-4f24-98c7-846b3e859fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:31:47.297552 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 679/1373] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:31:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:31:47.633391 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea19d7e-a330-4784-8094-0e3c6853189b None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:31:47.633391 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea19d7e-a330-4784-8094-0e3c6853189b None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:31:47.633391 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea19d7e-a330-4784-8094-0e3c6853189b None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:31:47.636489 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 695/1374] 10.222.0.36 () {54 vars in 963 bytes} [Fri Jun 24 22:31:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:31:47.640334 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811f6987-65c4-4092-a59a-57a3f93661fd None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:31:47.640608 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811f6987-65c4-4092-a59a-57a3f93661fd None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:31:47.640891 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811f6987-65c4-4092-a59a-57a3f93661fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:31:47.693611 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-811f6987-65c4-4092-a59a-57a3f93661fd None None] MFA Rules not processed for user `e4a747e2a5684843a6ee9e3480badac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:31:47.694830 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-811f6987-65c4-4092-a59a-57a3f93661fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:31:47.758769 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 680/1375] 10.222.0.36 () {58 vars in 1060 bytes} [Fri Jun 24 22:31:47 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:31:47.766342 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea19d7e-a330-4784-8094-0e3c6853189b None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:31:47.777735 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea19d7e-a330-4784-8094-0e3c6853189b None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:31:47.781483 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0673af75-2a60-4b2e-a304-2f076d10df3c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a747e2a5684843a6ee9e3480badac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:31:47.782482 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0673af75-2a60-4b2e-a304-2f076d10df3c service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:31:47.782863 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0673af75-2a60-4b2e-a304-2f076d10df3c service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:31:47.783260 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0673af75-2a60-4b2e-a304-2f076d10df3c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:31:47.792937 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0673af75-2a60-4b2e-a304-2f076d10df3c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:31:47.794576 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0673af75-2a60-4b2e-a304-2f076d10df3c service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:31:47.804758 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 696/1376] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:31:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:31:48.856554 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920f9dce-cd48-4438-a593-74c81bf43f2c None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:31:48.856554 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920f9dce-cd48-4438-a593-74c81bf43f2c None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:31:48.857226 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920f9dce-cd48-4438-a593-74c81bf43f2c None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:31:48.858137 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 681/1377] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:31:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:31:48.863591 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fdc0a2-7e9f-4541-b84d-cfb815514c88 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:31:48.864002 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fdc0a2-7e9f-4541-b84d-cfb815514c88 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:31:48.864168 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fdc0a2-7e9f-4541-b84d-cfb815514c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:31:48.882861 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-29fdc0a2-7e9f-4541-b84d-cfb815514c88 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:31:48.884190 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-29fdc0a2-7e9f-4541-b84d-cfb815514c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:31:48.893064 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 697/1378] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:31:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:31:48.937776 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920f9dce-cd48-4438-a593-74c81bf43f2c None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:31:48.954226 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920f9dce-cd48-4438-a593-74c81bf43f2c None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:31:48.960716 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ccdc31-8b42-4e25-9057-a4f32e775c95 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214d9071042c4bad886bf060a079b6e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:31:48.961356 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ccdc31-8b42-4e25-9057-a4f32e775c95 service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:31:48.961641 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ccdc31-8b42-4e25-9057-a4f32e775c95 service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:31:48.961917 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ccdc31-8b42-4e25-9057-a4f32e775c95 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:31:48.970353 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ccdc31-8b42-4e25-9057-a4f32e775c95 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:31:48.971984 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ccdc31-8b42-4e25-9057-a4f32e775c95 service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:31:48.975831 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:31:48.982385 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 682/1379] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:31:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:31:51.135356 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512c21d6-fc6d-4223-b226-362e9a55aa87 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:31:51.135926 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512c21d6-fc6d-4223-b226-362e9a55aa87 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:31:51.137358 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512c21d6-fc6d-4223-b226-362e9a55aa87 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:31:51.140449 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 698/1380] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:31:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:31:51.145436 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aafa396-f510-45b6-b8f0-cc4964cc4943 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:31:51.145888 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aafa396-f510-45b6-b8f0-cc4964cc4943 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:31:51.146000 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aafa396-f510-45b6-b8f0-cc4964cc4943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:31:51.174048 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-5aafa396-f510-45b6-b8f0-cc4964cc4943 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:31:51.175267 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-5aafa396-f510-45b6-b8f0-cc4964cc4943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:31:51.184464 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 683/1381] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:31:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:31:51.231466 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512c21d6-fc6d-4223-b226-362e9a55aa87 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:31:51.247466 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512c21d6-fc6d-4223-b226-362e9a55aa87 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:31:51.253729 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22e6b13-a274-4b79-b4f7-3fe76e736ea0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214d9071042c4bad886bf060a079b6e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:31:51.254389 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22e6b13-a274-4b79-b4f7-3fe76e736ea0 service nova] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:31:51.254675 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22e6b13-a274-4b79-b4f7-3fe76e736ea0 service nova] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:31:51.254952 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22e6b13-a274-4b79-b4f7-3fe76e736ea0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:31:51.264225 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22e6b13-a274-4b79-b4f7-3fe76e736ea0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:31:51.266129 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22e6b13-a274-4b79-b4f7-3fe76e736ea0 service nova] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:31:51.276641 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 699/1382] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:31:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:31:53.399604 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee866b3-8a7a-418c-a9a0-d0ffb75acd4f None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:31:53.400185 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee866b3-8a7a-418c-a9a0-d0ffb75acd4f None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:31:53.400185 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee866b3-8a7a-418c-a9a0-d0ffb75acd4f None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:31:53.401495 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 684/1383] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:31:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:31:53.407730 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5054e7a-7c96-4431-b37e-11f4afb137be None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:31:53.408518 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5054e7a-7c96-4431-b37e-11f4afb137be None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:31:53.408805 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5054e7a-7c96-4431-b37e-11f4afb137be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:31:53.431183 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-a5054e7a-7c96-4431-b37e-11f4afb137be None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:31:53.431183 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-a5054e7a-7c96-4431-b37e-11f4afb137be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:31:53.447024 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 700/1384] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:31:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:31:53.492581 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee866b3-8a7a-418c-a9a0-d0ffb75acd4f None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:31:53.507843 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee866b3-8a7a-418c-a9a0-d0ffb75acd4f None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:31:53.514089 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30772125-d3bd-4261-b792-4420c13ed825 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214d9071042c4bad886bf060a079b6e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:31:53.514771 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30772125-d3bd-4261-b792-4420c13ed825 service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:31:53.515037 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30772125-d3bd-4261-b792-4420c13ed825 service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:31:53.515333 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30772125-d3bd-4261-b792-4420c13ed825 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:31:53.525610 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30772125-d3bd-4261-b792-4420c13ed825 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:31:53.527281 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30772125-d3bd-4261-b792-4420c13ed825 service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:31:53.538592 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 685/1385] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:31:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:31:55.622328 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c11dd-5b81-454f-9e7f-82ecc8b2c176 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:31:55.622889 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c11dd-5b81-454f-9e7f-82ecc8b2c176 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:31:55.623010 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c11dd-5b81-454f-9e7f-82ecc8b2c176 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:31:55.624764 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 701/1386] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:31:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:31:55.631608 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b31eb8-90ba-43dd-a6fd-dd994ba6cf2b None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:31:55.632232 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b31eb8-90ba-43dd-a6fd-dd994ba6cf2b None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:31:55.632232 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b31eb8-90ba-43dd-a6fd-dd994ba6cf2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:31:55.651380 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-17b31eb8-90ba-43dd-a6fd-dd994ba6cf2b None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:31:55.652673 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-17b31eb8-90ba-43dd-a6fd-dd994ba6cf2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:31:55.660467 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 686/1387] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:31:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:31:55.706323 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3c11dd-5b81-454f-9e7f-82ecc8b2c176 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:31:55.720926 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3c11dd-5b81-454f-9e7f-82ecc8b2c176 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:31:55.726877 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ade8d64-5ff2-4ee3-b471-1b0cbfaf61fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214d9071042c4bad886bf060a079b6e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:31:55.727553 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ade8d64-5ff2-4ee3-b471-1b0cbfaf61fc service nova] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:31:55.727838 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ade8d64-5ff2-4ee3-b471-1b0cbfaf61fc service nova] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:31:55.728122 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ade8d64-5ff2-4ee3-b471-1b0cbfaf61fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:31:55.736918 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ade8d64-5ff2-4ee3-b471-1b0cbfaf61fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:31:55.738531 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ade8d64-5ff2-4ee3-b471-1b0cbfaf61fc service nova] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:31:55.748467 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 702/1388] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:31:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:31:57.866109 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e0b7b0-19a7-4cb4-94dd-4c69896560f4 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:31:57.866662 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e0b7b0-19a7-4cb4-94dd-4c69896560f4 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:31:57.867132 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e0b7b0-19a7-4cb4-94dd-4c69896560f4 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:31:57.869763 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 687/1389] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:31:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:31:57.875648 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8402857e-4b4f-4c7d-871f-a793a42f8e0d None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:31:57.876131 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8402857e-4b4f-4c7d-871f-a793a42f8e0d None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:31:57.876233 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8402857e-4b4f-4c7d-871f-a793a42f8e0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:31:57.895003 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-8402857e-4b4f-4c7d-871f-a793a42f8e0d None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:31:57.896292 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-8402857e-4b4f-4c7d-871f-a793a42f8e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:31:57.905046 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 703/1390] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:31:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:31:57.952789 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e0b7b0-19a7-4cb4-94dd-4c69896560f4 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:31:57.968597 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e0b7b0-19a7-4cb4-94dd-4c69896560f4 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:31:57.975034 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e643f41e-75d6-4c82-959a-b35653ed1571 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214d9071042c4bad886bf060a079b6e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:31:57.975684 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e643f41e-75d6-4c82-959a-b35653ed1571 service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:31:57.975971 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e643f41e-75d6-4c82-959a-b35653ed1571 service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:31:57.976248 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e643f41e-75d6-4c82-959a-b35653ed1571 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:31:57.984935 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e643f41e-75d6-4c82-959a-b35653ed1571 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:31:57.986547 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e643f41e-75d6-4c82-959a-b35653ed1571 service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:31:57.996323 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 688/1391] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:31:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:32:00.090690 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28bc3f7-91ff-4ca8-9f8a-cd321e088528 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:32:00.091238 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28bc3f7-91ff-4ca8-9f8a-cd321e088528 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:32:00.091238 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28bc3f7-91ff-4ca8-9f8a-cd321e088528 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:32:00.092570 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 704/1392] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:32:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:32:00.097920 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6dd471-3ecf-4b8a-ab76-a1b2beb57fc5 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:32:00.098550 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6dd471-3ecf-4b8a-ab76-a1b2beb57fc5 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:32:00.098550 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6dd471-3ecf-4b8a-ab76-a1b2beb57fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:32:00.117992 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-3f6dd471-3ecf-4b8a-ab76-a1b2beb57fc5 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:32:00.119211 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-3f6dd471-3ecf-4b8a-ab76-a1b2beb57fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:32:00.128795 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 689/1393] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:32:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:32:00.173946 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28bc3f7-91ff-4ca8-9f8a-cd321e088528 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:32:00.196800 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28bc3f7-91ff-4ca8-9f8a-cd321e088528 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:32:00.206395 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81a0279-fb0e-4185-80b4-7b7dedd85aef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214d9071042c4bad886bf060a079b6e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:32:00.207989 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81a0279-fb0e-4185-80b4-7b7dedd85aef service nova] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:32:00.208558 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81a0279-fb0e-4185-80b4-7b7dedd85aef service nova] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:32:00.209193 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81a0279-fb0e-4185-80b4-7b7dedd85aef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:32:00.227611 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81a0279-fb0e-4185-80b4-7b7dedd85aef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:32:00.230621 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81a0279-fb0e-4185-80b4-7b7dedd85aef service nova] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:32:00.248811 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 705/1394] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:32:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:32:02.349546 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2214d113-bd74-442b-ae56-4fe5a6e9b65c None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:32:02.350237 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2214d113-bd74-442b-ae56-4fe5a6e9b65c None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:32:02.350237 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2214d113-bd74-442b-ae56-4fe5a6e9b65c None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:32:02.351545 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 690/1395] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:32:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:32:02.357195 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d2ac54-5e4b-459b-b954-21e33d630a89 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:32:02.357661 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d2ac54-5e4b-459b-b954-21e33d630a89 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:32:02.357766 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d2ac54-5e4b-459b-b954-21e33d630a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:32:02.376752 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-56d2ac54-5e4b-459b-b954-21e33d630a89 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:32:02.377933 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-56d2ac54-5e4b-459b-b954-21e33d630a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:32:02.386483 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 706/1396] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:32:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:32:02.430490 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2214d113-bd74-442b-ae56-4fe5a6e9b65c None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:32:02.447241 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2214d113-bd74-442b-ae56-4fe5a6e9b65c None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:32:02.454295 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c9f1b1-bcd6-45b8-83d2-5ebf203a4b35 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214d9071042c4bad886bf060a079b6e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:32:02.454951 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c9f1b1-bcd6-45b8-83d2-5ebf203a4b35 service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:32:02.455238 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c9f1b1-bcd6-45b8-83d2-5ebf203a4b35 service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:32:02.455554 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c9f1b1-bcd6-45b8-83d2-5ebf203a4b35 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:32:02.464289 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c9f1b1-bcd6-45b8-83d2-5ebf203a4b35 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:32:02.466309 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c9f1b1-bcd6-45b8-83d2-5ebf203a4b35 service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:32:02.476778 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 691/1397] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:32:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:32:02.973438 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896b5473-fa44-4f39-873c-265fa4434cfd None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:32:02.973732 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896b5473-fa44-4f39-873c-265fa4434cfd None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:32:02.974022 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896b5473-fa44-4f39-873c-265fa4434cfd None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:32:02.975469 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 707/1398] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:32:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:32:02.981006 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312f3ecd-4ed6-40e9-8a03-61259572bfb7 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:32:02.981305 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312f3ecd-4ed6-40e9-8a03-61259572bfb7 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:32:02.981560 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312f3ecd-4ed6-40e9-8a03-61259572bfb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:32:03.001284 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-312f3ecd-4ed6-40e9-8a03-61259572bfb7 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:32:03.002496 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-312f3ecd-4ed6-40e9-8a03-61259572bfb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:32:03.011023 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 692/1399] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:32:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:32:03.066968 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c0533a-ba19-452a-a1e9-e5045b69ca0f None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:32:03.067233 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c0533a-ba19-452a-a1e9-e5045b69ca0f None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:32:03.067574 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c0533a-ba19-452a-a1e9-e5045b69ca0f None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:32:03.069040 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 708/1400] 10.222.0.36 () {54 vars in 962 bytes} [Fri Jun 24 22:32:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:32:03.074398 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bcb61c-6de3-488c-86fd-bf9256fa3f1f None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:32:03.075105 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bcb61c-6de3-488c-86fd-bf9256fa3f1f None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:32:03.075105 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bcb61c-6de3-488c-86fd-bf9256fa3f1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:32:03.127175 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-97bcb61c-6de3-488c-86fd-bf9256fa3f1f None None] MFA Rules not processed for user `d156158fa06647569a8bb2d8d0019f28`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:32:03.128423 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-97bcb61c-6de3-488c-86fd-bf9256fa3f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:32:03.197778 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 693/1401] 10.222.0.36 () {58 vars in 1059 bytes} [Fri Jun 24 22:32:03 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:32:03.207405 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c0533a-ba19-452a-a1e9-e5045b69ca0f None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:32:03.220491 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c0533a-ba19-452a-a1e9-e5045b69ca0f None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:32:03.224148 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7d8dac-6bf8-41f8-9e22-3defcbb50b85 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd156158fa06647569a8bb2d8d0019f28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:32:03.224735 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7d8dac-6bf8-41f8-9e22-3defcbb50b85 service glance] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:32:03.225016 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7d8dac-6bf8-41f8-9e22-3defcbb50b85 service glance] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:32:03.225276 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7d8dac-6bf8-41f8-9e22-3defcbb50b85 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:32:03.235033 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7d8dac-6bf8-41f8-9e22-3defcbb50b85 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:32:03.236532 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7d8dac-6bf8-41f8-9e22-3defcbb50b85 service glance] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:32:03.247389 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 709/1402] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:32:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:32:03.968077 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9038f250-bfae-4ec6-8e19-e3951bb71a5d None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:32:03.968601 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9038f250-bfae-4ec6-8e19-e3951bb71a5d None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:32:03.968705 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9038f250-bfae-4ec6-8e19-e3951bb71a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:32:04.021570 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-9038f250-bfae-4ec6-8e19-e3951bb71a5d None None] MFA Rules not processed for user `542ea2e5a8114792836d0cdfd36b4c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:32:04.022810 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-9038f250-bfae-4ec6-8e19-e3951bb71a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:32:04.066115 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:32:04.090602 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 694/1403] 10.222.0.36 () {58 vars in 1009 bytes} [Fri Jun 24 22:32:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:32:04.136519 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132a7697-32c4-4200-af2f-23820494ed2e None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:32:04.136993 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132a7697-32c4-4200-af2f-23820494ed2e None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:32:04.137485 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132a7697-32c4-4200-af2f-23820494ed2e None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:32:04.139051 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 710/1404] 10.222.0.36 () {54 vars in 942 bytes} [Fri Jun 24 22:32:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:32:04.145987 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e69ab83-8087-4d4f-959a-9588a40165ca None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:32:04.146238 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e69ab83-8087-4d4f-959a-9588a40165ca None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:32:04.146523 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e69ab83-8087-4d4f-959a-9588a40165ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:32:04.196127 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-2e69ab83-8087-4d4f-959a-9588a40165ca None None] MFA Rules not processed for user `6b95846f7f2a453f85ddb41a5d3327f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:32:04.197396 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-2e69ab83-8087-4d4f-959a-9588a40165ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:32:04.276251 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 695/1405] 10.222.0.36 () {58 vars in 1039 bytes} [Fri Jun 24 22:32:04 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:32:04.285925 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132a7697-32c4-4200-af2f-23820494ed2e None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:32:04.301008 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132a7697-32c4-4200-af2f-23820494ed2e None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:32:04.306544 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75005979-dbca-435e-a3c5-ee5286afe2ff service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b95846f7f2a453f85ddb41a5d3327f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:32:04.307185 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75005979-dbca-435e-a3c5-ee5286afe2ff service swift] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:32:04.307494 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75005979-dbca-435e-a3c5-ee5286afe2ff service swift] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:32:04.307764 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75005979-dbca-435e-a3c5-ee5286afe2ff service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:32:04.316900 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75005979-dbca-435e-a3c5-ee5286afe2ff service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:32:04.318520 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75005979-dbca-435e-a3c5-ee5286afe2ff service swift] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:32:04.327340 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 711/1406] 10.222.0.36 () {60 vars in 1384 bytes} [Fri Jun 24 22:32:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 22:32:04.571671 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1553f2fe-0114-481a-b017-dc81725f9b6d None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:32:04.571968 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1553f2fe-0114-481a-b017-dc81725f9b6d None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:32:04.572426 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1553f2fe-0114-481a-b017-dc81725f9b6d None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:32:04.573943 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 696/1407] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:32:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:32:04.579556 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d122f9a3-8d2b-4b97-9deb-23e0e1969389 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:32:04.579840 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d122f9a3-8d2b-4b97-9deb-23e0e1969389 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:32:04.580393 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d122f9a3-8d2b-4b97-9deb-23e0e1969389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:32:04.586675 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=67 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:32:04.601644 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-d122f9a3-8d2b-4b97-9deb-23e0e1969389 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:32:04.603074 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-d122f9a3-8d2b-4b97-9deb-23e0e1969389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:32:04.613112 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 712/1408] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:32:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:32:04.657458 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1553f2fe-0114-481a-b017-dc81725f9b6d None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:32:04.674588 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1553f2fe-0114-481a-b017-dc81725f9b6d None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:32:04.680120 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a807aa-0ae3-475e-a103-8f0c4f099a2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214d9071042c4bad886bf060a079b6e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:32:04.680763 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a807aa-0ae3-475e-a103-8f0c4f099a2d service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:32:04.681048 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a807aa-0ae3-475e-a103-8f0c4f099a2d service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:32:04.681324 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a807aa-0ae3-475e-a103-8f0c4f099a2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:32:04.690326 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a807aa-0ae3-475e-a103-8f0c4f099a2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:32:04.692227 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a807aa-0ae3-475e-a103-8f0c4f099a2d service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:32:04.708197 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 697/1409] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:32:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:32:14.595412 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=2 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:32:14.702483 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=59 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:32:26.537635 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa820c9-122a-48b9-95fa-eb861d8a217b None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:32:26.538225 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa820c9-122a-48b9-95fa-eb861d8a217b None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:32:26.538225 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa820c9-122a-48b9-95fa-eb861d8a217b None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:32:26.539588 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 713/1410] 10.222.0.36 () {54 vars in 918 bytes} [Fri Jun 24 22:32:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:32:26.545671 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82bcbcb-a041-4eae-b101-2bb04d16d9de None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:32:26.546152 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82bcbcb-a041-4eae-b101-2bb04d16d9de None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:32:26.546256 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82bcbcb-a041-4eae-b101-2bb04d16d9de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:32:26.565915 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-d82bcbcb-a041-4eae-b101-2bb04d16d9de None None] MFA Rules not processed for user `0233b357708643be94c0ade17ac1fb3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:32:26.567131 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-d82bcbcb-a041-4eae-b101-2bb04d16d9de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:32:26.577404 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 698/1411] 10.222.0.36 () {58 vars in 1015 bytes} [Fri Jun 24 22:32:26 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:32:26.593970 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be08e275-d277-48f5-8979-a992370bbe45 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:32:26.594261 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be08e275-d277-48f5-8979-a992370bbe45 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:32:26.594550 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be08e275-d277-48f5-8979-a992370bbe45 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:32:26.595945 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 714/1412] 10.222.0.36 () {54 vars in 918 bytes} [Fri Jun 24 22:32:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:32:26.600580 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac0ac55-3d23-4631-99d1-f060943df1b1 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:32:26.600873 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac0ac55-3d23-4631-99d1-f060943df1b1 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:32:26.601177 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac0ac55-3d23-4631-99d1-f060943df1b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:32:26.620430 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-dac0ac55-3d23-4631-99d1-f060943df1b1 None None] MFA Rules not processed for user `214d9071042c4bad886bf060a079b6e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:32:26.621617 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-dac0ac55-3d23-4631-99d1-f060943df1b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:32:26.632329 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 699/1413] 10.222.0.36 () {58 vars in 1015 bytes} [Fri Jun 24 22:32:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:32:29.136776 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d75ea36-e0fa-485a-8660-7f27c05476a8 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:32:29.137636 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d75ea36-e0fa-485a-8660-7f27c05476a8 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:32:29.137636 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d75ea36-e0fa-485a-8660-7f27c05476a8 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:32:29.140139 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 715/1414] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 22:32:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:32:29.145757 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5647cb-643f-4f90-8c66-c40358fe0f2b None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:32:29.146209 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5647cb-643f-4f90-8c66-c40358fe0f2b None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:32:29.146316 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5647cb-643f-4f90-8c66-c40358fe0f2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:32:29.165745 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-aa5647cb-643f-4f90-8c66-c40358fe0f2b None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:32:29.166958 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-aa5647cb-643f-4f90-8c66-c40358fe0f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:32:29.175873 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 700/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 22:32:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:32:29.221153 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d75ea36-e0fa-485a-8660-7f27c05476a8 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:32:29.236838 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d75ea36-e0fa-485a-8660-7f27c05476a8 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:32:29.242313 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7b4704-1758-4cb2-ab43-e4dfd6f95b33 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214d9071042c4bad886bf060a079b6e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:32:29.242949 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b4704-1758-4cb2-ab43-e4dfd6f95b33 service nova] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:32:29.243225 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b4704-1758-4cb2-ab43-e4dfd6f95b33 service nova] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:32:29.243527 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b4704-1758-4cb2-ab43-e4dfd6f95b33 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:32:29.252207 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7b4704-1758-4cb2-ab43-e4dfd6f95b33 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:32:29.253831 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7b4704-1758-4cb2-ab43-e4dfd6f95b33 service nova] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:32:29.263264 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 716/1416] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:32:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:32:30.159171 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ff4694-5253-4f97-99e1-be9b360c1cc2 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:32:30.159829 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ff4694-5253-4f97-99e1-be9b360c1cc2 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:32:30.159829 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ff4694-5253-4f97-99e1-be9b360c1cc2 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:32:30.161147 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 701/1417] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 22:32:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:32:30.168188 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdecef83-5867-47e8-977c-4f6d5edeaa70 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:32:30.168909 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdecef83-5867-47e8-977c-4f6d5edeaa70 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:32:30.169105 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdecef83-5867-47e8-977c-4f6d5edeaa70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:32:30.193930 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-bdecef83-5867-47e8-977c-4f6d5edeaa70 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:32:30.195121 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-bdecef83-5867-47e8-977c-4f6d5edeaa70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:32:30.204803 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 717/1418] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 22:32:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:32:30.358035 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ff4694-5253-4f97-99e1-be9b360c1cc2 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:32:30.383643 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ff4694-5253-4f97-99e1-be9b360c1cc2 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:32:30.392211 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a4c1ae-7a00-44eb-8dca-a4da4d00ca9f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214d9071042c4bad886bf060a079b6e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:32:30.392893 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a4c1ae-7a00-44eb-8dca-a4da4d00ca9f service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:32:30.393174 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a4c1ae-7a00-44eb-8dca-a4da4d00ca9f service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:32:30.393442 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a4c1ae-7a00-44eb-8dca-a4da4d00ca9f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:32:30.402573 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a4c1ae-7a00-44eb-8dca-a4da4d00ca9f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:32:30.404266 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a4c1ae-7a00-44eb-8dca-a4da4d00ca9f service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:32:30.414451 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 702/1419] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:32:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:32:31.296357 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a2cbc-253a-4439-9579-0601371f9294 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:32:31.296930 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a2cbc-253a-4439-9579-0601371f9294 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:32:31.296930 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a2cbc-253a-4439-9579-0601371f9294 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:32:31.298451 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 718/1420] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 22:32:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:32:31.306598 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec278b45-90ee-4203-9bb8-90f6878dce2c None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:32:31.307077 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec278b45-90ee-4203-9bb8-90f6878dce2c None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:32:31.307180 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec278b45-90ee-4203-9bb8-90f6878dce2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:32:31.332624 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-ec278b45-90ee-4203-9bb8-90f6878dce2c None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:32:31.333798 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-ec278b45-90ee-4203-9bb8-90f6878dce2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:32:31.343671 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 703/1421] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 22:32:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:32:31.495334 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0a2cbc-253a-4439-9579-0601371f9294 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:32:31.511196 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0a2cbc-253a-4439-9579-0601371f9294 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:32:31.518410 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a199389-b1dc-43fb-a1f6-2e534cb845ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214d9071042c4bad886bf060a079b6e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:32:31.519046 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a199389-b1dc-43fb-a1f6-2e534cb845ce service nova] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:32:31.519434 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a199389-b1dc-43fb-a1f6-2e534cb845ce service nova] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:32:31.519709 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a199389-b1dc-43fb-a1f6-2e534cb845ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:32:31.528785 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a199389-b1dc-43fb-a1f6-2e534cb845ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:32:31.530554 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a199389-b1dc-43fb-a1f6-2e534cb845ce service nova] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:32:31.545407 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 719/1422] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:32:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:32:32.427710 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30d37d2-75ed-48fb-a617-20a2eda76cf5 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:32:32.428329 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30d37d2-75ed-48fb-a617-20a2eda76cf5 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:32:32.428329 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30d37d2-75ed-48fb-a617-20a2eda76cf5 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:32:32.429755 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 704/1423] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 22:32:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:32:32.435020 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155d8306-d198-4f89-9ca8-f9d80e8156e7 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:32:32.435517 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155d8306-d198-4f89-9ca8-f9d80e8156e7 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:32:32.435672 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155d8306-d198-4f89-9ca8-f9d80e8156e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:32:32.455394 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-155d8306-d198-4f89-9ca8-f9d80e8156e7 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:32:32.456600 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-155d8306-d198-4f89-9ca8-f9d80e8156e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:32:32.466304 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 720/1424] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 22:32:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 22:32:32.622111 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30d37d2-75ed-48fb-a617-20a2eda76cf5 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:32:32.643641 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30d37d2-75ed-48fb-a617-20a2eda76cf5 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:32:32.649732 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f7d141-a2a8-4f4c-abe3-05d7da0d7a16 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214d9071042c4bad886bf060a079b6e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:32:32.650393 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f7d141-a2a8-4f4c-abe3-05d7da0d7a16 service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:32:32.650673 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f7d141-a2a8-4f4c-abe3-05d7da0d7a16 service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:32:32.650945 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f7d141-a2a8-4f4c-abe3-05d7da0d7a16 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:32:32.664982 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f7d141-a2a8-4f4c-abe3-05d7da0d7a16 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:32:32.667432 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f7d141-a2a8-4f4c-abe3-05d7da0d7a16 service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:32:32.678430 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 705/1425] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:32:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:32:33.537166 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e66a66-dbc9-4f69-b409-86803e7c9abd None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:32:33.538040 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e66a66-dbc9-4f69-b409-86803e7c9abd None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:32:33.538040 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e66a66-dbc9-4f69-b409-86803e7c9abd None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:32:33.540351 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 721/1426] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 22:32:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:32:33.546057 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf0fbba-10a8-48fb-9419-d4ac863f83c9 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:32:33.546490 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf0fbba-10a8-48fb-9419-d4ac863f83c9 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:32:33.546601 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf0fbba-10a8-48fb-9419-d4ac863f83c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:32:33.566596 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-aaf0fbba-10a8-48fb-9419-d4ac863f83c9 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:32:33.567897 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-aaf0fbba-10a8-48fb-9419-d4ac863f83c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:32:33.577001 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 706/1427] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 22:32:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:32:33.733077 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e66a66-dbc9-4f69-b409-86803e7c9abd None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:32:33.754909 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e66a66-dbc9-4f69-b409-86803e7c9abd None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:32:33.760833 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0841fbb-f525-4c20-9f85-624ccae0bb2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214d9071042c4bad886bf060a079b6e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:32:33.761460 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0841fbb-f525-4c20-9f85-624ccae0bb2e service nova] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:32:33.761744 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0841fbb-f525-4c20-9f85-624ccae0bb2e service nova] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:32:33.762018 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0841fbb-f525-4c20-9f85-624ccae0bb2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:32:33.770209 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0841fbb-f525-4c20-9f85-624ccae0bb2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:32:33.771834 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0841fbb-f525-4c20-9f85-624ccae0bb2e service nova] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:32:33.782262 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 722/1428] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:32:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:32:34.601476 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f857dcdd-ec96-4e0f-a543-3d20a833fe91 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:32:34.602400 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f857dcdd-ec96-4e0f-a543-3d20a833fe91 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:32:34.602400 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f857dcdd-ec96-4e0f-a543-3d20a833fe91 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:32:34.604641 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 707/1429] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 22:32:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:32:34.609845 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fd2e7e-e738-4190-b141-78cf5bbfc7ac None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:32:34.610303 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fd2e7e-e738-4190-b141-78cf5bbfc7ac None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:32:34.610397 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fd2e7e-e738-4190-b141-78cf5bbfc7ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:32:34.633113 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-c7fd2e7e-e738-4190-b141-78cf5bbfc7ac None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:32:34.634930 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-c7fd2e7e-e738-4190-b141-78cf5bbfc7ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:32:34.649280 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 723/1430] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 22:32:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:32:34.813200 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f857dcdd-ec96-4e0f-a543-3d20a833fe91 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:32:34.834334 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f857dcdd-ec96-4e0f-a543-3d20a833fe91 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:32:34.841894 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdfa4e2-489a-4b9e-907d-aef72f7abb63 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214d9071042c4bad886bf060a079b6e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:32:34.842532 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdfa4e2-489a-4b9e-907d-aef72f7abb63 service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:32:34.842813 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdfa4e2-489a-4b9e-907d-aef72f7abb63 service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:32:34.843067 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdfa4e2-489a-4b9e-907d-aef72f7abb63 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:32:34.851840 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdfa4e2-489a-4b9e-907d-aef72f7abb63 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:32:34.853424 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdfa4e2-489a-4b9e-907d-aef72f7abb63 service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:32:34.863006 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 708/1431] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:32:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:32:35.674898 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705ee0c8-dcaa-42ae-aba1-26d499e1e0b0 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:32:35.675860 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705ee0c8-dcaa-42ae-aba1-26d499e1e0b0 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:32:35.675860 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705ee0c8-dcaa-42ae-aba1-26d499e1e0b0 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:32:35.678116 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 724/1432] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 22:32:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:32:35.687622 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6b546e-057b-4fe1-9f25-080285b69d36 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:32:35.688070 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6b546e-057b-4fe1-9f25-080285b69d36 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:32:35.688175 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6b546e-057b-4fe1-9f25-080285b69d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:32:35.711548 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-6a6b546e-057b-4fe1-9f25-080285b69d36 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:32:35.712731 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-6a6b546e-057b-4fe1-9f25-080285b69d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:32:35.721310 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 709/1433] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 22:32:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:32:35.870260 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705ee0c8-dcaa-42ae-aba1-26d499e1e0b0 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:32:35.895708 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705ee0c8-dcaa-42ae-aba1-26d499e1e0b0 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:32:35.903080 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975fd22b-e3ea-433a-81c7-5e3544fd395f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214d9071042c4bad886bf060a079b6e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:32:35.903759 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975fd22b-e3ea-433a-81c7-5e3544fd395f service nova] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:32:35.904046 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975fd22b-e3ea-433a-81c7-5e3544fd395f service nova] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:32:35.905042 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975fd22b-e3ea-433a-81c7-5e3544fd395f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:32:35.913612 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975fd22b-e3ea-433a-81c7-5e3544fd395f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:32:35.915213 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975fd22b-e3ea-433a-81c7-5e3544fd395f service nova] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:32:35.924801 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 725/1434] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:32:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:32:36.728136 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a105567-92ae-43d8-bf71-19251279de23 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:32:36.728673 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a105567-92ae-43d8-bf71-19251279de23 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:32:36.728673 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a105567-92ae-43d8-bf71-19251279de23 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:32:36.729997 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 710/1435] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 22:32:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:32:36.736680 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e5444-eeb2-4eef-be5b-c5f237357321 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:32:36.737435 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e5444-eeb2-4eef-be5b-c5f237357321 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:32:36.737629 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e5444-eeb2-4eef-be5b-c5f237357321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:32:36.761319 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-f84e5444-eeb2-4eef-be5b-c5f237357321 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:32:36.762509 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-f84e5444-eeb2-4eef-be5b-c5f237357321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:32:36.771651 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 726/1436] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 22:32:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:32:36.922722 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a105567-92ae-43d8-bf71-19251279de23 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:32:36.942261 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a105567-92ae-43d8-bf71-19251279de23 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:32:36.948721 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3795d53-4c12-495f-bb88-0613e4ac9c59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214d9071042c4bad886bf060a079b6e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:32:36.949409 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3795d53-4c12-495f-bb88-0613e4ac9c59 service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:32:36.949688 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3795d53-4c12-495f-bb88-0613e4ac9c59 service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:32:36.949962 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3795d53-4c12-495f-bb88-0613e4ac9c59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:32:36.958660 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3795d53-4c12-495f-bb88-0613e4ac9c59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:32:36.960341 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3795d53-4c12-495f-bb88-0613e4ac9c59 service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:32:36.970253 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 711/1437] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:32:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 22:32:37.803541 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb8647-6b73-4c20-9f12-599de994f554 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:32:37.804147 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb8647-6b73-4c20-9f12-599de994f554 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:32:37.804147 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb8647-6b73-4c20-9f12-599de994f554 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:32:37.805398 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 727/1438] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 22:32:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:32:37.811604 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f6beab-9561-48c3-8e5a-7f7c38bfc920 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:32:37.812117 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f6beab-9561-48c3-8e5a-7f7c38bfc920 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:32:37.812220 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f6beab-9561-48c3-8e5a-7f7c38bfc920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:32:37.836391 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-72f6beab-9561-48c3-8e5a-7f7c38bfc920 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:32:37.837605 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-72f6beab-9561-48c3-8e5a-7f7c38bfc920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:32:37.847904 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 712/1439] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 22:32:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:32:38.005431 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fb8647-6b73-4c20-9f12-599de994f554 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:32:38.024757 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fb8647-6b73-4c20-9f12-599de994f554 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:32:38.030952 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4f89f2-0385-4df2-9999-72cc5056dd53 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214d9071042c4bad886bf060a079b6e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:32:38.031621 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4f89f2-0385-4df2-9999-72cc5056dd53 service nova] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:32:38.031903 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4f89f2-0385-4df2-9999-72cc5056dd53 service nova] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:32:38.032179 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4f89f2-0385-4df2-9999-72cc5056dd53 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:32:38.040808 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4f89f2-0385-4df2-9999-72cc5056dd53 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:32:38.042417 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4f89f2-0385-4df2-9999-72cc5056dd53 service nova] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:32:38.052287 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 728/1440] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:32:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:32:39.984701 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac15d7fa-2fc0-4381-b2d9-11e93cec7e2d None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:32:39.985560 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac15d7fa-2fc0-4381-b2d9-11e93cec7e2d None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:32:39.985560 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac15d7fa-2fc0-4381-b2d9-11e93cec7e2d None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:32:39.987753 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 713/1441] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 22:32:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:32:39.993111 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaee3cf5-92c5-4d35-8602-6b27a8bfa2cb None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:32:39.993551 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaee3cf5-92c5-4d35-8602-6b27a8bfa2cb None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:32:39.993647 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaee3cf5-92c5-4d35-8602-6b27a8bfa2cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:32:40.012518 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-aaee3cf5-92c5-4d35-8602-6b27a8bfa2cb None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:32:40.013849 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-aaee3cf5-92c5-4d35-8602-6b27a8bfa2cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:32:40.023222 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 729/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 22:32:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:32:40.061924 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac15d7fa-2fc0-4381-b2d9-11e93cec7e2d None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:32:40.074676 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac15d7fa-2fc0-4381-b2d9-11e93cec7e2d None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:32:40.079469 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f90c06-4a90-4fb1-88ce-c24e56f897da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:32:40.080117 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f90c06-4a90-4fb1-88ce-c24e56f897da service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:32:40.080396 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f90c06-4a90-4fb1-88ce-c24e56f897da service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:32:40.080667 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f90c06-4a90-4fb1-88ce-c24e56f897da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:32:40.090124 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f90c06-4a90-4fb1-88ce-c24e56f897da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:32:40.091609 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f90c06-4a90-4fb1-88ce-c24e56f897da service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:32:40.101225 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 714/1443] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:32:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:32:42.264147 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9930f73-2fb8-47bb-9b20-9345846ee51f None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:32:42.264810 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9930f73-2fb8-47bb-9b20-9345846ee51f None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:32:42.264810 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9930f73-2fb8-47bb-9b20-9345846ee51f None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:32:42.266067 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 730/1444] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 22:32:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:32:42.274766 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc4d920-91f9-483a-b6cc-c7090f852a6c None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:32:42.275557 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc4d920-91f9-483a-b6cc-c7090f852a6c None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:32:42.275730 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc4d920-91f9-483a-b6cc-c7090f852a6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:32:42.301604 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-abc4d920-91f9-483a-b6cc-c7090f852a6c None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:32:42.302848 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-abc4d920-91f9-483a-b6cc-c7090f852a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:32:42.311627 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 715/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 22:32:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:32:42.352358 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9930f73-2fb8-47bb-9b20-9345846ee51f None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:32:42.355337 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-a9930f73-2fb8-47bb-9b20-9345846ee51f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:32:42.369798 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9930f73-2fb8-47bb-9b20-9345846ee51f None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:32:42.373490 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fa8728-0056-4aaf-ad62-4c1640eb362d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:32:42.374125 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fa8728-0056-4aaf-ad62-4c1640eb362d service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:32:42.374402 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fa8728-0056-4aaf-ad62-4c1640eb362d service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:32:42.374677 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fa8728-0056-4aaf-ad62-4c1640eb362d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:32:42.385922 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fa8728-0056-4aaf-ad62-4c1640eb362d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:32:42.387412 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fa8728-0056-4aaf-ad62-4c1640eb362d service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:32:42.397795 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 731/1446] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:32:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:32:44.712867 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c9b39e-6e42-4780-97f4-f085243de1d9 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:32:44.713766 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c9b39e-6e42-4780-97f4-f085243de1d9 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:32:44.713766 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c9b39e-6e42-4780-97f4-f085243de1d9 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:32:44.715959 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 716/1447] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 22:32:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:32:44.721570 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b451a91-fad1-4228-8e25-cd32d008fcf8 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:32:44.722040 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b451a91-fad1-4228-8e25-cd32d008fcf8 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:32:44.722150 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b451a91-fad1-4228-8e25-cd32d008fcf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:32:44.741809 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-1b451a91-fad1-4228-8e25-cd32d008fcf8 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:32:44.743022 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-1b451a91-fad1-4228-8e25-cd32d008fcf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:32:44.751879 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 732/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 22:32:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:32:44.794673 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c9b39e-6e42-4780-97f4-f085243de1d9 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:32:44.806802 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c9b39e-6e42-4780-97f4-f085243de1d9 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:32:44.810850 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fede81-7139-4199-9596-927a8b6b1e92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:32:44.811522 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fede81-7139-4199-9596-927a8b6b1e92 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:32:44.811790 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fede81-7139-4199-9596-927a8b6b1e92 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:32:44.812068 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fede81-7139-4199-9596-927a8b6b1e92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:32:44.821323 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fede81-7139-4199-9596-927a8b6b1e92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:32:44.822772 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fede81-7139-4199-9596-927a8b6b1e92 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:32:44.832587 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 717/1449] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:32:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:32:47.009695 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb97e41-7770-4d98-b2c8-3098af36dc8d None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:32:47.010428 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb97e41-7770-4d98-b2c8-3098af36dc8d None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:32:47.010428 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb97e41-7770-4d98-b2c8-3098af36dc8d None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:32:47.012859 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 733/1450] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 22:32:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:32:47.019451 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67177bbb-f1d6-4c75-aab9-c22ffc96d4f0 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:32:47.019891 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67177bbb-f1d6-4c75-aab9-c22ffc96d4f0 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:32:47.020001 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67177bbb-f1d6-4c75-aab9-c22ffc96d4f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:32:47.044899 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-67177bbb-f1d6-4c75-aab9-c22ffc96d4f0 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:32:47.046975 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-67177bbb-f1d6-4c75-aab9-c22ffc96d4f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:32:47.056606 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 718/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 22:32:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:32:47.095487 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb97e41-7770-4d98-b2c8-3098af36dc8d None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:32:47.109274 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb97e41-7770-4d98-b2c8-3098af36dc8d None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:32:47.113940 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61d0b5c-1a1f-429e-8e5b-88b0e247b407 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:32:47.114576 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61d0b5c-1a1f-429e-8e5b-88b0e247b407 service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:32:47.114856 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61d0b5c-1a1f-429e-8e5b-88b0e247b407 service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:32:47.115126 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61d0b5c-1a1f-429e-8e5b-88b0e247b407 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:32:47.126267 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61d0b5c-1a1f-429e-8e5b-88b0e247b407 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:32:47.127774 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61d0b5c-1a1f-429e-8e5b-88b0e247b407 service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:32:47.137723 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 734/1452] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:32:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:32:49.288022 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384117d6-c2e7-458c-9285-1f0cd1add91a None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:32:49.288937 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384117d6-c2e7-458c-9285-1f0cd1add91a None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:32:49.288937 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384117d6-c2e7-458c-9285-1f0cd1add91a None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:32:49.291200 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 719/1453] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 22:32:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:32:49.296994 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c575d-e7a6-456b-b9de-bfce6d202b7f None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:32:49.297442 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c575d-e7a6-456b-b9de-bfce6d202b7f None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:32:49.297574 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c575d-e7a6-456b-b9de-bfce6d202b7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:32:49.316821 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-ae3c575d-e7a6-456b-b9de-bfce6d202b7f None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:32:49.318020 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-ae3c575d-e7a6-456b-b9de-bfce6d202b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:32:49.326484 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 735/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 22:32:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:32:49.379829 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384117d6-c2e7-458c-9285-1f0cd1add91a None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:32:49.392358 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384117d6-c2e7-458c-9285-1f0cd1add91a None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:32:49.396432 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0c0528-d803-4673-b76d-1bd67a5bd1ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:32:49.397061 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0c0528-d803-4673-b76d-1bd67a5bd1ca service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:32:49.397335 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0c0528-d803-4673-b76d-1bd67a5bd1ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:32:49.397609 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0c0528-d803-4673-b76d-1bd67a5bd1ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:32:49.407597 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0c0528-d803-4673-b76d-1bd67a5bd1ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:32:49.409014 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0c0528-d803-4673-b76d-1bd67a5bd1ca service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:32:49.418918 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 720/1455] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:32:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:32:51.588765 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c9a61-fe13-4fa3-943d-94aaedcceb5f None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:32:51.589358 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c9a61-fe13-4fa3-943d-94aaedcceb5f None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:32:51.589358 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c9a61-fe13-4fa3-943d-94aaedcceb5f None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:32:51.590702 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 736/1456] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 22:32:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:32:51.597938 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ca062b-4757-43d5-b9ed-9c15de23313c None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:32:51.598686 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ca062b-4757-43d5-b9ed-9c15de23313c None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:32:51.598824 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ca062b-4757-43d5-b9ed-9c15de23313c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:32:51.626970 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-81ca062b-4757-43d5-b9ed-9c15de23313c None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:32:51.628745 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-81ca062b-4757-43d5-b9ed-9c15de23313c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:32:51.641353 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 721/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 22:32:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:32:51.679037 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6c9a61-fe13-4fa3-943d-94aaedcceb5f None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:32:51.691924 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6c9a61-fe13-4fa3-943d-94aaedcceb5f None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:32:51.696327 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491feda6-fd4d-454c-9c3d-89e8e80a41f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:32:51.696955 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491feda6-fd4d-454c-9c3d-89e8e80a41f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:32:51.697229 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491feda6-fd4d-454c-9c3d-89e8e80a41f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:32:51.697551 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491feda6-fd4d-454c-9c3d-89e8e80a41f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:32:51.708952 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491feda6-fd4d-454c-9c3d-89e8e80a41f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:32:51.711434 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491feda6-fd4d-454c-9c3d-89e8e80a41f3 service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:32:51.724603 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 737/1458] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:32:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:32:53.885615 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2fee99-656f-400a-a296-72c797d3048c None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:32:53.886448 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2fee99-656f-400a-a296-72c797d3048c None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:32:53.886448 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2fee99-656f-400a-a296-72c797d3048c None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:32:53.888637 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 722/1459] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 22:32:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:32:53.894070 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd8e82-d88e-4ead-9004-5769387d5186 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:32:53.894499 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd8e82-d88e-4ead-9004-5769387d5186 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:32:53.894609 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd8e82-d88e-4ead-9004-5769387d5186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:32:53.914593 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-e0cd8e82-d88e-4ead-9004-5769387d5186 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:32:53.915835 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-e0cd8e82-d88e-4ead-9004-5769387d5186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:32:53.928891 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 738/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 22:32:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:32:53.967196 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2fee99-656f-400a-a296-72c797d3048c None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:32:53.979664 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2fee99-656f-400a-a296-72c797d3048c None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:32:53.984097 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d587624a-5466-48d7-88cc-1477af69dd35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:32:53.984737 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d587624a-5466-48d7-88cc-1477af69dd35 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:32:53.985018 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d587624a-5466-48d7-88cc-1477af69dd35 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:32:53.985290 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d587624a-5466-48d7-88cc-1477af69dd35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:32:53.995447 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d587624a-5466-48d7-88cc-1477af69dd35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:32:53.996895 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d587624a-5466-48d7-88cc-1477af69dd35 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:32:54.007775 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 723/1461] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:32:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:32:56.079667 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80c771a-e463-42e7-8385-50c0c3728b0a None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:32:56.080600 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80c771a-e463-42e7-8385-50c0c3728b0a None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:32:56.080600 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80c771a-e463-42e7-8385-50c0c3728b0a None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:32:56.082751 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 739/1462] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 22:32:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:32:56.089258 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1a1b34-2732-46bf-80ea-5fa52c02b2c8 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:32:56.090008 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1a1b34-2732-46bf-80ea-5fa52c02b2c8 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:32:56.090168 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1a1b34-2732-46bf-80ea-5fa52c02b2c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:32:56.100469 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=79 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:32:56.116584 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-6c1a1b34-2732-46bf-80ea-5fa52c02b2c8 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:32:56.117785 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-6c1a1b34-2732-46bf-80ea-5fa52c02b2c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:32:56.127054 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 724/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 22:32:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:32:56.164490 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80c771a-e463-42e7-8385-50c0c3728b0a None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:32:56.171064 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=73 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:32:56.178028 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80c771a-e463-42e7-8385-50c0c3728b0a None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:32:56.182130 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8e3273-2dd0-4d7c-9f21-bb2faa372081 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:32:56.182770 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e3273-2dd0-4d7c-9f21-bb2faa372081 service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:32:56.183053 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e3273-2dd0-4d7c-9f21-bb2faa372081 service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:32:56.183366 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e3273-2dd0-4d7c-9f21-bb2faa372081 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:32:56.192563 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8e3273-2dd0-4d7c-9f21-bb2faa372081 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:32:56.194002 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8e3273-2dd0-4d7c-9f21-bb2faa372081 service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:32:56.203499 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 740/1464] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:32:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:32:58.263861 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07a767b-0726-4b61-999b-fdd6099c1676 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:32:58.264854 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07a767b-0726-4b61-999b-fdd6099c1676 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:32:58.264854 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07a767b-0726-4b61-999b-fdd6099c1676 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:32:58.266592 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 725/1465] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 22:32:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:32:58.272308 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aed16a0-1837-4bd8-9f39-ef9b11480560 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:32:58.272776 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aed16a0-1837-4bd8-9f39-ef9b11480560 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:32:58.272880 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aed16a0-1837-4bd8-9f39-ef9b11480560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:32:58.293217 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-2aed16a0-1837-4bd8-9f39-ef9b11480560 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:32:58.294413 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-2aed16a0-1837-4bd8-9f39-ef9b11480560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:32:58.303217 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 741/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 22:32:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:32:58.340926 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07a767b-0726-4b61-999b-fdd6099c1676 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:32:58.353508 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07a767b-0726-4b61-999b-fdd6099c1676 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:32:58.357231 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209ccb43-1c0a-40a2-b3ac-6bb43a52ff6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:32:58.357880 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209ccb43-1c0a-40a2-b3ac-6bb43a52ff6e service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:32:58.358242 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209ccb43-1c0a-40a2-b3ac-6bb43a52ff6e service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:32:58.358579 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209ccb43-1c0a-40a2-b3ac-6bb43a52ff6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:32:58.367466 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209ccb43-1c0a-40a2-b3ac-6bb43a52ff6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:32:58.368913 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209ccb43-1c0a-40a2-b3ac-6bb43a52ff6e service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:32:58.378736 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 726/1467] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:32:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:33:00.429666 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada99b16-b174-4d94-bdca-5fb2ab117ce8 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:33:00.430529 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada99b16-b174-4d94-bdca-5fb2ab117ce8 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:33:00.430529 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada99b16-b174-4d94-bdca-5fb2ab117ce8 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:33:00.432648 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 742/1468] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 22:33:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:33:00.439533 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9b5896-aa73-4baf-8071-c4f608539931 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:33:00.440214 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9b5896-aa73-4baf-8071-c4f608539931 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:33:00.440378 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9b5896-aa73-4baf-8071-c4f608539931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:33:00.462971 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-6e9b5896-aa73-4baf-8071-c4f608539931 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:33:00.464225 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-6e9b5896-aa73-4baf-8071-c4f608539931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:33:00.472829 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 727/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 22:33:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:33:00.512606 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada99b16-b174-4d94-bdca-5fb2ab117ce8 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:33:00.524426 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada99b16-b174-4d94-bdca-5fb2ab117ce8 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:33:00.528291 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcd9189-130a-45e0-85ee-2075e57d8f4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:33:00.528915 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcd9189-130a-45e0-85ee-2075e57d8f4c service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:33:00.529191 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcd9189-130a-45e0-85ee-2075e57d8f4c service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:33:00.529439 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcd9189-130a-45e0-85ee-2075e57d8f4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:33:00.538509 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcd9189-130a-45e0-85ee-2075e57d8f4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:33:00.539987 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcd9189-130a-45e0-85ee-2075e57d8f4c service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:33:00.549337 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 743/1470] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:33:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 22:33:10.457498 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=11 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:33:10.545121 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=14 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:33:20.525581 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e8a501-f883-4c89-ad17-2934e817c1be None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:33:20.526315 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e8a501-f883-4c89-ad17-2934e817c1be None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:33:20.526315 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e8a501-f883-4c89-ad17-2934e817c1be None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:33:20.528194 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 728/1471] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:33:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:33:20.533809 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987ff559-4cfa-4621-b6f8-944c0beac04f None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:33:20.534278 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987ff559-4cfa-4621-b6f8-944c0beac04f None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:33:20.534392 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987ff559-4cfa-4621-b6f8-944c0beac04f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:33:20.552960 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-987ff559-4cfa-4621-b6f8-944c0beac04f None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:33:20.554156 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-987ff559-4cfa-4621-b6f8-944c0beac04f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:33:20.568143 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 744/1472] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:33:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:33:20.620426 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282b2c7a-b7fe-4126-a9c0-f87c3f7df884 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:33:20.620764 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282b2c7a-b7fe-4126-a9c0-f87c3f7df884 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:33:20.621153 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282b2c7a-b7fe-4126-a9c0-f87c3f7df884 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:33:20.623146 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 729/1473] 10.222.0.36 () {54 vars in 962 bytes} [Fri Jun 24 22:33:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:33:20.631064 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07ac7f8-153e-418e-ab4b-7c80b01866a2 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:33:20.631563 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07ac7f8-153e-418e-ab4b-7c80b01866a2 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:33:20.632012 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07ac7f8-153e-418e-ab4b-7c80b01866a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:33:20.654233 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-d07ac7f8-153e-418e-ab4b-7c80b01866a2 None None] MFA Rules not processed for user `d156158fa06647569a8bb2d8d0019f28`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:33:20.656257 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-d07ac7f8-153e-418e-ab4b-7c80b01866a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:33:20.663888 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 745/1474] 10.222.0.36 () {58 vars in 1059 bytes} [Fri Jun 24 22:33:20 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:33:20.671377 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282b2c7a-b7fe-4126-a9c0-f87c3f7df884 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:33:20.683931 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282b2c7a-b7fe-4126-a9c0-f87c3f7df884 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:33:20.688933 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2104e8e-97b3-459a-a521-73ac7c15a7a5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd156158fa06647569a8bb2d8d0019f28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:33:20.689565 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2104e8e-97b3-459a-a521-73ac7c15a7a5 service glance] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:33:20.689853 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2104e8e-97b3-459a-a521-73ac7c15a7a5 service glance] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:33:20.690132 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2104e8e-97b3-459a-a521-73ac7c15a7a5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:33:20.700071 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2104e8e-97b3-459a-a521-73ac7c15a7a5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:33:20.701520 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2104e8e-97b3-459a-a521-73ac7c15a7a5 service glance] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:33:20.711935 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 730/1475] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:33:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:33:22.822821 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f15a67c-66f4-4e15-9b1b-b6f11787a453 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:33:22.823671 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f15a67c-66f4-4e15-9b1b-b6f11787a453 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:33:22.823671 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f15a67c-66f4-4e15-9b1b-b6f11787a453 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:33:22.825879 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 746/1476] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:33:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:33:22.831824 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c5885-a098-4ed3-b323-83d18cad117e None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:33:22.832240 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c5885-a098-4ed3-b323-83d18cad117e None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:33:22.832412 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c5885-a098-4ed3-b323-83d18cad117e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:33:22.851433 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-1e3c5885-a098-4ed3-b323-83d18cad117e None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:33:22.852639 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-1e3c5885-a098-4ed3-b323-83d18cad117e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:33:22.861503 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 731/1477] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:33:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:33:22.885628 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f15a67c-66f4-4e15-9b1b-b6f11787a453 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:33:22.900144 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f15a67c-66f4-4e15-9b1b-b6f11787a453 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:33:22.905649 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a20e7d-6d39-4ee0-b630-09435be97ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:33:22.906297 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a20e7d-6d39-4ee0-b630-09435be97ae5 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:33:22.906575 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a20e7d-6d39-4ee0-b630-09435be97ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:33:22.906845 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a20e7d-6d39-4ee0-b630-09435be97ae5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:33:22.907604 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a20e7d-6d39-4ee0-b630-09435be97ae5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:33:22.909367 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: WARNING py.warnings [None req-44a20e7d-6d39-4ee0-b630-09435be97ae5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 22:33:22.909367 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: warnings.warn(msg) Jun 24 22:33:22.909367 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: Jun 24 22:33:22.910513 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a20e7d-6d39-4ee0-b630-09435be97ae5 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:33:22.930114 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 747/1478] 10.222.0.36 () {56 vars in 1108 bytes} [Fri Jun 24 22:33:22 2022] GET /identity/v3/projects => generated 2553 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:33:24.992765 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da7102a-f6aa-41ff-9339-83fd41d9b5c5 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:33:24.993566 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da7102a-f6aa-41ff-9339-83fd41d9b5c5 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:33:24.993755 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da7102a-f6aa-41ff-9339-83fd41d9b5c5 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:33:24.995965 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 732/1479] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:33:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:33:25.003558 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75955d65-e6d2-4b4f-ab9e-dc49f2e4c369 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:33:25.004011 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75955d65-e6d2-4b4f-ab9e-dc49f2e4c369 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:33:25.004131 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75955d65-e6d2-4b4f-ab9e-dc49f2e4c369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:33:25.023604 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-75955d65-e6d2-4b4f-ab9e-dc49f2e4c369 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:33:25.024814 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-75955d65-e6d2-4b4f-ab9e-dc49f2e4c369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:33:25.033956 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 748/1480] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:33:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:33:25.083360 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da7102a-f6aa-41ff-9339-83fd41d9b5c5 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:33:25.100611 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da7102a-f6aa-41ff-9339-83fd41d9b5c5 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:33:25.107372 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bced812-02b0-4bb1-a353-38fa3b400193 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214d9071042c4bad886bf060a079b6e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:33:25.108209 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bced812-02b0-4bb1-a353-38fa3b400193 service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:33:25.108608 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bced812-02b0-4bb1-a353-38fa3b400193 service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:33:25.108911 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bced812-02b0-4bb1-a353-38fa3b400193 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:33:25.117575 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bced812-02b0-4bb1-a353-38fa3b400193 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:33:25.119182 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bced812-02b0-4bb1-a353-38fa3b400193 service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:33:25.129479 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 733/1481] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:33:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:33:27.339452 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6402464a-f93e-4980-a665-ab1b5397ad76 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:33:27.340053 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6402464a-f93e-4980-a665-ab1b5397ad76 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:33:27.340053 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6402464a-f93e-4980-a665-ab1b5397ad76 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:33:27.341389 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 749/1482] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:33:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:33:27.348212 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5013136f-9eb5-4e30-92b4-ab47d7a62e08 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:33:27.348923 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5013136f-9eb5-4e30-92b4-ab47d7a62e08 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:33:27.349086 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5013136f-9eb5-4e30-92b4-ab47d7a62e08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:33:27.368724 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-5013136f-9eb5-4e30-92b4-ab47d7a62e08 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:33:27.369910 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-5013136f-9eb5-4e30-92b4-ab47d7a62e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:33:27.378597 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 734/1483] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:33:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:33:27.416929 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6402464a-f93e-4980-a665-ab1b5397ad76 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:33:27.428413 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6402464a-f93e-4980-a665-ab1b5397ad76 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:33:27.432078 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff85ea20-c7df-4f1f-9b84-28542a254080 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:33:27.432742 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff85ea20-c7df-4f1f-9b84-28542a254080 service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:33:27.433026 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff85ea20-c7df-4f1f-9b84-28542a254080 service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:33:27.433359 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff85ea20-c7df-4f1f-9b84-28542a254080 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:33:27.443380 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff85ea20-c7df-4f1f-9b84-28542a254080 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:33:27.444834 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff85ea20-c7df-4f1f-9b84-28542a254080 service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:33:27.454787 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 750/1484] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:33:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 22:33:29.534385 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60326f70-31e7-4d4d-86f2-7e1b51996067 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:33:29.534954 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60326f70-31e7-4d4d-86f2-7e1b51996067 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:33:29.534954 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60326f70-31e7-4d4d-86f2-7e1b51996067 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:33:29.536391 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 735/1485] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:33:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:33:29.542138 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d47612-45d5-45d9-b1a5-b6f6cdaed23b None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:33:29.542513 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d47612-45d5-45d9-b1a5-b6f6cdaed23b None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:33:29.542734 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d47612-45d5-45d9-b1a5-b6f6cdaed23b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:33:29.563908 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-57d47612-45d5-45d9-b1a5-b6f6cdaed23b None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:33:29.565131 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-57d47612-45d5-45d9-b1a5-b6f6cdaed23b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:33:29.573518 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 751/1486] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:33:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:33:29.624027 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60326f70-31e7-4d4d-86f2-7e1b51996067 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:33:29.647197 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60326f70-31e7-4d4d-86f2-7e1b51996067 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:33:29.651696 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396d569f-ddf4-4c14-908d-686f47e86164 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:33:29.652337 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396d569f-ddf4-4c14-908d-686f47e86164 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:33:29.652619 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396d569f-ddf4-4c14-908d-686f47e86164 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:33:29.652892 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396d569f-ddf4-4c14-908d-686f47e86164 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:33:29.662706 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396d569f-ddf4-4c14-908d-686f47e86164 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:33:29.664182 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396d569f-ddf4-4c14-908d-686f47e86164 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:33:29.673909 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 736/1487] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:33:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:33:31.929694 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df25bfdd-d0a5-4d0c-86a6-76d061ab313a None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:33:31.930653 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df25bfdd-d0a5-4d0c-86a6-76d061ab313a None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:33:31.930653 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df25bfdd-d0a5-4d0c-86a6-76d061ab313a None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:33:31.932839 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 752/1488] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:33:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:33:31.938602 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a3568-14a1-4294-9582-107e776abc4c None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:33:31.939063 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a3568-14a1-4294-9582-107e776abc4c None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:33:31.939160 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a3568-14a1-4294-9582-107e776abc4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:33:31.959151 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-674a3568-14a1-4294-9582-107e776abc4c None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:33:31.960398 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-674a3568-14a1-4294-9582-107e776abc4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:33:31.969037 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 737/1489] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:33:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:33:32.009684 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df25bfdd-d0a5-4d0c-86a6-76d061ab313a None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:33:32.022907 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df25bfdd-d0a5-4d0c-86a6-76d061ab313a None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:33:32.027504 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421b138e-8341-4ea4-b4ef-8efdbab2dc26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:33:32.028391 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421b138e-8341-4ea4-b4ef-8efdbab2dc26 service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:33:32.028981 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421b138e-8341-4ea4-b4ef-8efdbab2dc26 service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:33:32.029376 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421b138e-8341-4ea4-b4ef-8efdbab2dc26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:33:32.044001 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421b138e-8341-4ea4-b4ef-8efdbab2dc26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:33:32.046126 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421b138e-8341-4ea4-b4ef-8efdbab2dc26 service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:33:32.055803 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 753/1490] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:33:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:33:34.285901 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9c8a36-da52-4f18-85be-c9b8def3f602 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:33:34.286533 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9c8a36-da52-4f18-85be-c9b8def3f602 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:33:34.286533 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9c8a36-da52-4f18-85be-c9b8def3f602 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:33:34.287846 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 738/1491] 10.222.0.36 () {54 vars in 926 bytes} [Fri Jun 24 22:33:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:33:34.294046 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b7740-fda6-438e-aba0-1ac37f07d57b None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:33:34.294831 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b7740-fda6-438e-aba0-1ac37f07d57b None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:33:34.295002 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b7740-fda6-438e-aba0-1ac37f07d57b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:33:34.314769 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-c55b7740-fda6-438e-aba0-1ac37f07d57b None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:33:34.315991 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-c55b7740-fda6-438e-aba0-1ac37f07d57b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:33:34.325339 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 754/1492] 10.222.0.36 () {58 vars in 1023 bytes} [Fri Jun 24 22:33:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:33:34.375041 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9c8a36-da52-4f18-85be-c9b8def3f602 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:33:34.390654 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9c8a36-da52-4f18-85be-c9b8def3f602 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:33:34.395873 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01bd6ad-238c-48f7-b8bf-fc41031d0c89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:33:34.396510 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01bd6ad-238c-48f7-b8bf-fc41031d0c89 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:33:34.396789 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01bd6ad-238c-48f7-b8bf-fc41031d0c89 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:33:34.397065 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01bd6ad-238c-48f7-b8bf-fc41031d0c89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:33:34.409719 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01bd6ad-238c-48f7-b8bf-fc41031d0c89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:33:34.411191 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01bd6ad-238c-48f7-b8bf-fc41031d0c89 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:33:34.421160 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 739/1493] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:33:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 22:33:44.309030 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=33 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:33:44.416768 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=33 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:35:18.921318 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b984c502-012f-4e57-aa5d-a50354505789 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:35:18.921965 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b984c502-012f-4e57-aa5d-a50354505789 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:35:18.921965 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b984c502-012f-4e57-aa5d-a50354505789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:35:18.947533 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-b984c502-012f-4e57-aa5d-a50354505789 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:35:18.948748 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-b984c502-012f-4e57-aa5d-a50354505789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:35:18.961478 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 755/1494] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:35:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:35:18.969889 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b15d21-a9ce-4366-b738-1bd1043ea988 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:35:18.970418 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b15d21-a9ce-4366-b738-1bd1043ea988 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:35:18.970418 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b15d21-a9ce-4366-b738-1bd1043ea988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:35:18.991355 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-82b15d21-a9ce-4366-b738-1bd1043ea988 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:35:18.992554 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-82b15d21-a9ce-4366-b738-1bd1043ea988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:35:19.001942 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 740/1495] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:35:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:35:19.007165 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b984c502-012f-4e57-aa5d-a50354505789 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:35:19.017245 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b984c502-012f-4e57-aa5d-a50354505789 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:35:19.023169 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264becb1-9cfa-4624-b0cb-c1b3a605549b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:35:19.023849 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264becb1-9cfa-4624-b0cb-c1b3a605549b admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:35:19.024130 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264becb1-9cfa-4624-b0cb-c1b3a605549b admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:35:19.024403 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264becb1-9cfa-4624-b0cb-c1b3a605549b admin admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:35:19.025126 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264becb1-9cfa-4624-b0cb-c1b3a605549b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:35:19.025428 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264becb1-9cfa-4624-b0cb-c1b3a605549b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:35:19.026459 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: WARNING py.warnings [None req-264becb1-9cfa-4624-b0cb-c1b3a605549b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 22:35:19.026459 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: warnings.warn(msg) Jun 24 22:35:19.026459 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: Jun 24 22:35:19.027704 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264becb1-9cfa-4624-b0cb-c1b3a605549b admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:35:19.042254 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 756/1496] 10.222.0.36 () {58 vars in 1152 bytes} [Fri Jun 24 22:35:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:35:19.050774 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b15d21-a9ce-4366-b738-1bd1043ea988 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:35:19.060833 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b15d21-a9ce-4366-b738-1bd1043ea988 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:35:19.066790 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f22cde-e2ac-4a01-824f-d3d58a76345e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:35:19.067701 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f22cde-e2ac-4a01-824f-d3d58a76345e admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:35:19.067981 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f22cde-e2ac-4a01-824f-d3d58a76345e admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:35:19.068256 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f22cde-e2ac-4a01-824f-d3d58a76345e admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:35:19.068938 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f22cde-e2ac-4a01-824f-d3d58a76345e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:35:19.070722 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: WARNING py.warnings [None req-b6f22cde-e2ac-4a01-824f-d3d58a76345e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 22:35:19.070722 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: warnings.warn(msg) Jun 24 22:35:19.070722 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: Jun 24 22:35:19.072006 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f22cde-e2ac-4a01-824f-d3d58a76345e admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:35:19.121999 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 741/1497] 10.222.0.36 () {60 vars in 1152 bytes} [Fri Jun 24 22:35:19 2022] POST /identity/v3/projects => generated 379 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:35:19.126568 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264becb1-9cfa-4624-b0cb-c1b3a605549b admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:35:19.137588 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264becb1-9cfa-4624-b0cb-c1b3a605549b admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:35:19.197783 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474e2ec2-51b6-4e25-bc4f-928854b1b686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:35:19.198372 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474e2ec2-51b6-4e25-bc4f-928854b1b686 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:35:19.198655 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474e2ec2-51b6-4e25-bc4f-928854b1b686 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:35:19.198925 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474e2ec2-51b6-4e25-bc4f-928854b1b686 admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:35:19.199796 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474e2ec2-51b6-4e25-bc4f-928854b1b686 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:35:19.200817 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: WARNING py.warnings [None req-474e2ec2-51b6-4e25-bc4f-928854b1b686 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 22:35:19.200817 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: warnings.warn(msg) Jun 24 22:35:19.200817 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: Jun 24 22:35:19.202107 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474e2ec2-51b6-4e25-bc4f-928854b1b686 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:35:19.227238 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 757/1498] 10.222.0.36 () {60 vars in 1143 bytes} [Fri Jun 24 22:35:19 2022] POST /identity/v3/users => generated 290 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:35:19.232530 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f22cde-e2ac-4a01-824f-d3d58a76345e admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:35:19.245119 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f22cde-e2ac-4a01-824f-d3d58a76345e admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:35:19.250049 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96c4fc1-5c30-4564-a498-eac571b81512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:35:19.250906 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c4fc1-5c30-4564-a498-eac571b81512 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:35:19.251190 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c4fc1-5c30-4564-a498-eac571b81512 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:35:19.251496 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c4fc1-5c30-4564-a498-eac571b81512 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:35:19.252220 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96c4fc1-5c30-4564-a498-eac571b81512 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:35:19.253644 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: WARNING py.warnings [None req-c96c4fc1-5c30-4564-a498-eac571b81512 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 22:35:19.253644 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: warnings.warn(msg) Jun 24 22:35:19.253644 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: Jun 24 22:35:19.254525 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96c4fc1-5c30-4564-a498-eac571b81512 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:35:19.267295 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 742/1499] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:35:19 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:35:19.271478 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474e2ec2-51b6-4e25-bc4f-928854b1b686 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:35:19.281986 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474e2ec2-51b6-4e25-bc4f-928854b1b686 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:35:19.287629 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38b9587-8bd6-46af-8f99-85011e247923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:35:19.288298 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b9587-8bd6-46af-8f99-85011e247923 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:35:19.288579 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b9587-8bd6-46af-8f99-85011e247923 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:35:19.288852 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b9587-8bd6-46af-8f99-85011e247923 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:35:19.289586 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38b9587-8bd6-46af-8f99-85011e247923 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:35:19.290647 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: WARNING py.warnings [None req-b38b9587-8bd6-46af-8f99-85011e247923 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 22:35:19.290647 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: warnings.warn(msg) Jun 24 22:35:19.290647 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: Jun 24 22:35:19.291591 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38b9587-8bd6-46af-8f99-85011e247923 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:35:19.305439 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 758/1500] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:35:19 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:35:19.311814 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96c4fc1-5c30-4564-a498-eac571b81512 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:35:19.326821 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96c4fc1-5c30-4564-a498-eac571b81512 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:35:19.333764 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4520da8-d2c6-489a-8955-fe37fe913106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:35:19.334650 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4520da8-d2c6-489a-8955-fe37fe913106 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:35:19.334925 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4520da8-d2c6-489a-8955-fe37fe913106 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:35:19.335182 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4520da8-d2c6-489a-8955-fe37fe913106 admin admin] PATH_INFO: `/v3/projects/3dd95140432941d4bbfab6512a5a65fb/users/54ae74a264e84cb7988cad2aa1fbe562/roles/1928787bfcc745419829cd315900ac44` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:35:19.349835 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4520da8-d2c6-489a-8955-fe37fe913106 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dd95140432941d4bbfab6512a5a65fb, user_id=54ae74a264e84cb7988cad2aa1fbe562, role_id=1928787bfcc745419829cd315900ac44)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:35:19.350871 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: WARNING py.warnings [None req-a4520da8-d2c6-489a-8955-fe37fe913106 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 22:35:19.350871 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: warnings.warn(msg) Jun 24 22:35:19.350871 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: Jun 24 22:35:19.352829 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4520da8-d2c6-489a-8955-fe37fe913106 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:35:19.369733 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 743/1501] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 22:35:19 2022] PUT /identity/v3/projects/3dd95140432941d4bbfab6512a5a65fb/users/54ae74a264e84cb7988cad2aa1fbe562/roles/1928787bfcc745419829cd315900ac44 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:35:19.381705 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e1d391-2e1e-4720-8113-71dca0f88a38 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:35:19.381998 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e1d391-2e1e-4720-8113-71dca0f88a38 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:35:19.382273 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e1d391-2e1e-4720-8113-71dca0f88a38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:35:19.409709 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-a5e1d391-2e1e-4720-8113-71dca0f88a38 None None] MFA Rules not processed for user `54ae74a264e84cb7988cad2aa1fbe562`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:35:19.410911 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-a5e1d391-2e1e-4720-8113-71dca0f88a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:35:19.488742 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 759/1502] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:35:19 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:35:19.504743 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8865e30-29d0-493b-a294-f7678b5e4bf3 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:35:19.505034 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8865e30-29d0-493b-a294-f7678b5e4bf3 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:35:19.505336 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8865e30-29d0-493b-a294-f7678b5e4bf3 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:35:19.506725 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 744/1503] 10.222.0.36 () {54 vars in 963 bytes} [Fri Jun 24 22:35:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:35:19.511845 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005f4b86-8729-4c01-a3da-14b0b98f9bf2 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:35:19.512135 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005f4b86-8729-4c01-a3da-14b0b98f9bf2 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:35:19.512409 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005f4b86-8729-4c01-a3da-14b0b98f9bf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:35:19.534181 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-005f4b86-8729-4c01-a3da-14b0b98f9bf2 None None] MFA Rules not processed for user `e4a747e2a5684843a6ee9e3480badac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:35:19.535435 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-005f4b86-8729-4c01-a3da-14b0b98f9bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:35:19.582172 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:35:19.590236 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 760/1504] 10.222.0.36 () {58 vars in 1060 bytes} [Fri Jun 24 22:35:19 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:35:19.597920 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8865e30-29d0-493b-a294-f7678b5e4bf3 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:35:19.609697 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8865e30-29d0-493b-a294-f7678b5e4bf3 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:35:19.613783 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72d4bfe-b432-4893-a28b-5326e939f067 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a747e2a5684843a6ee9e3480badac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:35:19.614415 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72d4bfe-b432-4893-a28b-5326e939f067 service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:35:19.614694 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72d4bfe-b432-4893-a28b-5326e939f067 service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:35:19.614954 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72d4bfe-b432-4893-a28b-5326e939f067 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:35:19.623402 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72d4bfe-b432-4893-a28b-5326e939f067 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:35:19.624835 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72d4bfe-b432-4893-a28b-5326e939f067 service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:35:19.634095 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 745/1505] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:35:19 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:35:19.678432 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854f834f-fca8-4116-9a75-1e44cdcd798e None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:35:19.678719 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854f834f-fca8-4116-9a75-1e44cdcd798e None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:35:19.678994 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854f834f-fca8-4116-9a75-1e44cdcd798e None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:35:19.680321 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 761/1506] 10.222.0.36 () {52 vars in 829 bytes} [Fri Jun 24 22:35:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:35:19.684113 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72d4bfe-b432-4893-a28b-5326e939f067 service cinder] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:35:19.747682 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72d4bfe-b432-4893-a28b-5326e939f067 service cinder] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:35:19.753359 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6a60f9-d6fe-40ce-9271-5902419e8fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:35:19.754240 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6a60f9-d6fe-40ce-9271-5902419e8fb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:35:19.754496 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6a60f9-d6fe-40ce-9271-5902419e8fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:35:19.754776 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6a60f9-d6fe-40ce-9271-5902419e8fb8 admin admin] PATH_INFO: `/v3/users/54ae74a264e84cb7988cad2aa1fbe562` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:35:19.756117 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6a60f9-d6fe-40ce-9271-5902419e8fb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54ae74a264e84cb7988cad2aa1fbe562)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:35:19.757189 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: WARNING py.warnings [None req-7f6a60f9-d6fe-40ce-9271-5902419e8fb8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 22:35:19.757189 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: warnings.warn(msg) Jun 24 22:35:19.757189 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: Jun 24 22:35:19.758503 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6a60f9-d6fe-40ce-9271-5902419e8fb8 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:35:19.845941 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-7f6a60f9-d6fe-40ce-9271-5902419e8fb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54ae74a264e84cb7988cad2aa1fbe562'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:35:19.859576 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-7f6a60f9-d6fe-40ce-9271-5902419e8fb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54ae74a264e84cb7988cad2aa1fbe562'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:35:19.860472 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-7f6a60f9-d6fe-40ce-9271-5902419e8fb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54ae74a264e84cb7988cad2aa1fbe562'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:35:19.863726 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-7f6a60f9-d6fe-40ce-9271-5902419e8fb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54ae74a264e84cb7988cad2aa1fbe562'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:35:19.887808 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-7f6a60f9-d6fe-40ce-9271-5902419e8fb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54ae74a264e84cb7988cad2aa1fbe562'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:35:19.892144 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:35:19.908288 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 746/1507] 10.222.0.36 () {58 vars in 1223 bytes} [Fri Jun 24 22:35:19 2022] DELETE /identity/v3/users/54ae74a264e84cb7988cad2aa1fbe562 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:35:19.913000 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ae4444-645e-491f-ba2d-c5b592e8fac3 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:35:19.913288 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ae4444-645e-491f-ba2d-c5b592e8fac3 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:35:19.913563 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ae4444-645e-491f-ba2d-c5b592e8fac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:35:19.931213 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-d3ae4444-645e-491f-ba2d-c5b592e8fac3 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:35:19.932425 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-d3ae4444-645e-491f-ba2d-c5b592e8fac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:35:19.993433 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 762/1508] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:35:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:35:20.005234 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6a60f9-d6fe-40ce-9271-5902419e8fb8 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:35:20.006612 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-7f6a60f9-d6fe-40ce-9271-5902419e8fb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:35:20.065522 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6a60f9-d6fe-40ce-9271-5902419e8fb8 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:35:20.071446 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368310e8-c4b7-4eed-85a7-2511427648c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:35:20.072101 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368310e8-c4b7-4eed-85a7-2511427648c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:35:20.072382 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368310e8-c4b7-4eed-85a7-2511427648c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:35:20.072657 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368310e8-c4b7-4eed-85a7-2511427648c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:35:20.084014 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368310e8-c4b7-4eed-85a7-2511427648c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:35:20.085523 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368310e8-c4b7-4eed-85a7-2511427648c7 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:35:20.095646 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 747/1509] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:35:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:35:20.433936 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ae4444-645e-491f-ba2d-c5b592e8fac3 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:35:20.435662 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-d3ae4444-645e-491f-ba2d-c5b592e8fac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:35:20.451571 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ae4444-645e-491f-ba2d-c5b592e8fac3 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:35:20.457342 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d63b7f-78cd-4634-92c6-2edb8ebbd655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:35:20.458259 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d63b7f-78cd-4634-92c6-2edb8ebbd655 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:35:20.458533 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d63b7f-78cd-4634-92c6-2edb8ebbd655 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:35:20.459736 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d63b7f-78cd-4634-92c6-2edb8ebbd655 admin admin] PATH_INFO: `/v3/projects/3dd95140432941d4bbfab6512a5a65fb` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:35:20.461219 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d63b7f-78cd-4634-92c6-2edb8ebbd655 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3dd95140432941d4bbfab6512a5a65fb)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:35:20.462253 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: WARNING py.warnings [None req-79d63b7f-78cd-4634-92c6-2edb8ebbd655 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 22:35:20.462253 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: warnings.warn(msg) Jun 24 22:35:20.462253 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: Jun 24 22:35:20.463472 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d63b7f-78cd-4634-92c6-2edb8ebbd655 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:35:20.529346 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-79d63b7f-78cd-4634-92c6-2edb8ebbd655 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3dd95140432941d4bbfab6512a5a65fb', 'request_id': 'req-79d63b7f-78cd-4634-92c6-2edb8ebbd655'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:35:20.542697 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-79d63b7f-78cd-4634-92c6-2edb8ebbd655 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3dd95140432941d4bbfab6512a5a65fb', 'request_id': 'req-79d63b7f-78cd-4634-92c6-2edb8ebbd655'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:35:20.554369 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-79d63b7f-78cd-4634-92c6-2edb8ebbd655 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3dd95140432941d4bbfab6512a5a65fb', 'request_id': 'req-79d63b7f-78cd-4634-92c6-2edb8ebbd655'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:35:20.565414 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-79d63b7f-78cd-4634-92c6-2edb8ebbd655 admin admin] The token cache is being invalidate because project 3dd95140432941d4bbfab6512a5a65fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 22:35:20.565706 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-79d63b7f-78cd-4634-92c6-2edb8ebbd655 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:35:20.566716 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-79d63b7f-78cd-4634-92c6-2edb8ebbd655 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:35:20.568507 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 763/1510] 10.222.0.36 () {58 vars in 1232 bytes} [Fri Jun 24 22:35:20 2022] DELETE /identity/v3/projects/3dd95140432941d4bbfab6512a5a65fb => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:35:30.091189 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:35:30.562447 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:36:55.441935 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a931d68-85c4-418d-aea1-ed51a6d22f6f None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:36:55.442487 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a931d68-85c4-418d-aea1-ed51a6d22f6f None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:36:55.442610 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a931d68-85c4-418d-aea1-ed51a6d22f6f None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:36:55.444654 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 748/1511] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 22:36:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:36:55.452547 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e7f581-d027-444b-9d19-f5cc51978090 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:36:55.453105 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e7f581-d027-444b-9d19-f5cc51978090 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:36:55.453201 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e7f581-d027-444b-9d19-f5cc51978090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:36:55.473084 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-50e7f581-d027-444b-9d19-f5cc51978090 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:36:55.474303 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-50e7f581-d027-444b-9d19-f5cc51978090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:36:55.544705 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 764/1512] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 22:36:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 22:36:55.700963 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a931d68-85c4-418d-aea1-ed51a6d22f6f None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:36:55.703932 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-8a931d68-85c4-418d-aea1-ed51a6d22f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:36:55.794058 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a931d68-85c4-418d-aea1-ed51a6d22f6f None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:36:55.800209 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1794fe3-dac8-4c80-b329-62e4b8e8a689 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214d9071042c4bad886bf060a079b6e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:36:55.800849 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1794fe3-dac8-4c80-b329-62e4b8e8a689 service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:36:55.801134 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1794fe3-dac8-4c80-b329-62e4b8e8a689 service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:36:55.801413 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1794fe3-dac8-4c80-b329-62e4b8e8a689 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:36:55.810406 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1794fe3-dac8-4c80-b329-62e4b8e8a689 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:36:55.812075 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1794fe3-dac8-4c80-b329-62e4b8e8a689 service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:36:55.821951 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 749/1513] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:36:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:36:56.731933 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32633d2-4940-4a66-a619-66cfb683bebc None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:36:56.732524 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32633d2-4940-4a66-a619-66cfb683bebc None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:36:56.732524 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32633d2-4940-4a66-a619-66cfb683bebc None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:36:56.734774 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 765/1514] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 22:36:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:36:56.740669 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e984d350-3f46-42e3-bdcc-a761fc99042b None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:36:56.741162 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e984d350-3f46-42e3-bdcc-a761fc99042b None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:36:56.741274 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e984d350-3f46-42e3-bdcc-a761fc99042b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:36:56.770105 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-e984d350-3f46-42e3-bdcc-a761fc99042b None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:36:56.771971 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-e984d350-3f46-42e3-bdcc-a761fc99042b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:36:56.791503 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 750/1515] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 22:36:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:36:56.956477 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32633d2-4940-4a66-a619-66cfb683bebc None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:36:56.980540 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32633d2-4940-4a66-a619-66cfb683bebc None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:36:56.987595 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8584a33-1da0-401f-b68d-c663e2ca7f0a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214d9071042c4bad886bf060a079b6e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:36:56.988179 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8584a33-1da0-401f-b68d-c663e2ca7f0a service nova] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:36:56.988465 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8584a33-1da0-401f-b68d-c663e2ca7f0a service nova] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:36:56.988723 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8584a33-1da0-401f-b68d-c663e2ca7f0a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:36:57.001155 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8584a33-1da0-401f-b68d-c663e2ca7f0a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:36:57.003197 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8584a33-1da0-401f-b68d-c663e2ca7f0a service nova] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:36:57.015082 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 766/1516] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:36:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:36:57.696126 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ea3c9-d0b2-4983-beb4-583ee98a4bc9 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:36:57.696919 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ea3c9-d0b2-4983-beb4-583ee98a4bc9 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:36:57.697199 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ea3c9-d0b2-4983-beb4-583ee98a4bc9 None None] PATH_INFO: `/v3` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:36:57.699141 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 751/1517] 10.222.0.13 () {54 vars in 925 bytes} [Fri Jun 24 22:36:57 2022] GET /identity/v3 => generated 255 bytes in 5 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:36:57.708372 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824d3c70-9cb1-46f8-9261-bc72ef9db62f None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:36:57.708664 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824d3c70-9cb1-46f8-9261-bc72ef9db62f None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:36:57.708941 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824d3c70-9cb1-46f8-9261-bc72ef9db62f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:36:57.728810 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-824d3c70-9cb1-46f8-9261-bc72ef9db62f None None] MFA Rules not processed for user `0233b357708643be94c0ade17ac1fb3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:36:57.730018 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-824d3c70-9cb1-46f8-9261-bc72ef9db62f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:36:57.809044 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 767/1518] 10.222.0.13 () {58 vars in 1015 bytes} [Fri Jun 24 22:36:57 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:37:06.751500 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de7a3b-b640-4a7c-80df-15d7e34be6b4 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:37:06.752069 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de7a3b-b640-4a7c-80df-15d7e34be6b4 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:37:06.752069 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de7a3b-b640-4a7c-80df-15d7e34be6b4 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:37:06.753709 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 752/1519] 10.222.0.36 () {54 vars in 960 bytes} [Fri Jun 24 22:37:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:37:06.760249 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=37 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:37:06.761760 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b258f26-3691-4eda-98c3-0dbe4e055586 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:37:06.762218 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b258f26-3691-4eda-98c3-0dbe4e055586 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:37:06.762539 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b258f26-3691-4eda-98c3-0dbe4e055586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:37:06.781638 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-5b258f26-3691-4eda-98c3-0dbe4e055586 None None] MFA Rules not processed for user `0233b357708643be94c0ade17ac1fb3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:37:06.782840 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-5b258f26-3691-4eda-98c3-0dbe4e055586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:37:06.793444 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 768/1520] 10.222.0.36 () {58 vars in 1057 bytes} [Fri Jun 24 22:37:06 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:37:06.804191 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1de7a3b-b640-4a7c-80df-15d7e34be6b4 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:37:06.818928 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1de7a3b-b640-4a7c-80df-15d7e34be6b4 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:37:06.824182 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ec5631-40a4-4775-a706-856a1dbd1ca6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0233b357708643be94c0ade17ac1fb3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:37:06.824813 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec5631-40a4-4775-a706-856a1dbd1ca6 service placement] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:37:06.825097 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec5631-40a4-4775-a706-856a1dbd1ca6 service placement] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:37:06.825372 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec5631-40a4-4775-a706-856a1dbd1ca6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:37:06.833745 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ec5631-40a4-4775-a706-856a1dbd1ca6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:37:06.835395 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ec5631-40a4-4775-a706-856a1dbd1ca6 service placement] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:37:06.845117 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 753/1521] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:37:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:37:08.295516 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfe7792-a835-4e6d-bd28-b82ac455eb84 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:37:08.296438 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfe7792-a835-4e6d-bd28-b82ac455eb84 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:37:08.296438 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfe7792-a835-4e6d-bd28-b82ac455eb84 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:37:08.298652 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 769/1522] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 22:37:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:37:08.303708 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480a8345-b794-4d60-8f2d-48503e1ea7cf None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:37:08.304160 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480a8345-b794-4d60-8f2d-48503e1ea7cf None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:37:08.304263 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480a8345-b794-4d60-8f2d-48503e1ea7cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:37:08.326127 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-480a8345-b794-4d60-8f2d-48503e1ea7cf None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:37:08.327365 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-480a8345-b794-4d60-8f2d-48503e1ea7cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:37:08.335970 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 754/1523] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 22:37:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:37:08.496508 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfe7792-a835-4e6d-bd28-b82ac455eb84 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:37:08.518079 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfe7792-a835-4e6d-bd28-b82ac455eb84 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:37:08.524587 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3850d1-1d9e-42de-b4ec-108e73b3e604 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214d9071042c4bad886bf060a079b6e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:37:08.525255 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3850d1-1d9e-42de-b4ec-108e73b3e604 service nova] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:37:08.525535 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3850d1-1d9e-42de-b4ec-108e73b3e604 service nova] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:37:08.525812 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3850d1-1d9e-42de-b4ec-108e73b3e604 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:37:08.534238 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3850d1-1d9e-42de-b4ec-108e73b3e604 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:37:08.535917 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3850d1-1d9e-42de-b4ec-108e73b3e604 service nova] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:37:08.545411 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 770/1524] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:37:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:37:09.371633 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb7a3ed-63ee-4e49-884e-d75f621c9c69 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:37:09.372522 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb7a3ed-63ee-4e49-884e-d75f621c9c69 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:37:09.372522 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb7a3ed-63ee-4e49-884e-d75f621c9c69 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:37:09.374677 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 755/1525] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 22:37:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:37:09.381067 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d557872d-2f09-4151-9f79-56f14c594bb7 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:37:09.381528 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d557872d-2f09-4151-9f79-56f14c594bb7 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:37:09.381629 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d557872d-2f09-4151-9f79-56f14c594bb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:37:09.406151 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-d557872d-2f09-4151-9f79-56f14c594bb7 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:37:09.407388 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-d557872d-2f09-4151-9f79-56f14c594bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:37:09.417354 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 771/1526] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 22:37:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:37:09.570133 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb7a3ed-63ee-4e49-884e-d75f621c9c69 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:37:09.586994 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb7a3ed-63ee-4e49-884e-d75f621c9c69 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:37:09.597358 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d365a7-7572-4d2f-b4b9-8984bc7fc794 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214d9071042c4bad886bf060a079b6e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:37:09.598309 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d365a7-7572-4d2f-b4b9-8984bc7fc794 service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:37:09.598712 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d365a7-7572-4d2f-b4b9-8984bc7fc794 service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:37:09.599103 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d365a7-7572-4d2f-b4b9-8984bc7fc794 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:37:09.612776 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d365a7-7572-4d2f-b4b9-8984bc7fc794 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:37:09.615301 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d365a7-7572-4d2f-b4b9-8984bc7fc794 service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:37:09.628702 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 756/1527] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:37:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:37:13.598423 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97d279b-dde8-41f7-a498-0f673ba03870 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:37:13.599043 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97d279b-dde8-41f7-a498-0f673ba03870 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:37:13.599043 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97d279b-dde8-41f7-a498-0f673ba03870 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:37:13.600388 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 772/1528] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 22:37:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:37:13.607312 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5969bab-b68a-4232-aa18-1812a013f065 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:37:13.608076 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5969bab-b68a-4232-aa18-1812a013f065 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:37:13.608245 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5969bab-b68a-4232-aa18-1812a013f065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:37:13.637398 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-f5969bab-b68a-4232-aa18-1812a013f065 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:37:13.638592 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-f5969bab-b68a-4232-aa18-1812a013f065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:37:13.647863 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 757/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 22:37:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:37:13.685614 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97d279b-dde8-41f7-a498-0f673ba03870 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:37:13.688732 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-a97d279b-dde8-41f7-a498-0f673ba03870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:37:13.768692 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97d279b-dde8-41f7-a498-0f673ba03870 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:37:13.773154 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d268aa1-76c0-405a-9d10-8b8648cb3b5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:37:13.773814 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d268aa1-76c0-405a-9d10-8b8648cb3b5a service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:37:13.774088 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d268aa1-76c0-405a-9d10-8b8648cb3b5a service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:37:13.774356 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d268aa1-76c0-405a-9d10-8b8648cb3b5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:37:13.785280 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d268aa1-76c0-405a-9d10-8b8648cb3b5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:37:13.786763 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d268aa1-76c0-405a-9d10-8b8648cb3b5a service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:37:13.792470 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:37:13.799649 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 773/1530] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:37:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:37:15.796614 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3069a8-00cf-4325-8789-c3e84735bd90 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:37:15.797179 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3069a8-00cf-4325-8789-c3e84735bd90 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:37:15.797179 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3069a8-00cf-4325-8789-c3e84735bd90 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:37:15.798474 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 758/1531] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 22:37:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:37:15.804900 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb658652-8eac-4feb-a2b5-bc48ec60db6f None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:37:15.805331 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb658652-8eac-4feb-a2b5-bc48ec60db6f None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:37:15.805506 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb658652-8eac-4feb-a2b5-bc48ec60db6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:37:15.831408 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-eb658652-8eac-4feb-a2b5-bc48ec60db6f None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:37:15.832623 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-eb658652-8eac-4feb-a2b5-bc48ec60db6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:37:15.842304 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 774/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 22:37:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:37:15.878350 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3069a8-00cf-4325-8789-c3e84735bd90 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:37:15.890927 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3069a8-00cf-4325-8789-c3e84735bd90 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:37:15.895194 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5185233-689e-4d5d-b797-4d3f0b893935 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:37:15.895886 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5185233-689e-4d5d-b797-4d3f0b893935 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:37:15.896162 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5185233-689e-4d5d-b797-4d3f0b893935 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:37:15.896439 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5185233-689e-4d5d-b797-4d3f0b893935 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:37:15.912114 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5185233-689e-4d5d-b797-4d3f0b893935 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:37:15.914400 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5185233-689e-4d5d-b797-4d3f0b893935 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:37:15.925480 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 759/1533] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:37:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 22:37:19.454697 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6e9527-20fa-47cf-b31f-ec44df0f5a80 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:37:19.455319 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6e9527-20fa-47cf-b31f-ec44df0f5a80 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:37:19.455319 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6e9527-20fa-47cf-b31f-ec44df0f5a80 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:37:19.456733 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 775/1534] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 22:37:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:37:19.462316 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b972b153-fe32-47a7-ae62-e315be7d0282 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:37:19.462744 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b972b153-fe32-47a7-ae62-e315be7d0282 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:37:19.462857 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b972b153-fe32-47a7-ae62-e315be7d0282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:37:19.482651 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-b972b153-fe32-47a7-ae62-e315be7d0282 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:37:19.483907 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-b972b153-fe32-47a7-ae62-e315be7d0282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:37:19.493365 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 760/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 22:37:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:37:19.797532 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6e9527-20fa-47cf-b31f-ec44df0f5a80 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:37:19.799825 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-ac6e9527-20fa-47cf-b31f-ec44df0f5a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:37:19.862554 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6e9527-20fa-47cf-b31f-ec44df0f5a80 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:37:19.866384 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5289d4d-1f74-409b-bf81-fcbb663e4c2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a747e2a5684843a6ee9e3480badac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:37:19.867031 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5289d4d-1f74-409b-bf81-fcbb663e4c2f service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:37:19.867337 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5289d4d-1f74-409b-bf81-fcbb663e4c2f service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:37:19.867596 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5289d4d-1f74-409b-bf81-fcbb663e4c2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:37:19.876692 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5289d4d-1f74-409b-bf81-fcbb663e4c2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:37:19.878454 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5289d4d-1f74-409b-bf81-fcbb663e4c2f service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:37:19.887849 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 776/1536] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:37:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:37:21.954562 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd473ca-3154-447a-b81c-386de12620b1 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:37:21.955163 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd473ca-3154-447a-b81c-386de12620b1 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:37:21.955163 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd473ca-3154-447a-b81c-386de12620b1 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:37:21.956886 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 761/1537] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 22:37:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:37:21.962564 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4665a31e-c126-470d-aa37-27045f5eb2f9 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:37:21.963061 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4665a31e-c126-470d-aa37-27045f5eb2f9 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:37:21.963164 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4665a31e-c126-470d-aa37-27045f5eb2f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:37:21.983346 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-4665a31e-c126-470d-aa37-27045f5eb2f9 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:37:21.984559 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-4665a31e-c126-470d-aa37-27045f5eb2f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:37:21.994226 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 777/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 22:37:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 22:37:22.295950 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd473ca-3154-447a-b81c-386de12620b1 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:37:22.298036 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-ffd473ca-3154-447a-b81c-386de12620b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:37:22.312944 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd473ca-3154-447a-b81c-386de12620b1 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:37:22.317017 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fdbf9a-1a5f-4080-8382-68e9b1db1640 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a747e2a5684843a6ee9e3480badac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:37:22.317630 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fdbf9a-1a5f-4080-8382-68e9b1db1640 service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:37:22.317931 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fdbf9a-1a5f-4080-8382-68e9b1db1640 service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:37:22.318205 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fdbf9a-1a5f-4080-8382-68e9b1db1640 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:37:22.329010 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fdbf9a-1a5f-4080-8382-68e9b1db1640 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:37:22.330453 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fdbf9a-1a5f-4080-8382-68e9b1db1640 service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:37:22.341025 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 762/1539] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:37:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:37:31.977740 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=32 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:37:32.336243 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=33 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:38:50.013435 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a50fcf7-7fca-4ff0-b71f-1fedbad81e5e None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:38:50.014647 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a50fcf7-7fca-4ff0-b71f-1fedbad81e5e None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:38:50.015155 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a50fcf7-7fca-4ff0-b71f-1fedbad81e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:38:50.034871 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af54766-f19a-457f-9d4a-172e1909fab4 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:38:50.036551 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af54766-f19a-457f-9d4a-172e1909fab4 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:38:50.037077 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af54766-f19a-457f-9d4a-172e1909fab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:38:50.042236 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-5a50fcf7-7fca-4ff0-b71f-1fedbad81e5e None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:38:50.043713 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-5a50fcf7-7fca-4ff0-b71f-1fedbad81e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:38:50.057921 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 778/1540] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:38:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:38:50.059298 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c56f97-75a8-460e-86a2-20511ae81bec None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:38:50.059577 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c56f97-75a8-460e-86a2-20511ae81bec None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:38:50.059857 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c56f97-75a8-460e-86a2-20511ae81bec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:38:50.079319 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-6af54766-f19a-457f-9d4a-172e1909fab4 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:38:50.080929 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-6af54766-f19a-457f-9d4a-172e1909fab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:38:50.085494 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-22c56f97-75a8-460e-86a2-20511ae81bec None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:38:50.087219 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-22c56f97-75a8-460e-86a2-20511ae81bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:38:50.096575 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 779/1541] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:38:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:38:50.098393 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7e0e8f-0b5d-437c-99be-1b59f34a745e None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:38:50.098854 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7e0e8f-0b5d-437c-99be-1b59f34a745e None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:38:50.099398 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7e0e8f-0b5d-437c-99be-1b59f34a745e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:38:50.105281 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 763/1542] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:38:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 22:38:50.107076 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092de233-4d33-448e-825a-31802f5f4cf1 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:38:50.107519 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092de233-4d33-448e-825a-31802f5f4cf1 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:38:50.108926 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092de233-4d33-448e-825a-31802f5f4cf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:38:50.120436 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-ca7e0e8f-0b5d-437c-99be-1b59f34a745e None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:38:50.121896 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-ca7e0e8f-0b5d-437c-99be-1b59f34a745e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:38:50.141840 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 780/1543] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:38:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:38:50.143554 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f565f6-803c-404a-bb56-f45c5b2a8201 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:38:50.144239 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f565f6-803c-404a-bb56-f45c5b2a8201 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:38:50.145802 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f565f6-803c-404a-bb56-f45c5b2a8201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:38:50.152844 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-092de233-4d33-448e-825a-31802f5f4cf1 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:38:50.154274 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-092de233-4d33-448e-825a-31802f5f4cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:38:50.171381 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 764/1544] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:38:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:38:50.174405 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092de233-4d33-448e-825a-31802f5f4cf1 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:38:50.183881 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-74f565f6-803c-404a-bb56-f45c5b2a8201 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:38:50.185412 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-74f565f6-803c-404a-bb56-f45c5b2a8201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:38:50.194819 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092de233-4d33-448e-825a-31802f5f4cf1 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:38:50.204663 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 781/1545] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:38:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:38:50.206791 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143351d8-053f-4dc0-9d22-a4a88ea7a672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:38:50.207693 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143351d8-053f-4dc0-9d22-a4a88ea7a672 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:38:50.207997 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f565f6-803c-404a-bb56-f45c5b2a8201 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:38:50.208947 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143351d8-053f-4dc0-9d22-a4a88ea7a672 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:38:50.211648 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143351d8-053f-4dc0-9d22-a4a88ea7a672 admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:38:50.212670 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143351d8-053f-4dc0-9d22-a4a88ea7a672 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:38:50.213269 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143351d8-053f-4dc0-9d22-a4a88ea7a672 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:38:50.214471 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: WARNING py.warnings [None req-143351d8-053f-4dc0-9d22-a4a88ea7a672 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 22:38:50.214471 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: warnings.warn(msg) Jun 24 22:38:50.214471 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: Jun 24 22:38:50.217958 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143351d8-053f-4dc0-9d22-a4a88ea7a672 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:38:50.225402 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f565f6-803c-404a-bb56-f45c5b2a8201 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:38:50.231168 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70631ed-9d35-4b3b-b761-a0fbe93b6ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:38:50.231896 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70631ed-9d35-4b3b-b761-a0fbe93b6ec0 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:38:50.232180 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70631ed-9d35-4b3b-b761-a0fbe93b6ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:38:50.232455 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70631ed-9d35-4b3b-b761-a0fbe93b6ec0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:38:50.233189 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70631ed-9d35-4b3b-b761-a0fbe93b6ec0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:38:50.233498 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70631ed-9d35-4b3b-b761-a0fbe93b6ec0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:38:50.234146 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 765/1546] 10.222.0.36 () {58 vars in 1152 bytes} [Fri Jun 24 22:38:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:38:50.235752 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a7b99b-66ff-4af1-a24c-98c363cee151 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:38:50.236029 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70631ed-9d35-4b3b-b761-a0fbe93b6ec0 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:38:50.236382 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a7b99b-66ff-4af1-a24c-98c363cee151 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:38:50.236875 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a7b99b-66ff-4af1-a24c-98c363cee151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:38:50.250949 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 782/1547] 10.222.0.36 () {58 vars in 1152 bytes} [Fri Jun 24 22:38:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:38:50.254994 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70631ed-9d35-4b3b-b761-a0fbe93b6ec0 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:38:50.257482 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-69a7b99b-66ff-4af1-a24c-98c363cee151 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:38:50.258869 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-69a7b99b-66ff-4af1-a24c-98c363cee151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:38:50.269997 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 766/1548] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:38:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:38:50.271556 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd4a5d-0054-430d-80d7-5f1d168051cd None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:38:50.272076 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd4a5d-0054-430d-80d7-5f1d168051cd None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:38:50.272570 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd4a5d-0054-430d-80d7-5f1d168051cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:38:50.274572 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70631ed-9d35-4b3b-b761-a0fbe93b6ec0 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:38:50.281972 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c824b72a-dce8-4f94-befb-7616de6bcef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:38:50.283955 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c824b72a-dce8-4f94-befb-7616de6bcef0 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:38:50.288031 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c824b72a-dce8-4f94-befb-7616de6bcef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:38:50.288489 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c824b72a-dce8-4f94-befb-7616de6bcef0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:38:50.289405 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c824b72a-dce8-4f94-befb-7616de6bcef0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:38:50.289878 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c824b72a-dce8-4f94-befb-7616de6bcef0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:38:50.291757 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c824b72a-dce8-4f94-befb-7616de6bcef0 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:38:50.298380 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-f5dd4a5d-0054-430d-80d7-5f1d168051cd None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:38:50.300209 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-f5dd4a5d-0054-430d-80d7-5f1d168051cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:38:50.304993 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 783/1549] 10.222.0.36 () {58 vars in 1152 bytes} [Fri Jun 24 22:38:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:38:50.305978 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c824b72a-dce8-4f94-befb-7616de6bcef0 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:38:50.310111 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 767/1550] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:38:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:38:50.311244 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dd4a5d-0054-430d-80d7-5f1d168051cd None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:38:50.316215 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c824b72a-dce8-4f94-befb-7616de6bcef0 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:38:50.321471 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53240410-14b9-4628-84d6-3aeec4de823b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:38:50.322133 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53240410-14b9-4628-84d6-3aeec4de823b admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:38:50.322427 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53240410-14b9-4628-84d6-3aeec4de823b admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:38:50.322681 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53240410-14b9-4628-84d6-3aeec4de823b admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:38:50.323397 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53240410-14b9-4628-84d6-3aeec4de823b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:38:50.324437 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: WARNING py.warnings [None req-53240410-14b9-4628-84d6-3aeec4de823b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 22:38:50.324437 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: warnings.warn(msg) Jun 24 22:38:50.324437 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: Jun 24 22:38:50.324673 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dd4a5d-0054-430d-80d7-5f1d168051cd None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:38:50.325638 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53240410-14b9-4628-84d6-3aeec4de823b admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:38:50.329437 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31025bb7-14b4-4d0c-88e1-f9594e637f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:38:50.330457 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31025bb7-14b4-4d0c-88e1-f9594e637f23 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:38:50.330744 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31025bb7-14b4-4d0c-88e1-f9594e637f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:38:50.331020 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31025bb7-14b4-4d0c-88e1-f9594e637f23 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:38:50.331754 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31025bb7-14b4-4d0c-88e1-f9594e637f23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:38:50.333663 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31025bb7-14b4-4d0c-88e1-f9594e637f23 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:38:50.358625 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 784/1551] 10.222.0.36 () {60 vars in 1152 bytes} [Fri Jun 24 22:38:50 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:38:50.358625 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c87be6-8215-40ea-a871-d222d85c5a9d None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:38:50.358625 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c87be6-8215-40ea-a871-d222d85c5a9d None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:38:50.358625 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c87be6-8215-40ea-a871-d222d85c5a9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:38:50.369156 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 768/1552] 10.222.0.36 () {60 vars in 1152 bytes} [Fri Jun 24 22:38:50 2022] POST /identity/v3/projects => generated 393 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:38:50.370842 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6c7b70-23c5-4486-8a2e-87a51b562028 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:38:50.371135 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6c7b70-23c5-4486-8a2e-87a51b562028 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:38:50.371447 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6c7b70-23c5-4486-8a2e-87a51b562028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:38:50.377216 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-25c87be6-8215-40ea-a871-d222d85c5a9d None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:38:50.378435 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-25c87be6-8215-40ea-a871-d222d85c5a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:38:50.390003 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-0e6c7b70-23c5-4486-8a2e-87a51b562028 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:38:50.391223 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-0e6c7b70-23c5-4486-8a2e-87a51b562028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:38:50.436208 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 785/1553] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:38:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:38:50.443384 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf81a7-6960-451f-8c25-2c71d4c62121 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:38:50.443384 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf81a7-6960-451f-8c25-2c71d4c62121 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:38:50.443384 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf81a7-6960-451f-8c25-2c71d4c62121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:38:50.458055 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-36bf81a7-6960-451f-8c25-2c71d4c62121 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:38:50.459277 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-36bf81a7-6960-451f-8c25-2c71d4c62121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:38:50.461314 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 769/1554] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:38:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:38:50.464114 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6c7b70-23c5-4486-8a2e-87a51b562028 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:38:50.467587 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 786/1555] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:38:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:38:50.468885 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96509855-2600-458b-b030-9cb5389d4b47 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:38:50.469169 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96509855-2600-458b-b030-9cb5389d4b47 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:38:50.469633 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96509855-2600-458b-b030-9cb5389d4b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:38:50.474321 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6c7b70-23c5-4486-8a2e-87a51b562028 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:38:50.479463 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af61fac5-2c25-4f31-ad8a-9ded22b70488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:38:50.480125 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af61fac5-2c25-4f31-ad8a-9ded22b70488 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:38:50.480407 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af61fac5-2c25-4f31-ad8a-9ded22b70488 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:38:50.480682 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af61fac5-2c25-4f31-ad8a-9ded22b70488 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:38:50.481375 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af61fac5-2c25-4f31-ad8a-9ded22b70488 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:38:50.483480 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af61fac5-2c25-4f31-ad8a-9ded22b70488 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:38:50.487516 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-96509855-2600-458b-b030-9cb5389d4b47 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:38:50.488729 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-96509855-2600-458b-b030-9cb5389d4b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:38:50.496454 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 787/1556] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:38:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:38:50.497186 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96509855-2600-458b-b030-9cb5389d4b47 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:38:50.507573 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96509855-2600-458b-b030-9cb5389d4b47 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:38:50.512014 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc512fad-d8bf-4817-a56a-990fc9d13d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:38:50.512646 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 770/1557] 10.222.0.36 () {60 vars in 1152 bytes} [Fri Jun 24 22:38:50 2022] POST /identity/v3/projects => generated 375 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:38:50.512772 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc512fad-d8bf-4817-a56a-990fc9d13d13 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:38:50.512954 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc512fad-d8bf-4817-a56a-990fc9d13d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:38:50.513205 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc512fad-d8bf-4817-a56a-990fc9d13d13 admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:38:50.513881 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc512fad-d8bf-4817-a56a-990fc9d13d13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:38:50.513985 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1954e916-ed6f-4155-adfe-5ceb99fc2041 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:38:50.514215 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1954e916-ed6f-4155-adfe-5ceb99fc2041 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:38:50.514495 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1954e916-ed6f-4155-adfe-5ceb99fc2041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:38:50.515959 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc512fad-d8bf-4817-a56a-990fc9d13d13 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:38:50.534511 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-1954e916-ed6f-4155-adfe-5ceb99fc2041 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:38:50.535752 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-1954e916-ed6f-4155-adfe-5ceb99fc2041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:38:50.536757 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 788/1558] 10.222.0.36 () {60 vars in 1143 bytes} [Fri Jun 24 22:38:50 2022] POST /identity/v3/users => generated 292 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:38:50.537309 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc512fad-d8bf-4817-a56a-990fc9d13d13 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:38:50.546874 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc512fad-d8bf-4817-a56a-990fc9d13d13 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:38:50.595090 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:38:50.596290 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 771/1559] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:38:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:38:50.597825 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0845584c-151f-4df3-be1b-f20de896cf89 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:38:50.598114 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0845584c-151f-4df3-be1b-f20de896cf89 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:38:50.598428 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0845584c-151f-4df3-be1b-f20de896cf89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:38:50.605824 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e169f9e-1d7e-4db2-ab98-1fcc9ee8a949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:38:50.607304 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e169f9e-1d7e-4db2-ab98-1fcc9ee8a949 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:38:50.607808 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e169f9e-1d7e-4db2-ab98-1fcc9ee8a949 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:38:50.608306 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e169f9e-1d7e-4db2-ab98-1fcc9ee8a949 admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:38:50.609688 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e169f9e-1d7e-4db2-ab98-1fcc9ee8a949 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:38:50.613514 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e169f9e-1d7e-4db2-ab98-1fcc9ee8a949 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:38:50.617672 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-0845584c-151f-4df3-be1b-f20de896cf89 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:38:50.618881 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-0845584c-151f-4df3-be1b-f20de896cf89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:38:50.628506 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 772/1560] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:38:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:38:50.629536 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0845584c-151f-4df3-be1b-f20de896cf89 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:38:50.636835 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 789/1561] 10.222.0.36 () {60 vars in 1143 bytes} [Fri Jun 24 22:38:50 2022] POST /identity/v3/users => generated 297 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:38:50.638469 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39baa2d3-b6f5-4a2a-b1ab-c04d5a6a0aca None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:38:50.638766 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39baa2d3-b6f5-4a2a-b1ab-c04d5a6a0aca None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:38:50.639046 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39baa2d3-b6f5-4a2a-b1ab-c04d5a6a0aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:38:50.639751 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0845584c-151f-4df3-be1b-f20de896cf89 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:38:50.645014 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fd316c-16e5-49d8-ad55-40a9de864334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:38:50.645716 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fd316c-16e5-49d8-ad55-40a9de864334 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:38:50.645995 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fd316c-16e5-49d8-ad55-40a9de864334 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:38:50.646268 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fd316c-16e5-49d8-ad55-40a9de864334 admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:38:50.647007 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fd316c-16e5-49d8-ad55-40a9de864334 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:38:50.647364 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fd316c-16e5-49d8-ad55-40a9de864334 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:38:50.649037 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fd316c-16e5-49d8-ad55-40a9de864334 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:38:50.656606 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:38:50.657165 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-39baa2d3-b6f5-4a2a-b1ab-c04d5a6a0aca None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:38:50.658507 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-39baa2d3-b6f5-4a2a-b1ab-c04d5a6a0aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:38:50.662328 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 773/1562] 10.222.0.36 () {58 vars in 1152 bytes} [Fri Jun 24 22:38:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:38:50.663196 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fd316c-16e5-49d8-ad55-40a9de864334 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:38:50.671468 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 790/1563] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:38:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:38:50.672535 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39baa2d3-b6f5-4a2a-b1ab-c04d5a6a0aca None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:38:50.679590 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fd316c-16e5-49d8-ad55-40a9de864334 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:38:50.682087 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39baa2d3-b6f5-4a2a-b1ab-c04d5a6a0aca None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:38:50.684266 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeacc60-628a-4ba3-a2e8-dba9d1611b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:38:50.685061 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeacc60-628a-4ba3-a2e8-dba9d1611b0f admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:38:50.685349 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeacc60-628a-4ba3-a2e8-dba9d1611b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:38:50.685624 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeacc60-628a-4ba3-a2e8-dba9d1611b0f admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:38:50.686341 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeacc60-628a-4ba3-a2e8-dba9d1611b0f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:38:50.686645 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeacc60-628a-4ba3-a2e8-dba9d1611b0f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:38:50.686768 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfd0a41-5d99-47d6-8e4a-937e79a0e05c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:38:50.687424 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfd0a41-5d99-47d6-8e4a-937e79a0e05c admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:38:50.687823 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfd0a41-5d99-47d6-8e4a-937e79a0e05c admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:38:50.688528 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfd0a41-5d99-47d6-8e4a-937e79a0e05c admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:38:50.688616 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeacc60-628a-4ba3-a2e8-dba9d1611b0f admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:38:50.689036 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfd0a41-5d99-47d6-8e4a-937e79a0e05c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:38:50.690962 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfd0a41-5d99-47d6-8e4a-937e79a0e05c admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:38:50.702034 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 774/1564] 10.222.0.36 () {58 vars in 1152 bytes} [Fri Jun 24 22:38:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:38:50.703005 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeacc60-628a-4ba3-a2e8-dba9d1611b0f admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:38:50.714396 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeacc60-628a-4ba3-a2e8-dba9d1611b0f admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:38:50.714564 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 791/1565] 10.222.0.36 () {60 vars in 1143 bytes} [Fri Jun 24 22:38:50 2022] POST /identity/v3/users => generated 288 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:38:50.715787 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398d44f8-c800-49c5-bf4b-2c41310cadcd None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:38:50.716065 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398d44f8-c800-49c5-bf4b-2c41310cadcd None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:38:50.716346 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398d44f8-c800-49c5-bf4b-2c41310cadcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:38:50.721571 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c49b6a-0a5a-4e27-b91f-a31c922d812b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:38:50.722235 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c49b6a-0a5a-4e27-b91f-a31c922d812b admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:38:50.722515 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c49b6a-0a5a-4e27-b91f-a31c922d812b admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:38:50.722788 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c49b6a-0a5a-4e27-b91f-a31c922d812b admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:38:50.723556 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c49b6a-0a5a-4e27-b91f-a31c922d812b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:38:50.725170 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c49b6a-0a5a-4e27-b91f-a31c922d812b admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:38:50.735021 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-398d44f8-c800-49c5-bf4b-2c41310cadcd None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:38:50.735754 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 775/1566] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:38:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:38:50.738870 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-398d44f8-c800-49c5-bf4b-2c41310cadcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:38:50.738995 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c49b6a-0a5a-4e27-b91f-a31c922d812b admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:38:50.747922 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 792/1567] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:38:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:38:50.747922 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398d44f8-c800-49c5-bf4b-2c41310cadcd None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:38:50.748143 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c49b6a-0a5a-4e27-b91f-a31c922d812b admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:38:50.752275 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a75109-0ebb-4550-9f1f-8458433dd0b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:38:50.752917 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a75109-0ebb-4550-9f1f-8458433dd0b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:38:50.753201 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a75109-0ebb-4550-9f1f-8458433dd0b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:38:50.753477 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a75109-0ebb-4550-9f1f-8458433dd0b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:38:50.754198 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a75109-0ebb-4550-9f1f-8458433dd0b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:38:50.754505 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a75109-0ebb-4550-9f1f-8458433dd0b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:38:50.756151 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a75109-0ebb-4550-9f1f-8458433dd0b2 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:38:50.756272 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398d44f8-c800-49c5-bf4b-2c41310cadcd None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:38:50.760740 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c200046-ad67-4482-894a-413a39813881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:38:50.761384 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c200046-ad67-4482-894a-413a39813881 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:38:50.761660 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c200046-ad67-4482-894a-413a39813881 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:38:50.761955 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c200046-ad67-4482-894a-413a39813881 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:38:50.762669 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c200046-ad67-4482-894a-413a39813881 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:38:50.764276 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c200046-ad67-4482-894a-413a39813881 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:38:50.768468 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 776/1568] 10.222.0.36 () {58 vars in 1152 bytes} [Fri Jun 24 22:38:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:38:50.769310 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a75109-0ebb-4550-9f1f-8458433dd0b2 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:38:50.778859 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a75109-0ebb-4550-9f1f-8458433dd0b2 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:38:50.781054 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 793/1569] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:38:50 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:38:50.781872 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c200046-ad67-4482-894a-413a39813881 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:38:50.787401 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efad6e8-8167-42a0-8ec3-0e0fd5b2d33f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:38:50.788064 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efad6e8-8167-42a0-8ec3-0e0fd5b2d33f admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:38:50.788387 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efad6e8-8167-42a0-8ec3-0e0fd5b2d33f admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:38:50.788682 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efad6e8-8167-42a0-8ec3-0e0fd5b2d33f admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:38:50.789371 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efad6e8-8167-42a0-8ec3-0e0fd5b2d33f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:38:50.791356 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efad6e8-8167-42a0-8ec3-0e0fd5b2d33f admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:38:50.793195 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c200046-ad67-4482-894a-413a39813881 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:38:50.798520 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb78d762-6979-467e-8aed-7ae17def80ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:38:50.799112 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb78d762-6979-467e-8aed-7ae17def80ae admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:38:50.799427 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb78d762-6979-467e-8aed-7ae17def80ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:38:50.799734 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb78d762-6979-467e-8aed-7ae17def80ae admin admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:38:50.800453 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb78d762-6979-467e-8aed-7ae17def80ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:38:50.800768 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb78d762-6979-467e-8aed-7ae17def80ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:38:50.802347 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb78d762-6979-467e-8aed-7ae17def80ae admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:38:50.816641 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 794/1570] 10.222.0.36 () {58 vars in 1152 bytes} [Fri Jun 24 22:38:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:38:50.817447 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb78d762-6979-467e-8aed-7ae17def80ae admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:38:50.826434 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 777/1571] 10.222.0.36 () {60 vars in 1152 bytes} [Fri Jun 24 22:38:50 2022] POST /identity/v3/projects => generated 367 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:38:50.827412 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efad6e8-8167-42a0-8ec3-0e0fd5b2d33f admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:38:50.832467 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb78d762-6979-467e-8aed-7ae17def80ae admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:38:50.891077 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efad6e8-8167-42a0-8ec3-0e0fd5b2d33f admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:38:50.891355 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590ad24a-d2cf-40f4-bb04-492a8b34f439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:38:50.892063 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590ad24a-d2cf-40f4-bb04-492a8b34f439 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:38:50.892319 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590ad24a-d2cf-40f4-bb04-492a8b34f439 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:38:50.892620 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590ad24a-d2cf-40f4-bb04-492a8b34f439 admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:38:50.893297 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590ad24a-d2cf-40f4-bb04-492a8b34f439 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:38:50.895224 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590ad24a-d2cf-40f4-bb04-492a8b34f439 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:38:50.895977 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb0a83f-f618-47e7-b461-f848b3d074e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:38:50.896642 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb0a83f-f618-47e7-b461-f848b3d074e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:38:50.896921 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb0a83f-f618-47e7-b461-f848b3d074e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:38:50.897194 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb0a83f-f618-47e7-b461-f848b3d074e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:38:50.897944 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb0a83f-f618-47e7-b461-f848b3d074e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:38:50.899552 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb0a83f-f618-47e7-b461-f848b3d074e3 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:38:50.909457 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 778/1572] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:38:50 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:38:50.910231 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb0a83f-f618-47e7-b461-f848b3d074e3 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:38:50.920582 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb0a83f-f618-47e7-b461-f848b3d074e3 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:38:50.928072 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 795/1573] 10.222.0.36 () {60 vars in 1152 bytes} [Fri Jun 24 22:38:50 2022] POST /identity/v3/projects => generated 385 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:38:50.928249 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200bfa84-90ad-454a-aa27-ba1403fca235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:38:50.928373 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590ad24a-d2cf-40f4-bb04-492a8b34f439 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:38:50.928456 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200bfa84-90ad-454a-aa27-ba1403fca235 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:38:50.928456 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200bfa84-90ad-454a-aa27-ba1403fca235 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:38:50.928456 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200bfa84-90ad-454a-aa27-ba1403fca235 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:38:50.928456 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200bfa84-90ad-454a-aa27-ba1403fca235 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:38:50.929209 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200bfa84-90ad-454a-aa27-ba1403fca235 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:38:50.940727 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 779/1574] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:38:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:38:50.941563 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200bfa84-90ad-454a-aa27-ba1403fca235 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:38:50.951786 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200bfa84-90ad-454a-aa27-ba1403fca235 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:38:50.987806 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590ad24a-d2cf-40f4-bb04-492a8b34f439 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:38:50.992260 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82613275-1007-4bf2-949c-a76d4e0c9921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:38:50.992923 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82613275-1007-4bf2-949c-a76d4e0c9921 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:38:50.993205 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82613275-1007-4bf2-949c-a76d4e0c9921 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:38:50.993480 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82613275-1007-4bf2-949c-a76d4e0c9921 admin admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:38:50.994195 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82613275-1007-4bf2-949c-a76d4e0c9921 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:38:50.994498 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82613275-1007-4bf2-949c-a76d4e0c9921 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:38:50.996145 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82613275-1007-4bf2-949c-a76d4e0c9921 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:38:51.007737 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 796/1575] 10.222.0.36 () {58 vars in 1152 bytes} [Fri Jun 24 22:38:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:38:51.008699 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82613275-1007-4bf2-949c-a76d4e0c9921 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:38:51.013467 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0c02bd-4968-4a53-a2bf-9815609e4e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:38:51.014449 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0c02bd-4968-4a53-a2bf-9815609e4e1e admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:38:51.014880 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0c02bd-4968-4a53-a2bf-9815609e4e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:38:51.015178 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0c02bd-4968-4a53-a2bf-9815609e4e1e admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:38:51.016026 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0c02bd-4968-4a53-a2bf-9815609e4e1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:38:51.017978 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0c02bd-4968-4a53-a2bf-9815609e4e1e admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:38:51.018307 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82613275-1007-4bf2-949c-a76d4e0c9921 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:38:51.022947 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbc7d7a-bebf-4054-873d-c1ddb39af49b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:38:51.023636 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbc7d7a-bebf-4054-873d-c1ddb39af49b admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:38:51.023895 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbc7d7a-bebf-4054-873d-c1ddb39af49b admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:38:51.024164 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbc7d7a-bebf-4054-873d-c1ddb39af49b admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:38:51.024897 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbc7d7a-bebf-4054-873d-c1ddb39af49b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:38:51.026506 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbc7d7a-bebf-4054-873d-c1ddb39af49b admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:38:51.028598 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:38:51.038117 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 797/1576] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:38:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:38:51.039673 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbc7d7a-bebf-4054-873d-c1ddb39af49b admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:38:51.050702 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 780/1577] 10.222.0.36 () {60 vars in 1152 bytes} [Fri Jun 24 22:38:50 2022] POST /identity/v3/projects => generated 373 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:38:51.050702 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0c02bd-4968-4a53-a2bf-9815609e4e1e admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:38:51.051625 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbc7d7a-bebf-4054-873d-c1ddb39af49b admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:38:51.058476 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:38:51.106414 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a4de51-d018-444b-a6b2-978b6de56db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:38:51.107086 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a4de51-d018-444b-a6b2-978b6de56db1 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:38:51.107395 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a4de51-d018-444b-a6b2-978b6de56db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:38:51.107665 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a4de51-d018-444b-a6b2-978b6de56db1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:38:51.108519 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a4de51-d018-444b-a6b2-978b6de56db1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:38:51.110834 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a4de51-d018-444b-a6b2-978b6de56db1 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:38:51.111739 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0c02bd-4968-4a53-a2bf-9815609e4e1e admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:38:51.116679 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda80b2b-088d-4220-aedd-da0b8f44e118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:38:51.117341 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda80b2b-088d-4220-aedd-da0b8f44e118 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:38:51.117626 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda80b2b-088d-4220-aedd-da0b8f44e118 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:38:51.117898 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda80b2b-088d-4220-aedd-da0b8f44e118 admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:38:51.118581 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda80b2b-088d-4220-aedd-da0b8f44e118 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:38:51.119618 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: WARNING py.warnings [None req-dda80b2b-088d-4220-aedd-da0b8f44e118 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 22:38:51.119618 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: warnings.warn(msg) Jun 24 22:38:51.119618 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: Jun 24 22:38:51.120808 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda80b2b-088d-4220-aedd-da0b8f44e118 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:38:51.139717 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 798/1578] 10.222.0.36 () {60 vars in 1152 bytes} [Fri Jun 24 22:38:51 2022] POST /identity/v3/projects => generated 377 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:38:51.140718 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a4de51-d018-444b-a6b2-978b6de56db1 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:38:51.146888 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 781/1579] 10.222.0.36 () {60 vars in 1143 bytes} [Fri Jun 24 22:38:51 2022] POST /identity/v3/users => generated 284 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:38:51.147621 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda80b2b-088d-4220-aedd-da0b8f44e118 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:38:51.158008 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda80b2b-088d-4220-aedd-da0b8f44e118 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:38:51.210466 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a4de51-d018-444b-a6b2-978b6de56db1 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:38:51.215199 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b43f62-da65-4f48-9dbb-4175139ec3fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:38:51.215747 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546ebdc8-85cc-478c-9b50-035ab9c4255b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:38:51.215882 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b43f62-da65-4f48-9dbb-4175139ec3fe admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:38:51.216161 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b43f62-da65-4f48-9dbb-4175139ec3fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:38:51.216428 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546ebdc8-85cc-478c-9b50-035ab9c4255b admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:38:51.216534 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b43f62-da65-4f48-9dbb-4175139ec3fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:38:51.216716 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546ebdc8-85cc-478c-9b50-035ab9c4255b admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:38:51.217023 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546ebdc8-85cc-478c-9b50-035ab9c4255b admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:38:51.217131 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b43f62-da65-4f48-9dbb-4175139ec3fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:38:51.217723 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546ebdc8-85cc-478c-9b50-035ab9c4255b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:38:51.218868 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b43f62-da65-4f48-9dbb-4175139ec3fe admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:38:51.220341 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546ebdc8-85cc-478c-9b50-035ab9c4255b admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:38:51.229081 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 799/1580] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:38:51 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:38:51.229848 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b43f62-da65-4f48-9dbb-4175139ec3fe admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:38:51.240336 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b43f62-da65-4f48-9dbb-4175139ec3fe admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:38:51.245331 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43376d91-09b7-4a0b-8fee-29f7492a895f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:38:51.246249 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43376d91-09b7-4a0b-8fee-29f7492a895f admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:38:51.246528 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43376d91-09b7-4a0b-8fee-29f7492a895f admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:38:51.246952 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43376d91-09b7-4a0b-8fee-29f7492a895f admin admin] PATH_INFO: `/v3/projects/3cf68a4d73974192b73fb0b7495d4821/users/d38e573b57c147afa87ba5aceb21f73b/roles/1928787bfcc745419829cd315900ac44` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:38:51.254939 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 782/1581] 10.222.0.36 () {60 vars in 1143 bytes} [Fri Jun 24 22:38:51 2022] POST /identity/v3/users => generated 293 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:38:51.256241 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546ebdc8-85cc-478c-9b50-035ab9c4255b admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:38:51.263557 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43376d91-09b7-4a0b-8fee-29f7492a895f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cf68a4d73974192b73fb0b7495d4821, user_id=d38e573b57c147afa87ba5aceb21f73b, role_id=1928787bfcc745419829cd315900ac44)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:38:51.264620 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: WARNING py.warnings [None req-43376d91-09b7-4a0b-8fee-29f7492a895f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 22:38:51.264620 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: warnings.warn(msg) Jun 24 22:38:51.264620 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: Jun 24 22:38:51.266664 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43376d91-09b7-4a0b-8fee-29f7492a895f admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:38:51.266799 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546ebdc8-85cc-478c-9b50-035ab9c4255b admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:38:51.272491 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f30435-7441-49a7-9fa0-5229661424db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:38:51.273300 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f30435-7441-49a7-9fa0-5229661424db admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:38:51.273632 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f30435-7441-49a7-9fa0-5229661424db admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:38:51.273910 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f30435-7441-49a7-9fa0-5229661424db admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:38:51.274629 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f30435-7441-49a7-9fa0-5229661424db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:38:51.276994 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f30435-7441-49a7-9fa0-5229661424db admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:38:51.282195 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 800/1582] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 22:38:51 2022] PUT /identity/v3/projects/3cf68a4d73974192b73fb0b7495d4821/users/d38e573b57c147afa87ba5aceb21f73b/roles/1928787bfcc745419829cd315900ac44 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:38:51.282787 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43376d91-09b7-4a0b-8fee-29f7492a895f admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:38:51.307729 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 783/1583] 10.222.0.36 () {60 vars in 1152 bytes} [Fri Jun 24 22:38:51 2022] POST /identity/v3/projects => generated 387 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:38:51.307729 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f30435-7441-49a7-9fa0-5229661424db admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:38:51.341229 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:38:51.345399 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43376d91-09b7-4a0b-8fee-29f7492a895f admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:38:51.367846 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f30435-7441-49a7-9fa0-5229661424db admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:38:51.372396 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca2ef1a-92ae-45c0-b229-8a2d1bbd05bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:38:51.373065 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca2ef1a-92ae-45c0-b229-8a2d1bbd05bf admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:38:51.373346 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca2ef1a-92ae-45c0-b229-8a2d1bbd05bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:38:51.373620 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca2ef1a-92ae-45c0-b229-8a2d1bbd05bf admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:38:51.374303 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca2ef1a-92ae-45c0-b229-8a2d1bbd05bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:38:51.376521 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca2ef1a-92ae-45c0-b229-8a2d1bbd05bf admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:38:51.386433 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:38:51.403043 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 784/1584] 10.222.0.36 () {60 vars in 1143 bytes} [Fri Jun 24 22:38:51 2022] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:38:51.403043 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca2ef1a-92ae-45c0-b229-8a2d1bbd05bf admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:38:51.403379 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36c01c9-fe98-4bfa-b146-892691ebc4a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:38:51.403379 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c01c9-fe98-4bfa-b146-892691ebc4a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:38:51.403597 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c01c9-fe98-4bfa-b146-892691ebc4a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:38:51.403840 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c01c9-fe98-4bfa-b146-892691ebc4a7 admin admin] PATH_INFO: `/v3/projects/d25315836739424093ce3bb14a3e96fb/users/5ef9341f6c60435fa653581ebaa05cbc/roles/1928787bfcc745419829cd315900ac44` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:38:51.411096 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca2ef1a-92ae-45c0-b229-8a2d1bbd05bf admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:38:51.415743 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02dc860-f2c4-4746-807a-f856d2dc623a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:38:51.416402 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02dc860-f2c4-4746-807a-f856d2dc623a admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:38:51.416699 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02dc860-f2c4-4746-807a-f856d2dc623a admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:38:51.416975 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02dc860-f2c4-4746-807a-f856d2dc623a admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:38:51.417688 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02dc860-f2c4-4746-807a-f856d2dc623a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:38:51.418848 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36c01c9-fe98-4bfa-b146-892691ebc4a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d25315836739424093ce3bb14a3e96fb, user_id=5ef9341f6c60435fa653581ebaa05cbc, role_id=1928787bfcc745419829cd315900ac44)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:38:51.419672 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02dc860-f2c4-4746-807a-f856d2dc623a admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:38:51.421618 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36c01c9-fe98-4bfa-b146-892691ebc4a7 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:38:51.437730 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 801/1585] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 22:38:51 2022] PUT /identity/v3/projects/d25315836739424093ce3bb14a3e96fb/users/5ef9341f6c60435fa653581ebaa05cbc/roles/1928787bfcc745419829cd315900ac44 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:38:51.441078 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36c01c9-fe98-4bfa-b146-892691ebc4a7 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:38:51.448821 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 785/1586] 10.222.0.36 () {60 vars in 1143 bytes} [Fri Jun 24 22:38:51 2022] POST /identity/v3/users => generated 289 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:38:51.448821 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02dc860-f2c4-4746-807a-f856d2dc623a admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:38:51.458679 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02dc860-f2c4-4746-807a-f856d2dc623a admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:38:51.504095 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36c01c9-fe98-4bfa-b146-892691ebc4a7 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:38:51.508860 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ed987d-57a7-4f76-af0a-ddea42d28b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:38:51.509531 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed987d-57a7-4f76-af0a-ddea42d28b45 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:38:51.509810 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed987d-57a7-4f76-af0a-ddea42d28b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:38:51.510086 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed987d-57a7-4f76-af0a-ddea42d28b45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:38:51.510807 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ed987d-57a7-4f76-af0a-ddea42d28b45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:38:51.512459 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ed987d-57a7-4f76-af0a-ddea42d28b45 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:38:51.517188 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3813139b-f0ba-47e8-a3c6-0f2f6b70ca9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:38:51.518090 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813139b-f0ba-47e8-a3c6-0f2f6b70ca9c admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:38:51.518373 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813139b-f0ba-47e8-a3c6-0f2f6b70ca9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:38:51.518648 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813139b-f0ba-47e8-a3c6-0f2f6b70ca9c admin admin] PATH_INFO: `/v3/projects/bab7480a07b1499fa565fac1ff380ca5/users/f0a40e9390da47f38bc80446387197c0/roles/1928787bfcc745419829cd315900ac44` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:38:51.522865 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 802/1587] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:38:51 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:38:51.526567 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ed987d-57a7-4f76-af0a-ddea42d28b45 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:38:51.533484 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3813139b-f0ba-47e8-a3c6-0f2f6b70ca9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bab7480a07b1499fa565fac1ff380ca5, user_id=f0a40e9390da47f38bc80446387197c0, role_id=1928787bfcc745419829cd315900ac44)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:38:51.536123 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ed987d-57a7-4f76-af0a-ddea42d28b45 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:38:51.536258 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3813139b-f0ba-47e8-a3c6-0f2f6b70ca9c admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:38:51.540813 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5f4373-2fef-4eb0-b430-db0895931656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:38:51.541509 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5f4373-2fef-4eb0-b430-db0895931656 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:38:51.541821 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5f4373-2fef-4eb0-b430-db0895931656 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:38:51.542095 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5f4373-2fef-4eb0-b430-db0895931656 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:38:51.542872 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5f4373-2fef-4eb0-b430-db0895931656 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:38:51.544732 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5f4373-2fef-4eb0-b430-db0895931656 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:38:51.551613 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 786/1588] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 22:38:51 2022] PUT /identity/v3/projects/bab7480a07b1499fa565fac1ff380ca5/users/f0a40e9390da47f38bc80446387197c0/roles/1928787bfcc745419829cd315900ac44 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:38:51.552887 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddf3588-a33e-4a16-96a3-f18dc4365365 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:38:51.553187 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddf3588-a33e-4a16-96a3-f18dc4365365 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:38:51.553489 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddf3588-a33e-4a16-96a3-f18dc4365365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:38:51.561863 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 803/1589] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:38:51 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:38:51.561863 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5f4373-2fef-4eb0-b430-db0895931656 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:38:51.571193 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5f4373-2fef-4eb0-b430-db0895931656 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:38:51.572065 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-8ddf3588-a33e-4a16-96a3-f18dc4365365 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:38:51.573294 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-8ddf3588-a33e-4a16-96a3-f18dc4365365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:38:51.627701 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed41b328-dfd0-4f48-8a01-68c67c8c6128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:38:51.628376 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed41b328-dfd0-4f48-8a01-68c67c8c6128 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:38:51.628789 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed41b328-dfd0-4f48-8a01-68c67c8c6128 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:38:51.629059 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed41b328-dfd0-4f48-8a01-68c67c8c6128 admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:38:51.629743 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed41b328-dfd0-4f48-8a01-68c67c8c6128 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:38:51.631706 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed41b328-dfd0-4f48-8a01-68c67c8c6128 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:38:51.634918 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 787/1590] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:38:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:38:51.638428 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddf3588-a33e-4a16-96a3-f18dc4365365 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:38:51.648090 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:38:51.649833 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddf3588-a33e-4a16-96a3-f18dc4365365 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:38:51.657746 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 804/1591] 10.222.0.36 () {60 vars in 1143 bytes} [Fri Jun 24 22:38:51 2022] POST /identity/v3/users => generated 294 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:38:51.657903 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf404dc-13a0-4e76-a7bc-1fa35b069ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:38:51.657903 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf404dc-13a0-4e76-a7bc-1fa35b069ead admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:38:51.657903 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf404dc-13a0-4e76-a7bc-1fa35b069ead admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:38:51.657903 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf404dc-13a0-4e76-a7bc-1fa35b069ead admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:38:51.658248 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66780697-7178-4544-a1a6-954a113b1f38 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:38:51.658248 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66780697-7178-4544-a1a6-954a113b1f38 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:38:51.658248 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66780697-7178-4544-a1a6-954a113b1f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:38:51.658472 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf404dc-13a0-4e76-a7bc-1fa35b069ead admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:38:51.658905 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf404dc-13a0-4e76-a7bc-1fa35b069ead admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:38:51.669551 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 788/1592] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:38:51 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:38:51.670390 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf404dc-13a0-4e76-a7bc-1fa35b069ead admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:38:51.678519 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-66780697-7178-4544-a1a6-954a113b1f38 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:38:51.679791 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-66780697-7178-4544-a1a6-954a113b1f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:38:51.681612 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf404dc-13a0-4e76-a7bc-1fa35b069ead admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:38:51.689274 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cc2769-67a0-479e-a8d1-88093976a769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:38:51.690108 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cc2769-67a0-479e-a8d1-88093976a769 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:38:51.690521 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cc2769-67a0-479e-a8d1-88093976a769 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:38:51.690801 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cc2769-67a0-479e-a8d1-88093976a769 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:38:51.691544 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 805/1593] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:38:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:38:51.691670 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cc2769-67a0-479e-a8d1-88093976a769 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:38:51.692349 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66780697-7178-4544-a1a6-954a113b1f38 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:38:51.693872 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cc2769-67a0-479e-a8d1-88093976a769 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:38:51.702129 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66780697-7178-4544-a1a6-954a113b1f38 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:38:51.706233 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 789/1594] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:38:51 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:38:51.707102 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133ba22b-569b-488e-b229-0d5f584ff6a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:38:51.707590 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd25e2e-1f0f-4af1-9c48-fe052ac1396e None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:38:51.707798 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ba22b-569b-488e-b229-0d5f584ff6a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:38:51.707902 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd25e2e-1f0f-4af1-9c48-fe052ac1396e None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:38:51.708099 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ba22b-569b-488e-b229-0d5f584ff6a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:38:51.708200 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd25e2e-1f0f-4af1-9c48-fe052ac1396e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:38:51.708362 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ba22b-569b-488e-b229-0d5f584ff6a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:38:51.709329 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133ba22b-569b-488e-b229-0d5f584ff6a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:38:51.710949 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133ba22b-569b-488e-b229-0d5f584ff6a6 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:38:51.721797 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 806/1595] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:38:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:38:51.725717 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133ba22b-569b-488e-b229-0d5f584ff6a6 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:38:51.734519 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-fbd25e2e-1f0f-4af1-9c48-fe052ac1396e None None] MFA Rules not processed for user `f0a40e9390da47f38bc80446387197c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:38:51.735356 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133ba22b-569b-488e-b229-0d5f584ff6a6 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:38:51.735769 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-fbd25e2e-1f0f-4af1-9c48-fe052ac1396e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:38:51.740394 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eccc60-f44e-4166-9ee5-d1baec6e682f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:38:51.741071 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eccc60-f44e-4166-9ee5-d1baec6e682f admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:38:51.741354 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eccc60-f44e-4166-9ee5-d1baec6e682f admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:38:51.741626 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eccc60-f44e-4166-9ee5-d1baec6e682f admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:38:51.742339 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eccc60-f44e-4166-9ee5-d1baec6e682f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:38:51.744010 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eccc60-f44e-4166-9ee5-d1baec6e682f admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:38:51.755406 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 807/1596] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:38:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:38:51.756236 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eccc60-f44e-4166-9ee5-d1baec6e682f admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:38:51.757894 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-56eccc60-f44e-4166-9ee5-d1baec6e682f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:38:51.769370 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:38:51.807905 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 790/1597] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:38:51 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:38:51.809017 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd25e2e-1f0f-4af1-9c48-fe052ac1396e None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:38:51.817493 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eccc60-f44e-4166-9ee5-d1baec6e682f admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:38:51.819219 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd25e2e-1f0f-4af1-9c48-fe052ac1396e None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:38:51.822262 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871dfe4c-add3-4b85-9c3b-7d99bb03aab8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:38:51.822919 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871dfe4c-add3-4b85-9c3b-7d99bb03aab8 service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:38:51.823196 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871dfe4c-add3-4b85-9c3b-7d99bb03aab8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:38:51.823493 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871dfe4c-add3-4b85-9c3b-7d99bb03aab8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:38:51.823763 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ece7c53-9eb6-414c-a97d-3f163ee345f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:38:51.824447 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ece7c53-9eb6-414c-a97d-3f163ee345f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:38:51.824711 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ece7c53-9eb6-414c-a97d-3f163ee345f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:38:51.824984 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ece7c53-9eb6-414c-a97d-3f163ee345f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:38:51.825712 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ece7c53-9eb6-414c-a97d-3f163ee345f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:38:51.827346 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ece7c53-9eb6-414c-a97d-3f163ee345f8 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:38:51.833390 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871dfe4c-add3-4b85-9c3b-7d99bb03aab8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:38:51.834876 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871dfe4c-add3-4b85-9c3b-7d99bb03aab8 service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:38:51.837744 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 791/1598] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:38:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:38:51.838611 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ece7c53-9eb6-414c-a97d-3f163ee345f8 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:38:51.846907 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 808/1599] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:38:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:38:51.847779 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871dfe4c-add3-4b85-9c3b-7d99bb03aab8 service neutron] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:38:51.848679 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ece7c53-9eb6-414c-a97d-3f163ee345f8 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:38:51.855590 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871dfe4c-add3-4b85-9c3b-7d99bb03aab8 service neutron] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:38:51.855795 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1867fd-38c8-4a5e-bb7a-0be23fc7826c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:38:51.856458 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1867fd-38c8-4a5e-bb7a-0be23fc7826c admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:38:51.856850 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1867fd-38c8-4a5e-bb7a-0be23fc7826c admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:38:51.857129 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1867fd-38c8-4a5e-bb7a-0be23fc7826c admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:38:51.857861 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1867fd-38c8-4a5e-bb7a-0be23fc7826c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:38:51.859277 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0107dbbc-17cb-4234-8b84-057d21e0d0c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:38:51.859750 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1867fd-38c8-4a5e-bb7a-0be23fc7826c admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:38:51.859950 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0107dbbc-17cb-4234-8b84-057d21e0d0c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:38:51.860428 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0107dbbc-17cb-4234-8b84-057d21e0d0c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:38:51.860707 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0107dbbc-17cb-4234-8b84-057d21e0d0c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:38:51.874082 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 792/1600] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:38:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:38:51.874082 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1867fd-38c8-4a5e-bb7a-0be23fc7826c admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:38:51.874362 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0107dbbc-17cb-4234-8b84-057d21e0d0c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:38:51.874444 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0107dbbc-17cb-4234-8b84-057d21e0d0c1 service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:38:51.883737 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1867fd-38c8-4a5e-bb7a-0be23fc7826c admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:38:51.886425 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 809/1601] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:38:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:38:51.887223 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0107dbbc-17cb-4234-8b84-057d21e0d0c1 service neutron] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:38:51.889902 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d633f73e-6010-49c8-9922-a6f7118e2f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:38:51.890612 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d633f73e-6010-49c8-9922-a6f7118e2f28 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:38:51.890902 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d633f73e-6010-49c8-9922-a6f7118e2f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:38:51.891181 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d633f73e-6010-49c8-9922-a6f7118e2f28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:38:51.892240 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d633f73e-6010-49c8-9922-a6f7118e2f28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:38:51.894043 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d633f73e-6010-49c8-9922-a6f7118e2f28 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:38:51.896580 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0107dbbc-17cb-4234-8b84-057d21e0d0c1 service neutron] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:38:51.901420 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bdbe22-0cde-4e8a-a62d-eea5ed435193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:38:51.902374 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bdbe22-0cde-4e8a-a62d-eea5ed435193 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:38:51.902656 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bdbe22-0cde-4e8a-a62d-eea5ed435193 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:38:51.902930 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bdbe22-0cde-4e8a-a62d-eea5ed435193 admin admin] PATH_INFO: `/v3/projects/8d9dc69886954d808518d0da82a04c78/users/fd75ebe602d043a7b4cec67a5e90e9b4/roles/1928787bfcc745419829cd315900ac44` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:38:51.905262 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 793/1602] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:38:51 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:38:51.906141 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d633f73e-6010-49c8-9922-a6f7118e2f28 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:38:51.920076 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d633f73e-6010-49c8-9922-a6f7118e2f28 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:38:51.923313 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bdbe22-0cde-4e8a-a62d-eea5ed435193 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d9dc69886954d808518d0da82a04c78, user_id=fd75ebe602d043a7b4cec67a5e90e9b4, role_id=1928787bfcc745419829cd315900ac44)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:38:51.926087 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bdbe22-0cde-4e8a-a62d-eea5ed435193 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:38:51.926224 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433007ed-84fc-41b2-b58f-48fe54100ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:38:51.927348 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433007ed-84fc-41b2-b58f-48fe54100ce6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:38:51.927709 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433007ed-84fc-41b2-b58f-48fe54100ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:38:51.928100 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433007ed-84fc-41b2-b58f-48fe54100ce6 admin admin] PATH_INFO: `/v3/projects/f5052436745d4ed99178070cf168499f/users/8a4d1070cbb54d50a1baa686019f78a2/roles/1928787bfcc745419829cd315900ac44` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:38:51.941088 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 810/1603] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 22:38:51 2022] PUT /identity/v3/projects/8d9dc69886954d808518d0da82a04c78/users/fd75ebe602d043a7b4cec67a5e90e9b4/roles/1928787bfcc745419829cd315900ac44 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:38:51.946512 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433007ed-84fc-41b2-b58f-48fe54100ce6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5052436745d4ed99178070cf168499f, user_id=8a4d1070cbb54d50a1baa686019f78a2, role_id=1928787bfcc745419829cd315900ac44)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:38:51.948210 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bdbe22-0cde-4e8a-a62d-eea5ed435193 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:38:51.949433 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433007ed-84fc-41b2-b58f-48fe54100ce6 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:38:51.975584 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 794/1604] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 22:38:51 2022] PUT /identity/v3/projects/f5052436745d4ed99178070cf168499f/users/8a4d1070cbb54d50a1baa686019f78a2/roles/1928787bfcc745419829cd315900ac44 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:38:51.975584 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433007ed-84fc-41b2-b58f-48fe54100ce6 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:38:52.023478 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bdbe22-0cde-4e8a-a62d-eea5ed435193 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:38:52.051353 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433007ed-84fc-41b2-b58f-48fe54100ce6 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:38:52.059023 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7018022-31ae-4368-b8a6-02cf7a7463ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:38:52.060329 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7018022-31ae-4368-b8a6-02cf7a7463ac admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:38:52.061347 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7018022-31ae-4368-b8a6-02cf7a7463ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:38:52.061661 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7018022-31ae-4368-b8a6-02cf7a7463ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:38:52.062565 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7018022-31ae-4368-b8a6-02cf7a7463ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:38:52.065808 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7018022-31ae-4368-b8a6-02cf7a7463ac admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:38:52.074065 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:38:52.079713 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 795/1605] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:38:51 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:38:52.083774 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7018022-31ae-4368-b8a6-02cf7a7463ac admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:38:52.095552 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7018022-31ae-4368-b8a6-02cf7a7463ac admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:38:52.096454 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0d9527-39e0-40ee-b1be-c59d18d2faaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:38:52.097499 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0d9527-39e0-40ee-b1be-c59d18d2faaa admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:38:52.098016 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0d9527-39e0-40ee-b1be-c59d18d2faaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:38:52.098492 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0d9527-39e0-40ee-b1be-c59d18d2faaa admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:38:52.099459 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0d9527-39e0-40ee-b1be-c59d18d2faaa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:38:52.100370 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917a2be7-84ae-4a93-a709-6b83f5e73e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:38:52.101263 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917a2be7-84ae-4a93-a709-6b83f5e73e87 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:38:52.101551 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917a2be7-84ae-4a93-a709-6b83f5e73e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:38:52.101837 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917a2be7-84ae-4a93-a709-6b83f5e73e87 admin admin] PATH_INFO: `/v3/projects/8edb5a27af9a450f8385060bcf3d6410/users/b1bf14f34ac0450fa854f4144b80f62c/roles/1928787bfcc745419829cd315900ac44` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:38:52.103492 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0d9527-39e0-40ee-b1be-c59d18d2faaa admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:38:52.118532 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917a2be7-84ae-4a93-a709-6b83f5e73e87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8edb5a27af9a450f8385060bcf3d6410, user_id=b1bf14f34ac0450fa854f4144b80f62c, role_id=1928787bfcc745419829cd315900ac44)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:38:52.122081 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917a2be7-84ae-4a93-a709-6b83f5e73e87 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:38:52.134393 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 811/1606] 10.222.0.36 () {60 vars in 1152 bytes} [Fri Jun 24 22:38:51 2022] POST /identity/v3/projects => generated 375 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:38:52.135612 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0d9527-39e0-40ee-b1be-c59d18d2faaa admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:38:52.141245 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 796/1607] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 22:38:52 2022] PUT /identity/v3/projects/8edb5a27af9a450f8385060bcf3d6410/users/b1bf14f34ac0450fa854f4144b80f62c/roles/1928787bfcc745419829cd315900ac44 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:38:52.144880 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948b479d-e5ef-4814-acc3-041e4a93ac84 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:38:52.147620 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948b479d-e5ef-4814-acc3-041e4a93ac84 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:38:52.148490 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948b479d-e5ef-4814-acc3-041e4a93ac84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:38:52.179920 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-948b479d-e5ef-4814-acc3-041e4a93ac84 None None] MFA Rules not processed for user `fd75ebe602d043a7b4cec67a5e90e9b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:38:52.181180 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-948b479d-e5ef-4814-acc3-041e4a93ac84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:38:52.217074 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0d9527-39e0-40ee-b1be-c59d18d2faaa admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:38:52.223886 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:38:52.224568 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a754e90-c371-4a3f-b3fb-fa3e0a3bbe0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:38:52.225637 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a754e90-c371-4a3f-b3fb-fa3e0a3bbe0f admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:38:52.225637 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a754e90-c371-4a3f-b3fb-fa3e0a3bbe0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:38:52.225637 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a754e90-c371-4a3f-b3fb-fa3e0a3bbe0f admin admin] PATH_INFO: `/v3/projects/0662077615104363a06fa97f2baae952/users/093a9e645ff24d129ee68067553bbcc6/roles/1928787bfcc745419829cd315900ac44` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:38:52.249885 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a754e90-c371-4a3f-b3fb-fa3e0a3bbe0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0662077615104363a06fa97f2baae952, user_id=093a9e645ff24d129ee68067553bbcc6, role_id=1928787bfcc745419829cd315900ac44)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:38:52.253552 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a754e90-c371-4a3f-b3fb-fa3e0a3bbe0f admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:38:52.265395 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 797/1608] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:38:52 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:38:52.267635 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5205edcd-5725-4e9e-9156-baaacf0b66e2 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:38:52.268200 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5205edcd-5725-4e9e-9156-baaacf0b66e2 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:38:52.268640 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5205edcd-5725-4e9e-9156-baaacf0b66e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:38:52.270183 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 812/1609] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 22:38:52 2022] PUT /identity/v3/projects/0662077615104363a06fa97f2baae952/users/093a9e645ff24d129ee68067553bbcc6/roles/1928787bfcc745419829cd315900ac44 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:38:52.270994 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a754e90-c371-4a3f-b3fb-fa3e0a3bbe0f admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:38:52.309402 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-5205edcd-5725-4e9e-9156-baaacf0b66e2 None None] MFA Rules not processed for user `8a4d1070cbb54d50a1baa686019f78a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:38:52.310626 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-5205edcd-5725-4e9e-9156-baaacf0b66e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:38:52.344859 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a754e90-c371-4a3f-b3fb-fa3e0a3bbe0f admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:38:52.351832 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48b9e7f-cd3d-4a84-aaae-9fab9ed3b987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:38:52.353267 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48b9e7f-cd3d-4a84-aaae-9fab9ed3b987 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:38:52.353755 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48b9e7f-cd3d-4a84-aaae-9fab9ed3b987 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:38:52.354343 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48b9e7f-cd3d-4a84-aaae-9fab9ed3b987 admin admin] PATH_INFO: `/v3/projects/92cea039a96d4972aacfe236615d15c0/users/a3b0839709774ee6854a51acc7fd79f5/roles/1928787bfcc745419829cd315900ac44` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:38:52.376178 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48b9e7f-cd3d-4a84-aaae-9fab9ed3b987 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92cea039a96d4972aacfe236615d15c0, user_id=a3b0839709774ee6854a51acc7fd79f5, role_id=1928787bfcc745419829cd315900ac44)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:38:52.382757 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48b9e7f-cd3d-4a84-aaae-9fab9ed3b987 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:38:52.407703 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 813/1610] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 22:38:52 2022] PUT /identity/v3/projects/92cea039a96d4972aacfe236615d15c0/users/a3b0839709774ee6854a51acc7fd79f5/roles/1928787bfcc745419829cd315900ac44 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:38:52.412354 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48b9e7f-cd3d-4a84-aaae-9fab9ed3b987 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:38:52.485499 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 798/1611] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:38:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:38:52.487030 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:38:52.491600 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3147996-6b40-4066-88d8-eb55e2871155 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:38:52.491911 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3147996-6b40-4066-88d8-eb55e2871155 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:38:52.492895 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3147996-6b40-4066-88d8-eb55e2871155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:38:52.523278 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48b9e7f-cd3d-4a84-aaae-9fab9ed3b987 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:38:52.524362 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-d3147996-6b40-4066-88d8-eb55e2871155 None None] MFA Rules not processed for user `b1bf14f34ac0450fa854f4144b80f62c`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:38:52.526676 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-d3147996-6b40-4066-88d8-eb55e2871155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:38:52.528283 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe750d8-815d-437b-82fc-9a7a52b441ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:38:52.529302 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe750d8-815d-437b-82fc-9a7a52b441ec admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:38:52.529591 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe750d8-815d-437b-82fc-9a7a52b441ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:38:52.530261 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe750d8-815d-437b-82fc-9a7a52b441ec admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:38:52.531514 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe750d8-815d-437b-82fc-9a7a52b441ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:38:52.533355 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe750d8-815d-437b-82fc-9a7a52b441ec admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:38:52.563865 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 814/1612] 10.222.0.36 () {60 vars in 1143 bytes} [Fri Jun 24 22:38:52 2022] POST /identity/v3/users => generated 294 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:38:52.565387 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a1ce08-1385-4a96-a649-8c509295f96f None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:38:52.565684 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a1ce08-1385-4a96-a649-8c509295f96f None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:38:52.566012 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a1ce08-1385-4a96-a649-8c509295f96f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:38:52.587878 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-73a1ce08-1385-4a96-a649-8c509295f96f None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:38:52.589142 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-73a1ce08-1385-4a96-a649-8c509295f96f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:38:52.598260 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 815/1613] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:38:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:38:52.598936 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a1ce08-1385-4a96-a649-8c509295f96f None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:38:52.619758 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 799/1614] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:38:52 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:38:52.621384 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08756ca-67ef-45f9-9e10-18a7cf9a512f None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:38:52.621793 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08756ca-67ef-45f9-9e10-18a7cf9a512f None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:38:52.622386 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08756ca-67ef-45f9-9e10-18a7cf9a512f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:38:52.661931 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-c08756ca-67ef-45f9-9e10-18a7cf9a512f None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:38:52.663895 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-c08756ca-67ef-45f9-9e10-18a7cf9a512f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:38:52.690130 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 800/1615] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:38:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:38:52.693030 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3073222a-02d7-4a35-bb62-302876da0175 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:38:52.693321 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3073222a-02d7-4a35-bb62-302876da0175 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:38:52.695620 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3073222a-02d7-4a35-bb62-302876da0175 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:38:52.698747 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a1ce08-1385-4a96-a649-8c509295f96f None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:38:52.702436 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 801/1616] 10.222.0.36 () {54 vars in 961 bytes} [Fri Jun 24 22:38:52 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:38:52.703586 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3073222a-02d7-4a35-bb62-302876da0175 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:38:52.711621 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa74e1f-84f2-4fcc-b846-ef14f21f58b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a747e2a5684843a6ee9e3480badac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:38:52.712516 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa74e1f-84f2-4fcc-b846-ef14f21f58b0 service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:38:52.713216 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa74e1f-84f2-4fcc-b846-ef14f21f58b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:38:52.713628 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa74e1f-84f2-4fcc-b846-ef14f21f58b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:38:52.746373 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3073222a-02d7-4a35-bb62-302876da0175 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:38:52.759498 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bf6636-4811-4b28-b0ab-db1ae51b7650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:38:52.762038 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bf6636-4811-4b28-b0ab-db1ae51b7650 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:38:52.762340 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bf6636-4811-4b28-b0ab-db1ae51b7650 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:38:52.762622 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bf6636-4811-4b28-b0ab-db1ae51b7650 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:38:52.765861 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bf6636-4811-4b28-b0ab-db1ae51b7650 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:38:52.768701 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bf6636-4811-4b28-b0ab-db1ae51b7650 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:38:52.797860 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa74e1f-84f2-4fcc-b846-ef14f21f58b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:38:52.799371 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 802/1617] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:38:52 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:38:52.799948 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa74e1f-84f2-4fcc-b846-ef14f21f58b0 service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:38:52.802349 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bf6636-4811-4b28-b0ab-db1ae51b7650 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:38:52.816263 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 816/1618] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:38:52 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:38:52.817561 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171208d9-5d20-4ad8-a91d-2a5c83e5b6b3 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:38:52.817910 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171208d9-5d20-4ad8-a91d-2a5c83e5b6b3 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:38:52.818126 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171208d9-5d20-4ad8-a91d-2a5c83e5b6b3 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:38:52.820120 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 817/1619] 10.222.0.36 () {54 vars in 961 bytes} [Fri Jun 24 22:38:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:38:52.822830 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13328603-0aa6-472d-b99f-0d675bdfecd2 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:38:52.823143 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13328603-0aa6-472d-b99f-0d675bdfecd2 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:38:52.823480 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13328603-0aa6-472d-b99f-0d675bdfecd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:38:52.875751 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-13328603-0aa6-472d-b99f-0d675bdfecd2 None None] MFA Rules not processed for user `214d9071042c4bad886bf060a079b6e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:38:52.879333 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-13328603-0aa6-472d-b99f-0d675bdfecd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:38:52.905488 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:38:52.943597 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bf6636-4811-4b28-b0ab-db1ae51b7650 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:38:52.954373 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfc3b83-a807-4141-8dc8-5fc9174a7304 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:38:52.955314 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfc3b83-a807-4141-8dc8-5fc9174a7304 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:38:52.955467 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfc3b83-a807-4141-8dc8-5fc9174a7304 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:38:52.955670 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfc3b83-a807-4141-8dc8-5fc9174a7304 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:38:52.980341 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfc3b83-a807-4141-8dc8-5fc9174a7304 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:38:52.982357 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfc3b83-a807-4141-8dc8-5fc9174a7304 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:38:53.002705 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 818/1620] 10.222.0.36 () {58 vars in 1058 bytes} [Fri Jun 24 22:38:52 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:38:53.003987 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13328603-0aa6-472d-b99f-0d675bdfecd2 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:38:53.012917 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:38:53.019578 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13328603-0aa6-472d-b99f-0d675bdfecd2 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:38:53.019798 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 803/1621] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:38:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:38:53.023413 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfc3b83-a807-4141-8dc8-5fc9174a7304 service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:38:53.024873 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9629661-8686-4d4e-ba37-745033139c7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:38:53.026248 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9629661-8686-4d4e-ba37-745033139c7e service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:38:53.026745 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9629661-8686-4d4e-ba37-745033139c7e service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:38:53.027538 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9629661-8686-4d4e-ba37-745033139c7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:38:53.039311 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9629661-8686-4d4e-ba37-745033139c7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:38:53.042086 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9629661-8686-4d4e-ba37-745033139c7e service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:38:53.051802 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfc3b83-a807-4141-8dc8-5fc9174a7304 service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:38:53.059204 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 819/1622] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:38:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:38:53.059900 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53affd62-15cc-4be4-bfa8-9da58c692f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:38:53.060814 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53affd62-15cc-4be4-bfa8-9da58c692f1e admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:38:53.061902 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53affd62-15cc-4be4-bfa8-9da58c692f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:38:53.061902 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53affd62-15cc-4be4-bfa8-9da58c692f1e admin admin] PATH_INFO: `/v3/projects/8feee3db563446a1ac0aad9aaa99b20f/users/0ee8721f3ee74efcb70c54475887ddca/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:38:53.063539 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94fb06b-6ad8-42de-be40-c4dc0f9fefb7 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:38:53.064070 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94fb06b-6ad8-42de-be40-c4dc0f9fefb7 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:38:53.065250 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94fb06b-6ad8-42de-be40-c4dc0f9fefb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:38:53.094641 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-c94fb06b-6ad8-42de-be40-c4dc0f9fefb7 None None] MFA Rules not processed for user `214d9071042c4bad886bf060a079b6e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:38:53.095383 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53affd62-15cc-4be4-bfa8-9da58c692f1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8feee3db563446a1ac0aad9aaa99b20f, user_id=0ee8721f3ee74efcb70c54475887ddca, role_id=1a1c43cc97a0407eb7a7c7a1333a9d4a)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:38:53.097018 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-c94fb06b-6ad8-42de-be40-c4dc0f9fefb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:38:53.098372 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53affd62-15cc-4be4-bfa8-9da58c692f1e admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:38:53.109141 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 820/1623] 10.222.0.36 () {58 vars in 1058 bytes} [Fri Jun 24 22:38:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:38:53.112362 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94fb06b-6ad8-42de-be40-c4dc0f9fefb7 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:38:53.136067 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 804/1624] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 22:38:53 2022] PUT /identity/v3/projects/8feee3db563446a1ac0aad9aaa99b20f/users/0ee8721f3ee74efcb70c54475887ddca/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:38:53.140198 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53affd62-15cc-4be4-bfa8-9da58c692f1e admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:38:53.146059 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94fb06b-6ad8-42de-be40-c4dc0f9fefb7 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:38:53.306437 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53affd62-15cc-4be4-bfa8-9da58c692f1e admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:38:53.326859 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b975bfd2-2299-41c5-9a10-4352717c7f33 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214d9071042c4bad886bf060a079b6e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:38:53.327380 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b975bfd2-2299-41c5-9a10-4352717c7f33 service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:38:53.327611 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b975bfd2-2299-41c5-9a10-4352717c7f33 service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:38:53.327892 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7295f1a-3496-46a2-a7f5-62248566973b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214d9071042c4bad886bf060a079b6e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:38:53.328121 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b975bfd2-2299-41c5-9a10-4352717c7f33 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:38:53.329716 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7295f1a-3496-46a2-a7f5-62248566973b service nova] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:38:53.329976 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7295f1a-3496-46a2-a7f5-62248566973b service nova] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:38:53.330266 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7295f1a-3496-46a2-a7f5-62248566973b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:38:53.466220 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7295f1a-3496-46a2-a7f5-62248566973b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:38:53.468001 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7295f1a-3496-46a2-a7f5-62248566973b service nova] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:38:53.469172 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b975bfd2-2299-41c5-9a10-4352717c7f33 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:38:53.473564 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b975bfd2-2299-41c5-9a10-4352717c7f33 service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:38:53.495508 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 821/1625] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:38:53 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:38:53.497326 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7295f1a-3496-46a2-a7f5-62248566973b service nova] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:38:53.499011 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 805/1626] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:38:53 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:38:53.713704 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7295f1a-3496-46a2-a7f5-62248566973b service nova] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:38:53.728184 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586dde5d-70a2-4810-9dc5-d84a7a92562a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:38:53.728940 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586dde5d-70a2-4810-9dc5-d84a7a92562a admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:38:53.729266 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586dde5d-70a2-4810-9dc5-d84a7a92562a admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:38:53.729546 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586dde5d-70a2-4810-9dc5-d84a7a92562a admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:38:53.730333 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586dde5d-70a2-4810-9dc5-d84a7a92562a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:38:53.734234 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586dde5d-70a2-4810-9dc5-d84a7a92562a admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:38:53.776239 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 822/1627] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:38:53 2022] GET /identity/v3/roles => generated 1420 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:38:53.780699 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b975bfd2-2299-41c5-9a10-4352717c7f33 service nova] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:38:53.811511 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b975bfd2-2299-41c5-9a10-4352717c7f33 service nova] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:38:53.825621 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d26336-e8f5-4bcd-96e4-0e2f23de8fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:38:53.826684 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d26336-e8f5-4bcd-96e4-0e2f23de8fcf admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:38:53.826974 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d26336-e8f5-4bcd-96e4-0e2f23de8fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:38:53.830169 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d26336-e8f5-4bcd-96e4-0e2f23de8fcf admin admin] PATH_INFO: `/v3/projects/8feee3db563446a1ac0aad9aaa99b20f/users/0ee8721f3ee74efcb70c54475887ddca/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:38:53.833049 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d26336-e8f5-4bcd-96e4-0e2f23de8fcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=8feee3db563446a1ac0aad9aaa99b20f, user_id=0ee8721f3ee74efcb70c54475887ddca, role_id=1a1c43cc97a0407eb7a7c7a1333a9d4a)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:38:53.853436 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d26336-e8f5-4bcd-96e4-0e2f23de8fcf admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:38:53.891939 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 806/1628] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 22:38:53 2022] PUT /identity/v3/projects/8feee3db563446a1ac0aad9aaa99b20f/users/0ee8721f3ee74efcb70c54475887ddca/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 22:38:53.902880 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b48dcc1-9738-42ae-854b-44f1d8c11a55 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:38:53.903189 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b48dcc1-9738-42ae-854b-44f1d8c11a55 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:38:53.903496 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b48dcc1-9738-42ae-854b-44f1d8c11a55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:38:53.996548 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-2b48dcc1-9738-42ae-854b-44f1d8c11a55 None None] MFA Rules not processed for user `0ee8721f3ee74efcb70c54475887ddca`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:38:53.999121 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-2b48dcc1-9738-42ae-854b-44f1d8c11a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:38:54.012436 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:38:54.023287 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cde5129-d9d5-4c86-82c5-5c166e00bf0c None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:38:54.023691 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cde5129-d9d5-4c86-82c5-5c166e00bf0c None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:38:54.024005 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cde5129-d9d5-4c86-82c5-5c166e00bf0c None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:38:54.025889 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 807/1629] 10.222.0.36 () {54 vars in 912 bytes} [Fri Jun 24 22:38:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:38:54.026790 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86150541-4169-460d-878c-082619533883 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:38:54.027070 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86150541-4169-460d-878c-082619533883 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:38:54.027405 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86150541-4169-460d-878c-082619533883 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:38:54.028987 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 808/1630] 10.222.0.36 () {54 vars in 912 bytes} [Fri Jun 24 22:38:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:38:54.036391 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7161550e-9915-4d86-a3c3-ec5715ccc416 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:38:54.036675 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7161550e-9915-4d86-a3c3-ec5715ccc416 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:38:54.036985 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7161550e-9915-4d86-a3c3-ec5715ccc416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:38:54.099439 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-7161550e-9915-4d86-a3c3-ec5715ccc416 None None] MFA Rules not processed for user `214d9071042c4bad886bf060a079b6e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:38:54.103077 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-7161550e-9915-4d86-a3c3-ec5715ccc416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:38:54.168228 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:38:54.186811 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 823/1631] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:38:53 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:38:54.188728 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7d11d3-ccb9-49cf-a3c4-c573cd772f0f None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:38:54.188876 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7d11d3-ccb9-49cf-a3c4-c573cd772f0f None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:38:54.189153 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7d11d3-ccb9-49cf-a3c4-c573cd772f0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:38:54.210852 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-1b7d11d3-ccb9-49cf-a3c4-c573cd772f0f None None] MFA Rules not processed for user `214d9071042c4bad886bf060a079b6e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:38:54.212317 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-1b7d11d3-ccb9-49cf-a3c4-c573cd772f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:38:54.214981 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 809/1632] 10.222.0.36 () {58 vars in 1009 bytes} [Fri Jun 24 22:38:54 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:38:54.216982 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7161550e-9915-4d86-a3c3-ec5715ccc416 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:38:54.239760 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 824/1633] 10.222.0.36 () {58 vars in 1009 bytes} [Fri Jun 24 22:38:54 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:38:54.240798 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7d11d3-ccb9-49cf-a3c4-c573cd772f0f None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:38:54.296277 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7161550e-9915-4d86-a3c3-ec5715ccc416 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:38:54.302159 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c8c8d8-e24d-4dc8-9ff6-88edb9b0c038 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a747e2a5684843a6ee9e3480badac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:38:54.303089 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c8c8d8-e24d-4dc8-9ff6-88edb9b0c038 service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:38:54.303639 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c8c8d8-e24d-4dc8-9ff6-88edb9b0c038 service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:38:54.304159 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c8c8d8-e24d-4dc8-9ff6-88edb9b0c038 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:38:54.328517 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7d11d3-ccb9-49cf-a3c4-c573cd772f0f None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:38:54.333263 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91951595-6382-4ab0-a04c-76f59a679568 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a747e2a5684843a6ee9e3480badac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:38:54.334144 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91951595-6382-4ab0-a04c-76f59a679568 service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:38:54.334432 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91951595-6382-4ab0-a04c-76f59a679568 service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:38:54.335118 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91951595-6382-4ab0-a04c-76f59a679568 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:38:54.349205 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91951595-6382-4ab0-a04c-76f59a679568 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:38:54.351960 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91951595-6382-4ab0-a04c-76f59a679568 service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:38:54.379287 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 825/1634] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:38:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:38:54.385085 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c8c8d8-e24d-4dc8-9ff6-88edb9b0c038 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:38:54.386974 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c8c8d8-e24d-4dc8-9ff6-88edb9b0c038 service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:38:54.398208 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 810/1635] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:38:54 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:38:55.004778 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91951595-6382-4ab0-a04c-76f59a679568 service cinder] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:38:55.004778 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91951595-6382-4ab0-a04c-76f59a679568 service cinder] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:38:55.004778 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0966f04-a981-46c5-9d9b-8371de416928 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a747e2a5684843a6ee9e3480badac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:38:55.004778 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0966f04-a981-46c5-9d9b-8371de416928 service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:38:55.006446 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0966f04-a981-46c5-9d9b-8371de416928 service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:38:55.006446 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0966f04-a981-46c5-9d9b-8371de416928 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:38:55.008097 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0966f04-a981-46c5-9d9b-8371de416928 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:38:55.017071 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0966f04-a981-46c5-9d9b-8371de416928 service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:38:55.047773 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 826/1636] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:38:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:38:55.498835 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c8c8d8-e24d-4dc8-9ff6-88edb9b0c038 service cinder] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:38:55.654046 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c8c8d8-e24d-4dc8-9ff6-88edb9b0c038 service cinder] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:38:55.668152 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ea3380-cb8b-4471-9cc6-2dcd96bb497b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:38:55.669344 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea3380-cb8b-4471-9cc6-2dcd96bb497b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:38:55.669835 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea3380-cb8b-4471-9cc6-2dcd96bb497b admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:38:55.670095 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea3380-cb8b-4471-9cc6-2dcd96bb497b admin admin] PATH_INFO: `/v3/users/b1bf14f34ac0450fa854f4144b80f62c` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:38:55.676494 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ea3380-cb8b-4471-9cc6-2dcd96bb497b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1bf14f34ac0450fa854f4144b80f62c)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:38:55.678703 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ea3380-cb8b-4471-9cc6-2dcd96bb497b admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:38:55.754390 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:38:55.789618 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-a7ea3380-cb8b-4471-9cc6-2dcd96bb497b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1bf14f34ac0450fa854f4144b80f62c'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:38:55.834446 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-a7ea3380-cb8b-4471-9cc6-2dcd96bb497b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1bf14f34ac0450fa854f4144b80f62c'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:38:55.836222 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-a7ea3380-cb8b-4471-9cc6-2dcd96bb497b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1bf14f34ac0450fa854f4144b80f62c'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:38:55.838744 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-a7ea3380-cb8b-4471-9cc6-2dcd96bb497b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1bf14f34ac0450fa854f4144b80f62c'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:38:55.879114 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-a7ea3380-cb8b-4471-9cc6-2dcd96bb497b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1bf14f34ac0450fa854f4144b80f62c'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:38:55.922751 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 811/1637] 10.222.0.36 () {58 vars in 1223 bytes} [Fri Jun 24 22:38:55 2022] DELETE /identity/v3/users/b1bf14f34ac0450fa854f4144b80f62c => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:38:55.928037 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f7eff5-d275-4bbd-b60f-2f86df2d5889 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:38:55.928655 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f7eff5-d275-4bbd-b60f-2f86df2d5889 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:38:55.928761 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f7eff5-d275-4bbd-b60f-2f86df2d5889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:38:55.976765 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-09f7eff5-d275-4bbd-b60f-2f86df2d5889 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:38:55.978162 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-09f7eff5-d275-4bbd-b60f-2f86df2d5889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:38:56.179154 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 827/1638] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:38:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:38:56.204829 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ea3380-cb8b-4471-9cc6-2dcd96bb497b admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:38:56.207648 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-a7ea3380-cb8b-4471-9cc6-2dcd96bb497b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:38:56.412850 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ea3380-cb8b-4471-9cc6-2dcd96bb497b admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:38:56.418218 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceae4ce-8373-445a-b5f1-34501eda2958 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:38:56.419088 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceae4ce-8373-445a-b5f1-34501eda2958 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:38:56.420026 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceae4ce-8373-445a-b5f1-34501eda2958 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:38:56.420467 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceae4ce-8373-445a-b5f1-34501eda2958 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:38:56.440972 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceae4ce-8373-445a-b5f1-34501eda2958 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:38:56.457634 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceae4ce-8373-445a-b5f1-34501eda2958 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:38:56.483144 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 812/1639] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:38:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:38:58.466211 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f7eff5-d275-4bbd-b60f-2f86df2d5889 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:38:58.467874 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-09f7eff5-d275-4bbd-b60f-2f86df2d5889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:38:58.481995 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f7eff5-d275-4bbd-b60f-2f86df2d5889 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:38:58.487850 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa953fe-d160-47e0-a3a5-e2afdf22e9ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:38:58.489193 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa953fe-d160-47e0-a3a5-e2afdf22e9ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:38:58.489471 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa953fe-d160-47e0-a3a5-e2afdf22e9ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:38:58.489881 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa953fe-d160-47e0-a3a5-e2afdf22e9ba admin admin] PATH_INFO: `/v3/projects/8edb5a27af9a450f8385060bcf3d6410` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:38:58.491747 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa953fe-d160-47e0-a3a5-e2afdf22e9ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=8edb5a27af9a450f8385060bcf3d6410)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:38:58.493903 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa953fe-d160-47e0-a3a5-e2afdf22e9ba admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:38:58.522540 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:38:58.604844 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-bfa953fe-d160-47e0-a3a5-e2afdf22e9ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8edb5a27af9a450f8385060bcf3d6410', 'request_id': 'req-bfa953fe-d160-47e0-a3a5-e2afdf22e9ba'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:38:58.619017 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-bfa953fe-d160-47e0-a3a5-e2afdf22e9ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8edb5a27af9a450f8385060bcf3d6410', 'request_id': 'req-bfa953fe-d160-47e0-a3a5-e2afdf22e9ba'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:38:58.641727 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-bfa953fe-d160-47e0-a3a5-e2afdf22e9ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8edb5a27af9a450f8385060bcf3d6410', 'request_id': 'req-bfa953fe-d160-47e0-a3a5-e2afdf22e9ba'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:38:58.666970 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-bfa953fe-d160-47e0-a3a5-e2afdf22e9ba admin admin] The token cache is being invalidate because project 8edb5a27af9a450f8385060bcf3d6410 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 22:38:58.667664 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-bfa953fe-d160-47e0-a3a5-e2afdf22e9ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:38:58.670326 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-bfa953fe-d160-47e0-a3a5-e2afdf22e9ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:38:58.673031 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 828/1640] 10.222.0.36 () {58 vars in 1232 bytes} [Fri Jun 24 22:38:58 2022] DELETE /identity/v3/projects/8edb5a27af9a450f8385060bcf3d6410 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:38:58.678618 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9d4381-edf6-4128-aa4f-dc36b19c5117 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:38:58.679159 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9d4381-edf6-4128-aa4f-dc36b19c5117 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:38:58.679159 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9d4381-edf6-4128-aa4f-dc36b19c5117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:38:58.703390 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-5f9d4381-edf6-4128-aa4f-dc36b19c5117 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:38:58.704741 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-5f9d4381-edf6-4128-aa4f-dc36b19c5117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:38:58.855889 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34572ffc-6fce-4590-b39b-36783b93914c None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:38:58.856544 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34572ffc-6fce-4590-b39b-36783b93914c None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:38:58.857081 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34572ffc-6fce-4590-b39b-36783b93914c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:38:58.859709 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 813/1641] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:38:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:38:58.884885 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-34572ffc-6fce-4590-b39b-36783b93914c None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:38:58.888406 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-34572ffc-6fce-4590-b39b-36783b93914c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:38:58.901694 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 829/1642] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:38:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:38:58.902827 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9d4381-edf6-4128-aa4f-dc36b19c5117 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:38:58.916609 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9d4381-edf6-4128-aa4f-dc36b19c5117 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:38:58.932063 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d88dc5-a906-4b20-98b3-98d5bbda85f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:38:58.932783 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d88dc5-a906-4b20-98b3-98d5bbda85f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:38:58.933056 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d88dc5-a906-4b20-98b3-98d5bbda85f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:38:58.933359 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d88dc5-a906-4b20-98b3-98d5bbda85f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:38:58.938917 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d88dc5-a906-4b20-98b3-98d5bbda85f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:38:58.938917 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d88dc5-a906-4b20-98b3-98d5bbda85f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:38:58.943115 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d88dc5-a906-4b20-98b3-98d5bbda85f6 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:38:58.965792 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 814/1643] 10.222.0.36 () {58 vars in 1152 bytes} [Fri Jun 24 22:38:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 22:38:58.967399 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34572ffc-6fce-4590-b39b-36783b93914c None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:38:58.981480 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34572ffc-6fce-4590-b39b-36783b93914c None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:38:58.988809 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707790f9-0f37-422b-8b32-48cbc5cbe902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:38:58.989496 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707790f9-0f37-422b-8b32-48cbc5cbe902 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:38:58.990322 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707790f9-0f37-422b-8b32-48cbc5cbe902 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:38:58.991533 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707790f9-0f37-422b-8b32-48cbc5cbe902 admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:38:58.993032 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707790f9-0f37-422b-8b32-48cbc5cbe902 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:38:59.000738 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707790f9-0f37-422b-8b32-48cbc5cbe902 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:38:59.059157 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d88dc5-a906-4b20-98b3-98d5bbda85f6 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:38:59.063495 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 830/1644] 10.222.0.36 () {60 vars in 1152 bytes} [Fri Jun 24 22:38:58 2022] POST /identity/v3/projects => generated 365 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 22:38:59.072418 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d88dc5-a906-4b20-98b3-98d5bbda85f6 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:38:59.110246 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:38:59.151715 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7cb32a-36bd-4124-8feb-383673aab30a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:38:59.152486 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7cb32a-36bd-4124-8feb-383673aab30a admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:38:59.153007 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7cb32a-36bd-4124-8feb-383673aab30a admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:38:59.153611 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7cb32a-36bd-4124-8feb-383673aab30a admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:38:59.154613 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7cb32a-36bd-4124-8feb-383673aab30a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:38:59.158317 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7cb32a-36bd-4124-8feb-383673aab30a admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:38:59.203473 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 815/1645] 10.222.0.36 () {60 vars in 1143 bytes} [Fri Jun 24 22:38:59 2022] POST /identity/v3/users => generated 283 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:38:59.211100 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707790f9-0f37-422b-8b32-48cbc5cbe902 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:38:59.228507 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707790f9-0f37-422b-8b32-48cbc5cbe902 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:38:59.257383 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838adb35-2ee5-4dd3-8a2e-99cfc4acec88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:38:59.261623 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838adb35-2ee5-4dd3-8a2e-99cfc4acec88 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:38:59.264239 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838adb35-2ee5-4dd3-8a2e-99cfc4acec88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:38:59.264239 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838adb35-2ee5-4dd3-8a2e-99cfc4acec88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:38:59.269558 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838adb35-2ee5-4dd3-8a2e-99cfc4acec88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:38:59.279588 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838adb35-2ee5-4dd3-8a2e-99cfc4acec88 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:38:59.323003 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 831/1646] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:38:59 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:38:59.325690 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7cb32a-36bd-4124-8feb-383673aab30a admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:38:59.359405 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7cb32a-36bd-4124-8feb-383673aab30a admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:38:59.373860 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216b9bf6-9930-4b37-8d87-b06d87fc2102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:38:59.374633 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216b9bf6-9930-4b37-8d87-b06d87fc2102 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:38:59.375090 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216b9bf6-9930-4b37-8d87-b06d87fc2102 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:38:59.375448 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216b9bf6-9930-4b37-8d87-b06d87fc2102 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:38:59.377147 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216b9bf6-9930-4b37-8d87-b06d87fc2102 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:38:59.388666 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216b9bf6-9930-4b37-8d87-b06d87fc2102 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:38:59.423008 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 816/1647] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:38:59 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:38:59.426377 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838adb35-2ee5-4dd3-8a2e-99cfc4acec88 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:38:59.449215 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838adb35-2ee5-4dd3-8a2e-99cfc4acec88 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:38:59.463992 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba139a60-49f1-4653-8087-4b25e9c2fbd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:38:59.464929 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba139a60-49f1-4653-8087-4b25e9c2fbd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:38:59.465207 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba139a60-49f1-4653-8087-4b25e9c2fbd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:38:59.465483 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba139a60-49f1-4653-8087-4b25e9c2fbd3 admin admin] PATH_INFO: `/v3/projects/f98027597fd34c94843f339a92dab880/users/26b72f7ab8d347eea1429e48e5f5468d/roles/1928787bfcc745419829cd315900ac44` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:38:59.510694 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba139a60-49f1-4653-8087-4b25e9c2fbd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f98027597fd34c94843f339a92dab880, user_id=26b72f7ab8d347eea1429e48e5f5468d, role_id=1928787bfcc745419829cd315900ac44)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:38:59.513620 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba139a60-49f1-4653-8087-4b25e9c2fbd3 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:38:59.548469 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 832/1648] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 22:38:59 2022] PUT /identity/v3/projects/f98027597fd34c94843f339a92dab880/users/26b72f7ab8d347eea1429e48e5f5468d/roles/1928787bfcc745419829cd315900ac44 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:38:59.559128 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b4b45-48a1-4bfa-b0e0-eddcee750eda None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:38:59.560876 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b4b45-48a1-4bfa-b0e0-eddcee750eda None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:38:59.561334 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b4b45-48a1-4bfa-b0e0-eddcee750eda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:38:59.709145 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-6f3b4b45-48a1-4bfa-b0e0-eddcee750eda None None] MFA Rules not processed for user `26b72f7ab8d347eea1429e48e5f5468d`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:38:59.709844 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-6f3b4b45-48a1-4bfa-b0e0-eddcee750eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:38:59.876048 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 817/1649] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:38:59 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:38:59.883459 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba139a60-49f1-4653-8087-4b25e9c2fbd3 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:00.118655 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba139a60-49f1-4653-8087-4b25e9c2fbd3 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:00.131750 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a22e32f-45a2-4896-9c26-ba3f9a778d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:00.132232 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a22e32f-45a2-4896-9c26-ba3f9a778d42 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:00.132615 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a22e32f-45a2-4896-9c26-ba3f9a778d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:00.133829 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a22e32f-45a2-4896-9c26-ba3f9a778d42 admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:00.134682 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a22e32f-45a2-4896-9c26-ba3f9a778d42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:00.137503 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a22e32f-45a2-4896-9c26-ba3f9a778d42 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:00.181891 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 833/1650] 10.222.0.36 () {60 vars in 1152 bytes} [Fri Jun 24 22:38:59 2022] POST /identity/v3/projects => generated 365 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:39:00.186056 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3b4b45-48a1-4bfa-b0e0-eddcee750eda None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:00.207714 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3b4b45-48a1-4bfa-b0e0-eddcee750eda None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:00.369121 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1222ea89-5876-467f-9fa6-e72c13b2b386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:00.370221 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1222ea89-5876-467f-9fa6-e72c13b2b386 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:00.370711 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1222ea89-5876-467f-9fa6-e72c13b2b386 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:00.371201 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1222ea89-5876-467f-9fa6-e72c13b2b386 admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:00.372146 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1222ea89-5876-467f-9fa6-e72c13b2b386 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:00.374354 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1222ea89-5876-467f-9fa6-e72c13b2b386 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:00.408432 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a22e32f-45a2-4896-9c26-ba3f9a778d42 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:00.415988 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 818/1651] 10.222.0.36 () {60 vars in 1143 bytes} [Fri Jun 24 22:39:00 2022] POST /identity/v3/users => generated 289 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:39:00.431644 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a22e32f-45a2-4896-9c26-ba3f9a778d42 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:00.443018 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df208641-8401-4ce4-90e1-4066bebcbcb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:00.443950 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df208641-8401-4ce4-90e1-4066bebcbcb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:00.447051 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df208641-8401-4ce4-90e1-4066bebcbcb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:00.447525 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df208641-8401-4ce4-90e1-4066bebcbcb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:00.448519 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df208641-8401-4ce4-90e1-4066bebcbcb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:00.454649 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df208641-8401-4ce4-90e1-4066bebcbcb6 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:00.478910 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1222ea89-5876-467f-9fa6-e72c13b2b386 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:00.489322 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 834/1652] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:39:00 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:39:00.492733 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1222ea89-5876-467f-9fa6-e72c13b2b386 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:00.498917 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccb4387-1bd5-463f-ba4a-0cd5941c46fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:00.500366 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccb4387-1bd5-463f-ba4a-0cd5941c46fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:00.500957 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccb4387-1bd5-463f-ba4a-0cd5941c46fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:00.501398 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccb4387-1bd5-463f-ba4a-0cd5941c46fe admin admin] PATH_INFO: `/v3/projects/ec5520a264354ec59bff2e84e2ffbeef/users/c694f56f8ee24a7eb53efed67694b671/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:00.526207 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccb4387-1bd5-463f-ba4a-0cd5941c46fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec5520a264354ec59bff2e84e2ffbeef, user_id=c694f56f8ee24a7eb53efed67694b671, role_id=1a1c43cc97a0407eb7a7c7a1333a9d4a)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:00.529206 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccb4387-1bd5-463f-ba4a-0cd5941c46fe admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:00.557036 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 819/1653] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 22:39:00 2022] PUT /identity/v3/projects/ec5520a264354ec59bff2e84e2ffbeef/users/c694f56f8ee24a7eb53efed67694b671/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 22:39:00.562616 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df208641-8401-4ce4-90e1-4066bebcbcb6 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:00.583767 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df208641-8401-4ce4-90e1-4066bebcbcb6 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:00.616035 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:39:00.727746 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04bde94-61dd-485a-b065-afcc2d6e7131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:00.728811 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04bde94-61dd-485a-b065-afcc2d6e7131 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:00.729313 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04bde94-61dd-485a-b065-afcc2d6e7131 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:00.729788 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04bde94-61dd-485a-b065-afcc2d6e7131 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:00.730736 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04bde94-61dd-485a-b065-afcc2d6e7131 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:00.732615 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04bde94-61dd-485a-b065-afcc2d6e7131 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:00.778760 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 835/1654] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:39:00 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:39:00.783277 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccb4387-1bd5-463f-ba4a-0cd5941c46fe admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:00.805275 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccb4387-1bd5-463f-ba4a-0cd5941c46fe admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:00.828029 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715f245d-7714-4f88-8453-a77cc0b22fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:00.829473 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715f245d-7714-4f88-8453-a77cc0b22fc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:00.829902 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715f245d-7714-4f88-8453-a77cc0b22fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:00.830317 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715f245d-7714-4f88-8453-a77cc0b22fc9 admin admin] PATH_INFO: `/v3/projects/ec5520a264354ec59bff2e84e2ffbeef/users/c694f56f8ee24a7eb53efed67694b671/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:00.833021 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715f245d-7714-4f88-8453-a77cc0b22fc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec5520a264354ec59bff2e84e2ffbeef, user_id=c694f56f8ee24a7eb53efed67694b671, role_id=1a1c43cc97a0407eb7a7c7a1333a9d4a)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:00.836001 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715f245d-7714-4f88-8453-a77cc0b22fc9 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:00.839102 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:39:00.854490 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 820/1655] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 22:39:00 2022] PUT /identity/v3/projects/ec5520a264354ec59bff2e84e2ffbeef/users/c694f56f8ee24a7eb53efed67694b671/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:39:00.863859 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa20417-eb44-4527-a6fd-83a5fee8d0be None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:00.864149 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa20417-eb44-4527-a6fd-83a5fee8d0be None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:00.864426 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa20417-eb44-4527-a6fd-83a5fee8d0be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:00.916003 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-baa20417-eb44-4527-a6fd-83a5fee8d0be None None] MFA Rules not processed for user `c694f56f8ee24a7eb53efed67694b671`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:39:00.917147 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-baa20417-eb44-4527-a6fd-83a5fee8d0be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:01.150275 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715f245d-7714-4f88-8453-a77cc0b22fc9 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:01.151343 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 836/1656] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:39:00 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:39:01.152673 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-715f245d-7714-4f88-8453-a77cc0b22fc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:01.301182 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715f245d-7714-4f88-8453-a77cc0b22fc9 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:01.334853 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba78df8e-4aa9-4771-8d17-777e58fa1b27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a747e2a5684843a6ee9e3480badac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:01.335634 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba78df8e-4aa9-4771-8d17-777e58fa1b27 service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:01.335920 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba78df8e-4aa9-4771-8d17-777e58fa1b27 service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:01.336199 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba78df8e-4aa9-4771-8d17-777e58fa1b27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:01.359559 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba78df8e-4aa9-4771-8d17-777e58fa1b27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:01.364722 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba78df8e-4aa9-4771-8d17-777e58fa1b27 service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:01.396910 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 821/1657] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:39:01 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 22:39:02.353323 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa20417-eb44-4527-a6fd-83a5fee8d0be None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:02.540524 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa20417-eb44-4527-a6fd-83a5fee8d0be None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:02.553125 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba44ae8d-1935-4403-8341-1aa677011a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:02.553594 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba44ae8d-1935-4403-8341-1aa677011a59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:02.553942 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba44ae8d-1935-4403-8341-1aa677011a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:02.554137 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba44ae8d-1935-4403-8341-1aa677011a59 admin admin] PATH_INFO: `/v3/users/26b72f7ab8d347eea1429e48e5f5468d` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:02.556402 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba44ae8d-1935-4403-8341-1aa677011a59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26b72f7ab8d347eea1429e48e5f5468d)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:02.560661 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: WARNING py.warnings [None req-ba44ae8d-1935-4403-8341-1aa677011a59 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 22:39:02.560661 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: warnings.warn(msg) Jun 24 22:39:02.560661 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: Jun 24 22:39:02.563182 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba44ae8d-1935-4403-8341-1aa677011a59 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:02.825077 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:39:02.832057 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-ba44ae8d-1935-4403-8341-1aa677011a59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26b72f7ab8d347eea1429e48e5f5468d'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:02.882954 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-ba44ae8d-1935-4403-8341-1aa677011a59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26b72f7ab8d347eea1429e48e5f5468d'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:02.883842 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-ba44ae8d-1935-4403-8341-1aa677011a59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26b72f7ab8d347eea1429e48e5f5468d'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:02.889605 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-ba44ae8d-1935-4403-8341-1aa677011a59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26b72f7ab8d347eea1429e48e5f5468d'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:02.936328 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-ba44ae8d-1935-4403-8341-1aa677011a59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26b72f7ab8d347eea1429e48e5f5468d'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:02.959056 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 837/1658] 10.222.0.36 () {58 vars in 1223 bytes} [Fri Jun 24 22:39:02 2022] DELETE /identity/v3/users/26b72f7ab8d347eea1429e48e5f5468d => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:39:02.964283 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a4e3bf-e9cb-4811-a642-e17711471858 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:02.965452 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a4e3bf-e9cb-4811-a642-e17711471858 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:02.966036 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a4e3bf-e9cb-4811-a642-e17711471858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:02.999610 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-65a4e3bf-e9cb-4811-a642-e17711471858 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:39:03.004986 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-65a4e3bf-e9cb-4811-a642-e17711471858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:03.185665 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab21936d-862a-4a9e-b75b-c247db3b4315 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:03.185969 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab21936d-862a-4a9e-b75b-c247db3b4315 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:03.186250 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab21936d-862a-4a9e-b75b-c247db3b4315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:03.206847 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 822/1659] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:39:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:39:03.218437 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a4e3bf-e9cb-4811-a642-e17711471858 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:03.220508 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-65a4e3bf-e9cb-4811-a642-e17711471858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:03.236422 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-ab21936d-862a-4a9e-b75b-c247db3b4315 None None] MFA Rules not processed for user `d38e573b57c147afa87ba5aceb21f73b`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:39:03.238148 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-ab21936d-862a-4a9e-b75b-c247db3b4315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:03.367491 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a4e3bf-e9cb-4811-a642-e17711471858 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:03.383656 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 838/1660] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:39:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:39:03.384169 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3333b3b4-6a78-4174-ae7f-8076c1a4f159 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:03.384169 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3333b3b4-6a78-4174-ae7f-8076c1a4f159 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:03.384169 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3333b3b4-6a78-4174-ae7f-8076c1a4f159 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:03.384169 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3333b3b4-6a78-4174-ae7f-8076c1a4f159 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:03.384461 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab21936d-862a-4a9e-b75b-c247db3b4315 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:03.384461 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-ab21936d-862a-4a9e-b75b-c247db3b4315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:03.396928 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3333b3b4-6a78-4174-ae7f-8076c1a4f159 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:03.398404 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3333b3b4-6a78-4174-ae7f-8076c1a4f159 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:03.423411 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 823/1661] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:39:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:39:03.424499 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3333b3b4-6a78-4174-ae7f-8076c1a4f159 service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:03.429908 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-3333b3b4-6a78-4174-ae7f-8076c1a4f159 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:03.475602 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab21936d-862a-4a9e-b75b-c247db3b4315 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:03.482042 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bf3dd4-b533-4a19-accf-8463e0b59703 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a747e2a5684843a6ee9e3480badac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:03.483111 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bf3dd4-b533-4a19-accf-8463e0b59703 service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:03.483644 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bf3dd4-b533-4a19-accf-8463e0b59703 service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:03.484228 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bf3dd4-b533-4a19-accf-8463e0b59703 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:03.487730 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-d8bf3dd4-b533-4a19-accf-8463e0b59703 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:03.533344 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:39:03.581984 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3333b3b4-6a78-4174-ae7f-8076c1a4f159 service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:03.590358 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78abacca-5c82-453e-804b-49e276bb3b84 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214d9071042c4bad886bf060a079b6e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:03.591079 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78abacca-5c82-453e-804b-49e276bb3b84 service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:03.591479 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78abacca-5c82-453e-804b-49e276bb3b84 service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:03.591761 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78abacca-5c82-453e-804b-49e276bb3b84 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:03.628190 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78abacca-5c82-453e-804b-49e276bb3b84 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:03.630620 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78abacca-5c82-453e-804b-49e276bb3b84 service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:03.646104 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 824/1662] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:39:03 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:39:03.654939 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bf3dd4-b533-4a19-accf-8463e0b59703 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:03.656605 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bf3dd4-b533-4a19-accf-8463e0b59703 service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:03.677036 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:39:03.711020 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 839/1663] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:39:03 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:39:04.408406 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78abacca-5c82-453e-804b-49e276bb3b84 service nova] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:04.410801 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-78abacca-5c82-453e-804b-49e276bb3b84 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:04.448930 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78abacca-5c82-453e-804b-49e276bb3b84 service nova] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:04.464991 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39ebea3-e9c3-446c-92e2-471b2c57e2d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:04.466144 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ebea3-e9c3-446c-92e2-471b2c57e2d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:04.466521 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ebea3-e9c3-446c-92e2-471b2c57e2d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:04.466902 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ebea3-e9c3-446c-92e2-471b2c57e2d7 admin admin] PATH_INFO: `/v3/projects/f98027597fd34c94843f339a92dab880` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:04.470273 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39ebea3-e9c3-446c-92e2-471b2c57e2d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f98027597fd34c94843f339a92dab880)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:04.474481 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: WARNING py.warnings [None req-f39ebea3-e9c3-446c-92e2-471b2c57e2d7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 22:39:04.474481 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: warnings.warn(msg) Jun 24 22:39:04.474481 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: Jun 24 22:39:04.479098 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39ebea3-e9c3-446c-92e2-471b2c57e2d7 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:04.592426 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-f39ebea3-e9c3-446c-92e2-471b2c57e2d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f98027597fd34c94843f339a92dab880', 'request_id': 'req-f39ebea3-e9c3-446c-92e2-471b2c57e2d7'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:04.619061 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-f39ebea3-e9c3-446c-92e2-471b2c57e2d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f98027597fd34c94843f339a92dab880', 'request_id': 'req-f39ebea3-e9c3-446c-92e2-471b2c57e2d7'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:04.637006 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-f39ebea3-e9c3-446c-92e2-471b2c57e2d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f98027597fd34c94843f339a92dab880', 'request_id': 'req-f39ebea3-e9c3-446c-92e2-471b2c57e2d7'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:04.653227 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-f39ebea3-e9c3-446c-92e2-471b2c57e2d7 admin admin] The token cache is being invalidate because project f98027597fd34c94843f339a92dab880 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 22:39:04.653895 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-f39ebea3-e9c3-446c-92e2-471b2c57e2d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:04.655890 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-f39ebea3-e9c3-446c-92e2-471b2c57e2d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:04.658284 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 825/1664] 10.222.0.36 () {58 vars in 1232 bytes} [Fri Jun 24 22:39:04 2022] DELETE /identity/v3/projects/f98027597fd34c94843f339a92dab880 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:39:04.662626 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bf3dd4-b533-4a19-accf-8463e0b59703 service cinder] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:04.682856 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bf3dd4-b533-4a19-accf-8463e0b59703 service cinder] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:04.837150 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4742e8d1-83b2-43e7-832b-a64bd99d2d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:04.838727 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4742e8d1-83b2-43e7-832b-a64bd99d2d31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:04.839216 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4742e8d1-83b2-43e7-832b-a64bd99d2d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:04.839876 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4742e8d1-83b2-43e7-832b-a64bd99d2d31 admin admin] PATH_INFO: `/v3/users/c694f56f8ee24a7eb53efed67694b671` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:04.841659 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4742e8d1-83b2-43e7-832b-a64bd99d2d31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c694f56f8ee24a7eb53efed67694b671)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:04.844617 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4742e8d1-83b2-43e7-832b-a64bd99d2d31 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:04.946616 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-4742e8d1-83b2-43e7-832b-a64bd99d2d31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c694f56f8ee24a7eb53efed67694b671'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:04.957434 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-4742e8d1-83b2-43e7-832b-a64bd99d2d31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c694f56f8ee24a7eb53efed67694b671'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:04.958365 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-4742e8d1-83b2-43e7-832b-a64bd99d2d31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c694f56f8ee24a7eb53efed67694b671'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:04.960741 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-4742e8d1-83b2-43e7-832b-a64bd99d2d31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c694f56f8ee24a7eb53efed67694b671'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:04.992779 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-4742e8d1-83b2-43e7-832b-a64bd99d2d31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c694f56f8ee24a7eb53efed67694b671'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:05.025657 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 840/1665] 10.222.0.36 () {58 vars in 1223 bytes} [Fri Jun 24 22:39:04 2022] DELETE /identity/v3/users/c694f56f8ee24a7eb53efed67694b671 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:39:06.457168 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39ebea3-e9c3-446c-92e2-471b2c57e2d7 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:06.461052 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-f39ebea3-e9c3-446c-92e2-471b2c57e2d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:06.528069 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39ebea3-e9c3-446c-92e2-471b2c57e2d7 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:06.709947 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7394da-3a93-4e2a-b741-cf888aef6f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:06.711922 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7394da-3a93-4e2a-b741-cf888aef6f17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:06.712373 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7394da-3a93-4e2a-b741-cf888aef6f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:06.712801 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7394da-3a93-4e2a-b741-cf888aef6f17 admin admin] PATH_INFO: `/v3/projects/ec5520a264354ec59bff2e84e2ffbeef` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:06.715056 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7394da-3a93-4e2a-b741-cf888aef6f17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec5520a264354ec59bff2e84e2ffbeef)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:06.720586 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7394da-3a93-4e2a-b741-cf888aef6f17 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:06.849948 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-dc7394da-3a93-4e2a-b741-cf888aef6f17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec5520a264354ec59bff2e84e2ffbeef', 'request_id': 'req-dc7394da-3a93-4e2a-b741-cf888aef6f17'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:06.854128 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:39:06.868978 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-dc7394da-3a93-4e2a-b741-cf888aef6f17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec5520a264354ec59bff2e84e2ffbeef', 'request_id': 'req-dc7394da-3a93-4e2a-b741-cf888aef6f17'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:06.886757 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-dc7394da-3a93-4e2a-b741-cf888aef6f17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec5520a264354ec59bff2e84e2ffbeef', 'request_id': 'req-dc7394da-3a93-4e2a-b741-cf888aef6f17'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:06.923441 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-dc7394da-3a93-4e2a-b741-cf888aef6f17 admin admin] The token cache is being invalidate because project ec5520a264354ec59bff2e84e2ffbeef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 22:39:06.923740 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-dc7394da-3a93-4e2a-b741-cf888aef6f17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:06.930066 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-dc7394da-3a93-4e2a-b741-cf888aef6f17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:06.934086 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 826/1666] 10.222.0.36 () {58 vars in 1232 bytes} [Fri Jun 24 22:39:06 2022] DELETE /identity/v3/projects/ec5520a264354ec59bff2e84e2ffbeef => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:39:06.939230 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5aa144-e269-4da9-a618-7113a3a81477 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:06.940217 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5aa144-e269-4da9-a618-7113a3a81477 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:06.940697 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5aa144-e269-4da9-a618-7113a3a81477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:06.991794 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-4d5aa144-e269-4da9-a618-7113a3a81477 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:39:07.006156 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-4d5aa144-e269-4da9-a618-7113a3a81477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:07.132030 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 841/1667] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:39:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:39:07.140812 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f808da65-5898-4041-a942-3568fc9dc000 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:07.141964 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f808da65-5898-4041-a942-3568fc9dc000 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:07.142455 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f808da65-5898-4041-a942-3568fc9dc000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:07.190046 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-f808da65-5898-4041-a942-3568fc9dc000 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:39:07.193990 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-f808da65-5898-4041-a942-3568fc9dc000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:07.216535 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 827/1668] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:39:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:39:07.222069 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5aa144-e269-4da9-a618-7113a3a81477 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:07.250303 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5aa144-e269-4da9-a618-7113a3a81477 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:07.270386 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec749b0-0f1f-4da3-ae94-e37a450953ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:07.272038 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec749b0-0f1f-4da3-ae94-e37a450953ef admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:07.272628 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec749b0-0f1f-4da3-ae94-e37a450953ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:07.273188 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec749b0-0f1f-4da3-ae94-e37a450953ef admin admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:07.274141 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec749b0-0f1f-4da3-ae94-e37a450953ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:39:07.274657 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec749b0-0f1f-4da3-ae94-e37a450953ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:07.276886 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec749b0-0f1f-4da3-ae94-e37a450953ef admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:07.300179 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 842/1669] 10.222.0.36 () {58 vars in 1152 bytes} [Fri Jun 24 22:39:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:39:07.307967 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f808da65-5898-4041-a942-3568fc9dc000 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:07.333466 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f808da65-5898-4041-a942-3568fc9dc000 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:07.352196 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35aa626-0325-4c4a-b623-a9b802691362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:07.356179 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35aa626-0325-4c4a-b623-a9b802691362 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:07.356660 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35aa626-0325-4c4a-b623-a9b802691362 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:07.357097 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35aa626-0325-4c4a-b623-a9b802691362 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:07.357999 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35aa626-0325-4c4a-b623-a9b802691362 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:07.364125 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35aa626-0325-4c4a-b623-a9b802691362 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:07.422718 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 828/1670] 10.222.0.36 () {60 vars in 1152 bytes} [Fri Jun 24 22:39:07 2022] POST /identity/v3/projects => generated 387 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:39:07.426885 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec749b0-0f1f-4da3-ae94-e37a450953ef admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:07.447445 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec749b0-0f1f-4da3-ae94-e37a450953ef admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:07.458759 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:39:07.608444 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11273cb-4aac-4fba-9d15-7dd7f7c3e14e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:07.609793 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11273cb-4aac-4fba-9d15-7dd7f7c3e14e admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:07.610741 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11273cb-4aac-4fba-9d15-7dd7f7c3e14e admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:07.611234 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11273cb-4aac-4fba-9d15-7dd7f7c3e14e admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:07.612422 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11273cb-4aac-4fba-9d15-7dd7f7c3e14e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:07.614919 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11273cb-4aac-4fba-9d15-7dd7f7c3e14e admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:07.652892 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 843/1671] 10.222.0.36 () {60 vars in 1143 bytes} [Fri Jun 24 22:39:07 2022] POST /identity/v3/users => generated 294 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:39:07.657582 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ae939-cbb5-4d43-8708-bff90bc0e87e None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:07.658083 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ae939-cbb5-4d43-8708-bff90bc0e87e None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:07.658226 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ae939-cbb5-4d43-8708-bff90bc0e87e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:07.665814 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11273cb-4aac-4fba-9d15-7dd7f7c3e14e admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:07.697545 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11273cb-4aac-4fba-9d15-7dd7f7c3e14e admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:07.721266 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172bf991-1818-4951-b262-edf3ebc13e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:07.721821 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-3d5ae939-cbb5-4d43-8708-bff90bc0e87e None None] MFA Rules not processed for user `5ef9341f6c60435fa653581ebaa05cbc`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:39:07.721977 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172bf991-1818-4951-b262-edf3ebc13e54 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:07.722263 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172bf991-1818-4951-b262-edf3ebc13e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:07.722536 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172bf991-1818-4951-b262-edf3ebc13e54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:07.723326 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172bf991-1818-4951-b262-edf3ebc13e54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:07.725105 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172bf991-1818-4951-b262-edf3ebc13e54 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:07.725409 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-3d5ae939-cbb5-4d43-8708-bff90bc0e87e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:07.757010 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 844/1672] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:39:07 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:39:07.761197 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172bf991-1818-4951-b262-edf3ebc13e54 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:07.786038 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172bf991-1818-4951-b262-edf3ebc13e54 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:07.794864 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6234aaba-44fa-488c-9892-350caa80fb3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:07.795667 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6234aaba-44fa-488c-9892-350caa80fb3b admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:07.795951 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6234aaba-44fa-488c-9892-350caa80fb3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:07.796223 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6234aaba-44fa-488c-9892-350caa80fb3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:07.797258 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6234aaba-44fa-488c-9892-350caa80fb3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:07.798970 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6234aaba-44fa-488c-9892-350caa80fb3b admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:07.836529 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 845/1673] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:39:07 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 22:39:07.840760 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6234aaba-44fa-488c-9892-350caa80fb3b admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:07.869621 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6234aaba-44fa-488c-9892-350caa80fb3b admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:07.880151 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7961e5f6-511b-4ab5-ba06-2b14b2878d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:07.881104 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7961e5f6-511b-4ab5-ba06-2b14b2878d39 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:07.881383 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7961e5f6-511b-4ab5-ba06-2b14b2878d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:07.881662 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7961e5f6-511b-4ab5-ba06-2b14b2878d39 admin admin] PATH_INFO: `/v3/projects/c6cb46df485f4adbbd9c9b33b4b16de9/users/4d69074821764deba9acd4e70d8af132/roles/1928787bfcc745419829cd315900ac44` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:07.910946 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 829/1674] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:39:07 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:39:07.912406 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6fd903-f416-45ff-96d8-152ac466eafb None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:07.912701 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6fd903-f416-45ff-96d8-152ac466eafb None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:07.912973 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6fd903-f416-45ff-96d8-152ac466eafb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:07.916693 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7961e5f6-511b-4ab5-ba06-2b14b2878d39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6cb46df485f4adbbd9c9b33b4b16de9, user_id=4d69074821764deba9acd4e70d8af132, role_id=1928787bfcc745419829cd315900ac44)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:07.919511 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7961e5f6-511b-4ab5-ba06-2b14b2878d39 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:07.944823 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 846/1675] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 22:39:07 2022] PUT /identity/v3/projects/c6cb46df485f4adbbd9c9b33b4b16de9/users/4d69074821764deba9acd4e70d8af132/roles/1928787bfcc745419829cd315900ac44 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:39:07.949985 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40655131-308d-476b-b36d-4e6578a805a5 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:07.950184 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-8d6fd903-f416-45ff-96d8-152ac466eafb None None] MFA Rules not processed for user `d38e573b57c147afa87ba5aceb21f73b`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:39:07.951949 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-8d6fd903-f416-45ff-96d8-152ac466eafb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:07.952469 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40655131-308d-476b-b36d-4e6578a805a5 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:07.952967 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40655131-308d-476b-b36d-4e6578a805a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:07.994961 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-40655131-308d-476b-b36d-4e6578a805a5 None None] MFA Rules not processed for user `5ef9341f6c60435fa653581ebaa05cbc`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:39:07.996988 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-40655131-308d-476b-b36d-4e6578a805a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:08.103350 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 830/1676] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:39:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:39:08.105041 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5140225-b260-4c29-8bb0-5333c0c9c5e0 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:08.109669 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5140225-b260-4c29-8bb0-5333c0c9c5e0 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:08.113522 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5140225-b260-4c29-8bb0-5333c0c9c5e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:08.166640 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 847/1677] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:39:07 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:39:08.181469 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40655131-308d-476b-b36d-4e6578a805a5 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:08.198772 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-40655131-308d-476b-b36d-4e6578a805a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:08.222483 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-f5140225-b260-4c29-8bb0-5333c0c9c5e0 None None] MFA Rules not processed for user `4d69074821764deba9acd4e70d8af132`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:39:08.224919 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-f5140225-b260-4c29-8bb0-5333c0c9c5e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:08.344874 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:39:08.372873 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:39:08.411146 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 831/1678] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:39:08 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:39:08.417608 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5140225-b260-4c29-8bb0-5333c0c9c5e0 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:08.447152 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40655131-308d-476b-b36d-4e6578a805a5 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:08.461989 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5527e09e-e05b-4e5e-9e81-81e6c919342e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214d9071042c4bad886bf060a079b6e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:08.462838 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5527e09e-e05b-4e5e-9e81-81e6c919342e service nova] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:08.463128 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5527e09e-e05b-4e5e-9e81-81e6c919342e service nova] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:08.463430 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5527e09e-e05b-4e5e-9e81-81e6c919342e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:08.484381 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5527e09e-e05b-4e5e-9e81-81e6c919342e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:08.486156 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5527e09e-e05b-4e5e-9e81-81e6c919342e service nova] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:08.513314 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 848/1679] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:39:08 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:39:08.560504 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5140225-b260-4c29-8bb0-5333c0c9c5e0 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:08.575841 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c9ef16-90ac-4aa0-afc2-1d5cf2b50837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:08.576598 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c9ef16-90ac-4aa0-afc2-1d5cf2b50837 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:08.576702 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c9ef16-90ac-4aa0-afc2-1d5cf2b50837 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:08.576983 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c9ef16-90ac-4aa0-afc2-1d5cf2b50837 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:08.579305 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c9ef16-90ac-4aa0-afc2-1d5cf2b50837 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:08.585566 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c9ef16-90ac-4aa0-afc2-1d5cf2b50837 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:08.644732 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 832/1680] 10.222.0.36 () {60 vars in 1152 bytes} [Fri Jun 24 22:39:08 2022] POST /identity/v3/projects => generated 387 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:39:08.648938 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5527e09e-e05b-4e5e-9e81-81e6c919342e service nova] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:08.670193 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5527e09e-e05b-4e5e-9e81-81e6c919342e service nova] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:08.877348 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30b2e6b-f361-466f-a51c-5fcf346078e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:08.878083 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30b2e6b-f361-466f-a51c-5fcf346078e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:08.878369 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30b2e6b-f361-466f-a51c-5fcf346078e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:08.878647 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30b2e6b-f361-466f-a51c-5fcf346078e4 admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:08.879394 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30b2e6b-f361-466f-a51c-5fcf346078e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:08.881680 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30b2e6b-f361-466f-a51c-5fcf346078e4 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:08.943931 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c9ef16-90ac-4aa0-afc2-1d5cf2b50837 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:08.953309 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 849/1681] 10.222.0.36 () {60 vars in 1143 bytes} [Fri Jun 24 22:39:08 2022] POST /identity/v3/users => generated 300 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:39:08.957938 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c9ef16-90ac-4aa0-afc2-1d5cf2b50837 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:08.963790 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc461b1c-74c4-4ccd-a9dc-12a35bec0c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:08.964804 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc461b1c-74c4-4ccd-a9dc-12a35bec0c26 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:08.965491 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc461b1c-74c4-4ccd-a9dc-12a35bec0c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:08.965961 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc461b1c-74c4-4ccd-a9dc-12a35bec0c26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:08.967534 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc461b1c-74c4-4ccd-a9dc-12a35bec0c26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:08.970184 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc461b1c-74c4-4ccd-a9dc-12a35bec0c26 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:08.983194 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 833/1682] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:39:08 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 22:39:08.988708 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30b2e6b-f361-466f-a51c-5fcf346078e4 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:09.005147 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30b2e6b-f361-466f-a51c-5fcf346078e4 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:09.012756 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ce51bb-6feb-4267-88d0-d789264fcad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:09.013108 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ce51bb-6feb-4267-88d0-d789264fcad2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:09.013380 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ce51bb-6feb-4267-88d0-d789264fcad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:09.013658 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ce51bb-6feb-4267-88d0-d789264fcad2 admin admin] PATH_INFO: `/v3/projects/355ced287f454aa58ef95293e4d30731/users/1d0c8f5b83454360be7f7211ea2d6121/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:09.039866 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ce51bb-6feb-4267-88d0-d789264fcad2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=355ced287f454aa58ef95293e4d30731, user_id=1d0c8f5b83454360be7f7211ea2d6121, role_id=1a1c43cc97a0407eb7a7c7a1333a9d4a)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:09.042663 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ce51bb-6feb-4267-88d0-d789264fcad2 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:09.071013 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 850/1683] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 22:39:08 2022] PUT /identity/v3/projects/355ced287f454aa58ef95293e4d30731/users/1d0c8f5b83454360be7f7211ea2d6121/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:39:09.075121 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc461b1c-74c4-4ccd-a9dc-12a35bec0c26 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:09.091383 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc461b1c-74c4-4ccd-a9dc-12a35bec0c26 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:09.128304 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fab6e8-e47c-4c46-ba7c-78ea1e341624 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:09.128605 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fab6e8-e47c-4c46-ba7c-78ea1e341624 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:09.128888 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fab6e8-e47c-4c46-ba7c-78ea1e341624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:09.205392 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-92fab6e8-e47c-4c46-ba7c-78ea1e341624 None None] MFA Rules not processed for user `a3b0839709774ee6854a51acc7fd79f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:39:09.206897 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-92fab6e8-e47c-4c46-ba7c-78ea1e341624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:09.274661 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fe5c05-de00-4832-bc81-883d591dc8a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:09.276641 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fe5c05-de00-4832-bc81-883d591dc8a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:09.277670 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fe5c05-de00-4832-bc81-883d591dc8a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:09.279750 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fe5c05-de00-4832-bc81-883d591dc8a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:09.282353 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fe5c05-de00-4832-bc81-883d591dc8a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:09.286621 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fe5c05-de00-4832-bc81-883d591dc8a4 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:09.322461 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 834/1684] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:39:09 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:39:09.325521 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fe5c05-de00-4832-bc81-883d591dc8a4 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:09.368368 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fe5c05-de00-4832-bc81-883d591dc8a4 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:09.397312 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3c5b8e-16f4-417d-9988-92dd01ea5078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:09.398233 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3c5b8e-16f4-417d-9988-92dd01ea5078 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:09.398515 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3c5b8e-16f4-417d-9988-92dd01ea5078 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:09.398793 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3c5b8e-16f4-417d-9988-92dd01ea5078 admin admin] PATH_INFO: `/v3/projects/355ced287f454aa58ef95293e4d30731/users/1d0c8f5b83454360be7f7211ea2d6121/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:09.410118 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3c5b8e-16f4-417d-9988-92dd01ea5078 admin admin] RBAC: Authorizing `identity:create_grant(project_id=355ced287f454aa58ef95293e4d30731, user_id=1d0c8f5b83454360be7f7211ea2d6121, role_id=1a1c43cc97a0407eb7a7c7a1333a9d4a)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:09.412856 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3c5b8e-16f4-417d-9988-92dd01ea5078 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:09.432703 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 851/1685] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:39:09 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:39:09.435563 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2feb280-928e-48fb-ad64-e6992f97cd07 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:09.436065 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2feb280-928e-48fb-ad64-e6992f97cd07 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:09.436526 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2feb280-928e-48fb-ad64-e6992f97cd07 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:09.439428 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 852/1686] 10.222.0.36 () {54 vars in 912 bytes} [Fri Jun 24 22:39:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:39:09.448331 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e0ded3-c742-4ee6-9434-ca034dce4e92 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:09.449902 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e0ded3-c742-4ee6-9434-ca034dce4e92 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:09.450204 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e0ded3-c742-4ee6-9434-ca034dce4e92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:09.473530 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 835/1687] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 22:39:09 2022] PUT /identity/v3/projects/355ced287f454aa58ef95293e4d30731/users/1d0c8f5b83454360be7f7211ea2d6121/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:39:09.476735 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da9878a-1253-4f9d-b852-0358710edc23 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:09.477030 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da9878a-1253-4f9d-b852-0358710edc23 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:09.477312 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da9878a-1253-4f9d-b852-0358710edc23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:09.532802 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-3da9878a-1253-4f9d-b852-0358710edc23 None None] MFA Rules not processed for user `1d0c8f5b83454360be7f7211ea2d6121`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:39:09.535020 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-3da9878a-1253-4f9d-b852-0358710edc23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:09.560522 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-c6e0ded3-c742-4ee6-9434-ca034dce4e92 None None] MFA Rules not processed for user `b78f1fcce4174d1a931453d930d306f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:39:09.562874 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-c6e0ded3-c742-4ee6-9434-ca034dce4e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:09.566721 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:39:09.609524 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:39:09.668372 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 853/1688] 10.222.0.36 () {58 vars in 1009 bytes} [Fri Jun 24 22:39:09 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:39:09.676077 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac017836-9fd9-4883-a4e8-2db8ecd0ef6e None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:09.676518 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac017836-9fd9-4883-a4e8-2db8ecd0ef6e None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:09.677015 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac017836-9fd9-4883-a4e8-2db8ecd0ef6e None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:09.681670 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 836/1689] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:39:09 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:39:09.683099 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70bb8f2-8eab-4671-b1aa-3d2ab1c72179 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:09.683425 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70bb8f2-8eab-4671-b1aa-3d2ab1c72179 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:09.684003 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70bb8f2-8eab-4671-b1aa-3d2ab1c72179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:09.684288 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 854/1690] 10.222.0.36 () {54 vars in 912 bytes} [Fri Jun 24 22:39:09 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:39:09.685205 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac017836-9fd9-4883-a4e8-2db8ecd0ef6e None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:09.687236 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-ac017836-9fd9-4883-a4e8-2db8ecd0ef6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:09.707961 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac017836-9fd9-4883-a4e8-2db8ecd0ef6e None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:09.720243 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c1abb0-8608-4faa-aa10-e29e078e0ef7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:09.720896 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c1abb0-8608-4faa-aa10-e29e078e0ef7 service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:09.721174 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c1abb0-8608-4faa-aa10-e29e078e0ef7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:09.721446 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c1abb0-8608-4faa-aa10-e29e078e0ef7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:09.723947 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-d70bb8f2-8eab-4671-b1aa-3d2ab1c72179 None None] MFA Rules not processed for user `093a9e645ff24d129ee68067553bbcc6`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:39:09.725427 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-d70bb8f2-8eab-4671-b1aa-3d2ab1c72179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:09.731419 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c1abb0-8608-4faa-aa10-e29e078e0ef7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:09.733074 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c1abb0-8608-4faa-aa10-e29e078e0ef7 service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:09.741801 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 855/1691] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:39:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:39:09.743328 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8517ffdb-bd22-4b4f-8db5-8f25b7c98839 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:09.743637 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8517ffdb-bd22-4b4f-8db5-8f25b7c98839 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:09.743894 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8517ffdb-bd22-4b4f-8db5-8f25b7c98839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:09.777417 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-8517ffdb-bd22-4b4f-8db5-8f25b7c98839 None None] MFA Rules not processed for user `b78f1fcce4174d1a931453d930d306f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:39:09.788453 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-8517ffdb-bd22-4b4f-8db5-8f25b7c98839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:09.801506 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 856/1692] 10.222.0.36 () {58 vars in 1009 bytes} [Fri Jun 24 22:39:09 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:39:09.808959 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8517ffdb-bd22-4b4f-8db5-8f25b7c98839 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:09.816397 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-8517ffdb-bd22-4b4f-8db5-8f25b7c98839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:09.853387 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 837/1693] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:39:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:39:09.854659 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70bb8f2-8eab-4671-b1aa-3d2ab1c72179 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:09.866272 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70bb8f2-8eab-4671-b1aa-3d2ab1c72179 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:09.870159 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeef631-75b7-4d62-b8a5-11425d3f44b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:09.870850 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeef631-75b7-4d62-b8a5-11425d3f44b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:09.871136 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeef631-75b7-4d62-b8a5-11425d3f44b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:09.871958 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeef631-75b7-4d62-b8a5-11425d3f44b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:09.881784 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeef631-75b7-4d62-b8a5-11425d3f44b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:09.885791 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeef631-75b7-4d62-b8a5-11425d3f44b2 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:09.899025 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8517ffdb-bd22-4b4f-8db5-8f25b7c98839 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:09.899316 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 838/1694] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:39:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:39:09.901125 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b12d1-1f6a-47e8-bf95-1dca4d30dda7 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:09.901550 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b12d1-1f6a-47e8-bf95-1dca4d30dda7 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:09.901977 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b12d1-1f6a-47e8-bf95-1dca4d30dda7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:09.903561 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f08be0-2aef-45ab-8190-cc0a271aa053 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a747e2a5684843a6ee9e3480badac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:09.904834 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f08be0-2aef-45ab-8190-cc0a271aa053 service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:09.904834 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f08be0-2aef-45ab-8190-cc0a271aa053 service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:09.904834 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f08be0-2aef-45ab-8190-cc0a271aa053 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:09.916384 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f08be0-2aef-45ab-8190-cc0a271aa053 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:09.918300 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f08be0-2aef-45ab-8190-cc0a271aa053 service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:09.931793 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 857/1695] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:39:09 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:39:09.940637 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-094b12d1-1f6a-47e8-bf95-1dca4d30dda7 None None] MFA Rules not processed for user `093a9e645ff24d129ee68067553bbcc6`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:39:09.941851 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-094b12d1-1f6a-47e8-bf95-1dca4d30dda7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:09.964323 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f08be0-2aef-45ab-8190-cc0a271aa053 service cinder] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:09.966066 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 839/1696] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:39:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:39:10.053016 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f08be0-2aef-45ab-8190-cc0a271aa053 service cinder] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:10.058287 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35b2946-4060-4f57-8056-7b33e47212a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:10.059477 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35b2946-4060-4f57-8056-7b33e47212a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:10.059936 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35b2946-4060-4f57-8056-7b33e47212a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:10.060510 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35b2946-4060-4f57-8056-7b33e47212a0 admin admin] PATH_INFO: `/v3/users/4d69074821764deba9acd4e70d8af132` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:10.062111 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35b2946-4060-4f57-8056-7b33e47212a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d69074821764deba9acd4e70d8af132)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:10.066161 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35b2946-4060-4f57-8056-7b33e47212a0 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:10.145055 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-f35b2946-4060-4f57-8056-7b33e47212a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d69074821764deba9acd4e70d8af132'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:10.163948 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-f35b2946-4060-4f57-8056-7b33e47212a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d69074821764deba9acd4e70d8af132'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:10.165294 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-f35b2946-4060-4f57-8056-7b33e47212a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d69074821764deba9acd4e70d8af132'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:10.166420 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-f35b2946-4060-4f57-8056-7b33e47212a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d69074821764deba9acd4e70d8af132'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:10.169510 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:39:10.191968 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-f35b2946-4060-4f57-8056-7b33e47212a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d69074821764deba9acd4e70d8af132'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:10.214274 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 858/1697] 10.222.0.36 () {58 vars in 1223 bytes} [Fri Jun 24 22:39:09 2022] DELETE /identity/v3/users/4d69074821764deba9acd4e70d8af132 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:39:10.219660 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dcf6ed-3014-4311-aca7-02629ed85ce0 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:10.220146 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dcf6ed-3014-4311-aca7-02629ed85ce0 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:10.220557 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dcf6ed-3014-4311-aca7-02629ed85ce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:10.277301 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-a8dcf6ed-3014-4311-aca7-02629ed85ce0 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:39:10.278911 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-a8dcf6ed-3014-4311-aca7-02629ed85ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:10.463444 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 840/1698] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:39:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:39:10.474976 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35b2946-4060-4f57-8056-7b33e47212a0 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:10.477345 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-f35b2946-4060-4f57-8056-7b33e47212a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:10.479449 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dcf6ed-3014-4311-aca7-02629ed85ce0 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:10.485968 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-a8dcf6ed-3014-4311-aca7-02629ed85ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:10.554637 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:39:10.624562 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dcf6ed-3014-4311-aca7-02629ed85ce0 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:10.629259 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35b2946-4060-4f57-8056-7b33e47212a0 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:10.631061 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c656a1-7fb4-4fa3-839c-b008fea3db70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214d9071042c4bad886bf060a079b6e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:10.631766 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c656a1-7fb4-4fa3-839c-b008fea3db70 service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:10.632459 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c656a1-7fb4-4fa3-839c-b008fea3db70 service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:10.632459 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c656a1-7fb4-4fa3-839c-b008fea3db70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:10.634137 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-56c656a1-7fb4-4fa3-839c-b008fea3db70 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:10.635853 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bd825d-8c30-4b32-bcc8-805361212a9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:10.636539 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bd825d-8c30-4b32-bcc8-805361212a9d service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:10.636820 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bd825d-8c30-4b32-bcc8-805361212a9d service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:10.637092 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bd825d-8c30-4b32-bcc8-805361212a9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:10.647024 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bd825d-8c30-4b32-bcc8-805361212a9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:10.648586 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bd825d-8c30-4b32-bcc8-805361212a9d service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:10.659634 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 859/1699] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:39:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:39:10.661221 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bd825d-8c30-4b32-bcc8-805361212a9d service neutron] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:10.662667 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-c5bd825d-8c30-4b32-bcc8-805361212a9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:10.679148 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bd825d-8c30-4b32-bcc8-805361212a9d service neutron] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:10.699787 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb055297-40e0-48df-ab93-f22fcf17f6b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214d9071042c4bad886bf060a079b6e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:10.700452 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb055297-40e0-48df-ab93-f22fcf17f6b9 service nova] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:10.700734 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb055297-40e0-48df-ab93-f22fcf17f6b9 service nova] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:10.701014 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb055297-40e0-48df-ab93-f22fcf17f6b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:10.709097 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-bb055297-40e0-48df-ab93-f22fcf17f6b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:10.729898 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c656a1-7fb4-4fa3-839c-b008fea3db70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:10.731942 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c656a1-7fb4-4fa3-839c-b008fea3db70 service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:10.744541 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 841/1700] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:39:10 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:39:10.746280 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050572cd-afb8-44d1-9d97-428cc58151e9 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:10.746688 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050572cd-afb8-44d1-9d97-428cc58151e9 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:10.746991 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050572cd-afb8-44d1-9d97-428cc58151e9 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:10.748537 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 842/1701] 10.222.0.36 () {54 vars in 960 bytes} [Fri Jun 24 22:39:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:39:10.749510 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050572cd-afb8-44d1-9d97-428cc58151e9 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:10.752893 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-050572cd-afb8-44d1-9d97-428cc58151e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:10.833997 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb055297-40e0-48df-ab93-f22fcf17f6b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:10.835720 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb055297-40e0-48df-ab93-f22fcf17f6b9 service nova] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:10.848377 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 860/1702] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:39:10 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:39:10.849694 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d74345-7353-4889-9322-41133c94ad48 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:10.850012 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d74345-7353-4889-9322-41133c94ad48 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:10.850293 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d74345-7353-4889-9322-41133c94ad48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:10.885673 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-77d74345-7353-4889-9322-41133c94ad48 None None] MFA Rules not processed for user `0233b357708643be94c0ade17ac1fb3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:39:10.887626 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-77d74345-7353-4889-9322-41133c94ad48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:10.926179 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050572cd-afb8-44d1-9d97-428cc58151e9 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:10.960059 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400921ea-26aa-4bda-8f83-9a6c39d119a5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0233b357708643be94c0ade17ac1fb3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:10.962394 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400921ea-26aa-4bda-8f83-9a6c39d119a5 service placement] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:10.964019 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400921ea-26aa-4bda-8f83-9a6c39d119a5 service placement] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:10.964489 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400921ea-26aa-4bda-8f83-9a6c39d119a5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:10.973368 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-400921ea-26aa-4bda-8f83-9a6c39d119a5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:11.019581 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400921ea-26aa-4bda-8f83-9a6c39d119a5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:11.022617 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400921ea-26aa-4bda-8f83-9a6c39d119a5 service placement] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:11.038346 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 843/1703] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:39:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:39:11.062549 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 861/1704] 10.222.0.36 () {58 vars in 1057 bytes} [Fri Jun 24 22:39:10 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:39:11.070225 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400921ea-26aa-4bda-8f83-9a6c39d119a5 service placement] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:11.091147 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400921ea-26aa-4bda-8f83-9a6c39d119a5 service placement] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:11.104728 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599086f8-f491-4b5b-8820-37df327aa2f4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0233b357708643be94c0ade17ac1fb3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:11.105809 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599086f8-f491-4b5b-8820-37df327aa2f4 service placement] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:11.106283 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599086f8-f491-4b5b-8820-37df327aa2f4 service placement] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:11.106747 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599086f8-f491-4b5b-8820-37df327aa2f4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:11.123974 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599086f8-f491-4b5b-8820-37df327aa2f4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:11.129862 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599086f8-f491-4b5b-8820-37df327aa2f4 service placement] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:11.163773 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 844/1705] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:39:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:39:11.325251 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea17643d-aa02-4b3c-8cd1-fa1d6451cece None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:11.325554 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea17643d-aa02-4b3c-8cd1-fa1d6451cece None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:11.326184 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea17643d-aa02-4b3c-8cd1-fa1d6451cece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:11.356227 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-ea17643d-aa02-4b3c-8cd1-fa1d6451cece None None] MFA Rules not processed for user `5ef9341f6c60435fa653581ebaa05cbc`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:39:11.362129 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599086f8-f491-4b5b-8820-37df327aa2f4 service placement] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:11.363742 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-599086f8-f491-4b5b-8820-37df327aa2f4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:11.370814 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-ea17643d-aa02-4b3c-8cd1-fa1d6451cece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:11.384010 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:39:11.409378 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599086f8-f491-4b5b-8820-37df327aa2f4 service placement] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:11.417800 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bd4f02-904c-481a-94ae-af27422383f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:11.420220 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bd4f02-904c-481a-94ae-af27422383f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:11.422581 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bd4f02-904c-481a-94ae-af27422383f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:11.423048 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bd4f02-904c-481a-94ae-af27422383f5 admin admin] PATH_INFO: `/v3/projects/c6cb46df485f4adbbd9c9b33b4b16de9` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:11.425152 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bd4f02-904c-481a-94ae-af27422383f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6cb46df485f4adbbd9c9b33b4b16de9)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:11.432976 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bd4f02-904c-481a-94ae-af27422383f5 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:11.458523 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 862/1706] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:39:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:39:11.554584 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:39:11.573685 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-48bd4f02-904c-481a-94ae-af27422383f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6cb46df485f4adbbd9c9b33b4b16de9', 'request_id': 'req-48bd4f02-904c-481a-94ae-af27422383f5'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:11.629398 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-48bd4f02-904c-481a-94ae-af27422383f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6cb46df485f4adbbd9c9b33b4b16de9', 'request_id': 'req-48bd4f02-904c-481a-94ae-af27422383f5'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:11.648350 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-48bd4f02-904c-481a-94ae-af27422383f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6cb46df485f4adbbd9c9b33b4b16de9', 'request_id': 'req-48bd4f02-904c-481a-94ae-af27422383f5'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:11.679850 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-48bd4f02-904c-481a-94ae-af27422383f5 admin admin] The token cache is being invalidate because project c6cb46df485f4adbbd9c9b33b4b16de9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 22:39:11.680667 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-48bd4f02-904c-481a-94ae-af27422383f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:11.681491 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-48bd4f02-904c-481a-94ae-af27422383f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:11.685406 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 845/1707] 10.222.0.36 () {58 vars in 1232 bytes} [Fri Jun 24 22:39:11 2022] DELETE /identity/v3/projects/c6cb46df485f4adbbd9c9b33b4b16de9 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 22:39:11.689466 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea17643d-aa02-4b3c-8cd1-fa1d6451cece None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:11.705087 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea17643d-aa02-4b3c-8cd1-fa1d6451cece None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:11.912524 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a3f895-6ecd-4404-9586-e4ccd47a987e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:11.914205 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a3f895-6ecd-4404-9586-e4ccd47a987e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:11.916528 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a3f895-6ecd-4404-9586-e4ccd47a987e admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:11.916976 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a3f895-6ecd-4404-9586-e4ccd47a987e admin admin] PATH_INFO: `/v3/users/1d0c8f5b83454360be7f7211ea2d6121` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:11.919072 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a3f895-6ecd-4404-9586-e4ccd47a987e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d0c8f5b83454360be7f7211ea2d6121)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:11.922395 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a3f895-6ecd-4404-9586-e4ccd47a987e admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:12.132010 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-e7a3f895-6ecd-4404-9586-e4ccd47a987e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d0c8f5b83454360be7f7211ea2d6121'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:12.164685 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-e7a3f895-6ecd-4404-9586-e4ccd47a987e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d0c8f5b83454360be7f7211ea2d6121'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:12.165645 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-e7a3f895-6ecd-4404-9586-e4ccd47a987e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d0c8f5b83454360be7f7211ea2d6121'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:12.166455 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-e7a3f895-6ecd-4404-9586-e4ccd47a987e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d0c8f5b83454360be7f7211ea2d6121'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:12.202216 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-e7a3f895-6ecd-4404-9586-e4ccd47a987e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d0c8f5b83454360be7f7211ea2d6121'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:12.235851 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 863/1708] 10.222.0.36 () {58 vars in 1223 bytes} [Fri Jun 24 22:39:11 2022] DELETE /identity/v3/users/1d0c8f5b83454360be7f7211ea2d6121 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:39:14.212700 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bd4f02-904c-481a-94ae-af27422383f5 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:14.214364 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-48bd4f02-904c-481a-94ae-af27422383f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:14.247951 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bd4f02-904c-481a-94ae-af27422383f5 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:14.485801 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d99fe72-b94a-4729-8e0a-d435ff0e77cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:14.487532 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d99fe72-b94a-4729-8e0a-d435ff0e77cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:14.488091 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d99fe72-b94a-4729-8e0a-d435ff0e77cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:14.488589 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d99fe72-b94a-4729-8e0a-d435ff0e77cf admin admin] PATH_INFO: `/v3/projects/355ced287f454aa58ef95293e4d30731` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:14.496536 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d99fe72-b94a-4729-8e0a-d435ff0e77cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=355ced287f454aa58ef95293e4d30731)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:14.500906 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d99fe72-b94a-4729-8e0a-d435ff0e77cf admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:14.636578 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-8d99fe72-b94a-4729-8e0a-d435ff0e77cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '355ced287f454aa58ef95293e4d30731', 'request_id': 'req-8d99fe72-b94a-4729-8e0a-d435ff0e77cf'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:14.649831 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-8d99fe72-b94a-4729-8e0a-d435ff0e77cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '355ced287f454aa58ef95293e4d30731', 'request_id': 'req-8d99fe72-b94a-4729-8e0a-d435ff0e77cf'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:14.667859 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-8d99fe72-b94a-4729-8e0a-d435ff0e77cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '355ced287f454aa58ef95293e4d30731', 'request_id': 'req-8d99fe72-b94a-4729-8e0a-d435ff0e77cf'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:14.723077 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-8d99fe72-b94a-4729-8e0a-d435ff0e77cf admin admin] The token cache is being invalidate because project 355ced287f454aa58ef95293e4d30731 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 22:39:14.723393 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-8d99fe72-b94a-4729-8e0a-d435ff0e77cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:14.726955 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-8d99fe72-b94a-4729-8e0a-d435ff0e77cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:14.735497 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 846/1709] 10.222.0.36 () {58 vars in 1232 bytes} [Fri Jun 24 22:39:14 2022] DELETE /identity/v3/projects/355ced287f454aa58ef95293e4d30731 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:39:14.741836 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c47381-6f05-4d4e-a500-c6b04204f8fc None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:14.743127 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c47381-6f05-4d4e-a500-c6b04204f8fc None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:14.744209 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c47381-6f05-4d4e-a500-c6b04204f8fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:14.807355 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-18c47381-6f05-4d4e-a500-c6b04204f8fc None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:39:14.811618 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-18c47381-6f05-4d4e-a500-c6b04204f8fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:14.969508 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:39:15.097624 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 864/1710] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:39:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:39:15.105968 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88feef2f-5509-4e90-b6f4-cd781a9c765b None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:15.106331 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88feef2f-5509-4e90-b6f4-cd781a9c765b None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:15.106578 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88feef2f-5509-4e90-b6f4-cd781a9c765b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:15.160440 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-88feef2f-5509-4e90-b6f4-cd781a9c765b None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:39:15.161773 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-88feef2f-5509-4e90-b6f4-cd781a9c765b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:15.190457 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 847/1711] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:39:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:39:15.195075 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c47381-6f05-4d4e-a500-c6b04204f8fc None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:15.211431 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c47381-6f05-4d4e-a500-c6b04204f8fc None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:15.220297 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e3676f-c27d-4a76-adf6-fb29b14ae70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:15.221533 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e3676f-c27d-4a76-adf6-fb29b14ae70f admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:15.221828 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e3676f-c27d-4a76-adf6-fb29b14ae70f admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:15.222107 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e3676f-c27d-4a76-adf6-fb29b14ae70f admin admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:15.222864 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e3676f-c27d-4a76-adf6-fb29b14ae70f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:39:15.223175 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e3676f-c27d-4a76-adf6-fb29b14ae70f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:15.225310 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e3676f-c27d-4a76-adf6-fb29b14ae70f admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:15.274300 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 865/1712] 10.222.0.36 () {58 vars in 1152 bytes} [Fri Jun 24 22:39:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:39:15.278729 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88feef2f-5509-4e90-b6f4-cd781a9c765b None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:15.298121 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88feef2f-5509-4e90-b6f4-cd781a9c765b None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:15.308393 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9812aa-e2e1-41cd-b49a-de5405365953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:15.309789 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9812aa-e2e1-41cd-b49a-de5405365953 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:15.310439 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9812aa-e2e1-41cd-b49a-de5405365953 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:15.311057 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9812aa-e2e1-41cd-b49a-de5405365953 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:15.312426 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9812aa-e2e1-41cd-b49a-de5405365953 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:15.315768 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9812aa-e2e1-41cd-b49a-de5405365953 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:15.415672 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 848/1713] 10.222.0.36 () {60 vars in 1152 bytes} [Fri Jun 24 22:39:15 2022] POST /identity/v3/projects => generated 385 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:39:15.420133 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e3676f-c27d-4a76-adf6-fb29b14ae70f admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:15.449705 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e3676f-c27d-4a76-adf6-fb29b14ae70f admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:15.721248 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9812aa-e2e1-41cd-b49a-de5405365953 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:15.724497 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-7c9812aa-e2e1-41cd-b49a-de5405365953 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:15.728734 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade1726f-e9d9-4057-ac73-3a93fc3e8217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:15.729754 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade1726f-e9d9-4057-ac73-3a93fc3e8217 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:15.729754 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade1726f-e9d9-4057-ac73-3a93fc3e8217 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:15.730066 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade1726f-e9d9-4057-ac73-3a93fc3e8217 admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:15.730693 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade1726f-e9d9-4057-ac73-3a93fc3e8217 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:15.732710 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade1726f-e9d9-4057-ac73-3a93fc3e8217 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:15.745257 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9812aa-e2e1-41cd-b49a-de5405365953 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:15.757404 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dd8fcc-e6a8-4d02-a454-3b9aec1c43b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:15.758352 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dd8fcc-e6a8-4d02-a454-3b9aec1c43b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:15.758703 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dd8fcc-e6a8-4d02-a454-3b9aec1c43b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:15.758990 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dd8fcc-e6a8-4d02-a454-3b9aec1c43b0 admin admin] PATH_INFO: `/v3/users/8a4d1070cbb54d50a1baa686019f78a2` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:15.763801 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dd8fcc-e6a8-4d02-a454-3b9aec1c43b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a4d1070cbb54d50a1baa686019f78a2)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:15.773786 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dd8fcc-e6a8-4d02-a454-3b9aec1c43b0 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:15.795371 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 866/1714] 10.222.0.36 () {60 vars in 1143 bytes} [Fri Jun 24 22:39:15 2022] POST /identity/v3/users => generated 293 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 22:39:15.799403 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade1726f-e9d9-4057-ac73-3a93fc3e8217 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:15.826950 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade1726f-e9d9-4057-ac73-3a93fc3e8217 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:15.829896 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:39:15.848012 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1bfd03-63af-48e8-a289-cae42bd8d01e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:15.848822 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1bfd03-63af-48e8-a289-cae42bd8d01e admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:15.850261 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1bfd03-63af-48e8-a289-cae42bd8d01e admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:15.850728 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1bfd03-63af-48e8-a289-cae42bd8d01e admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:15.853846 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1bfd03-63af-48e8-a289-cae42bd8d01e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:15.863195 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1bfd03-63af-48e8-a289-cae42bd8d01e admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:15.892379 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 867/1715] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:39:15 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 22:39:15.907052 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559eab38-723a-4c6c-8bd5-91b4d1006f5b None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:15.910778 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559eab38-723a-4c6c-8bd5-91b4d1006f5b None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:15.911179 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559eab38-723a-4c6c-8bd5-91b4d1006f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:15.911299 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-88dd8fcc-e6a8-4d02-a454-3b9aec1c43b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a4d1070cbb54d50a1baa686019f78a2'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:15.943778 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-88dd8fcc-e6a8-4d02-a454-3b9aec1c43b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a4d1070cbb54d50a1baa686019f78a2'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:15.944741 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-88dd8fcc-e6a8-4d02-a454-3b9aec1c43b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a4d1070cbb54d50a1baa686019f78a2'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:15.945490 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-88dd8fcc-e6a8-4d02-a454-3b9aec1c43b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a4d1070cbb54d50a1baa686019f78a2'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:15.975701 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-559eab38-723a-4c6c-8bd5-91b4d1006f5b None None] MFA Rules not processed for user `a3b0839709774ee6854a51acc7fd79f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:39:15.976940 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-559eab38-723a-4c6c-8bd5-91b4d1006f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:15.991369 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-88dd8fcc-e6a8-4d02-a454-3b9aec1c43b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a4d1070cbb54d50a1baa686019f78a2'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:16.016056 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 849/1716] 10.222.0.36 () {58 vars in 1223 bytes} [Fri Jun 24 22:39:15 2022] DELETE /identity/v3/users/8a4d1070cbb54d50a1baa686019f78a2 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:39:16.017758 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dd8fcc-e6a8-4d02-a454-3b9aec1c43b0 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:16.022559 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-88dd8fcc-e6a8-4d02-a454-3b9aec1c43b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:16.097509 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 868/1717] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:39:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:39:16.098829 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96358201-f8e1-430b-abd5-80dfb9f1b0b2 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:16.099216 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96358201-f8e1-430b-abd5-80dfb9f1b0b2 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:16.099640 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96358201-f8e1-430b-abd5-80dfb9f1b0b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:16.136540 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-96358201-f8e1-430b-abd5-80dfb9f1b0b2 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:39:16.137891 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-96358201-f8e1-430b-abd5-80dfb9f1b0b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:16.219637 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dd8fcc-e6a8-4d02-a454-3b9aec1c43b0 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:16.232297 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78554ccd-5d21-478b-bcd7-13f982fa0d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:16.233003 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78554ccd-5d21-478b-bcd7-13f982fa0d17 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:16.233289 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78554ccd-5d21-478b-bcd7-13f982fa0d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:16.233700 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78554ccd-5d21-478b-bcd7-13f982fa0d17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:16.234473 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78554ccd-5d21-478b-bcd7-13f982fa0d17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:16.236148 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78554ccd-5d21-478b-bcd7-13f982fa0d17 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:16.254426 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:39:16.263620 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 850/1718] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:39:16 2022] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:39:16.265002 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78554ccd-5d21-478b-bcd7-13f982fa0d17 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:16.285825 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78554ccd-5d21-478b-bcd7-13f982fa0d17 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:16.306836 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44e4213-5fb4-4eeb-a35b-31496008e74a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:16.307788 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44e4213-5fb4-4eeb-a35b-31496008e74a admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:16.308077 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44e4213-5fb4-4eeb-a35b-31496008e74a admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:16.308360 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44e4213-5fb4-4eeb-a35b-31496008e74a admin admin] PATH_INFO: `/v3/projects/4b2c6320838e4d61a62c2e3aa0e33218/users/3ee44cd19957408fbd39eec0ad2711fc/roles/1928787bfcc745419829cd315900ac44` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:16.319121 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 869/1719] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:39:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:39:16.328754 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96358201-f8e1-430b-abd5-80dfb9f1b0b2 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:16.332066 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-96358201-f8e1-430b-abd5-80dfb9f1b0b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:16.376235 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44e4213-5fb4-4eeb-a35b-31496008e74a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b2c6320838e4d61a62c2e3aa0e33218, user_id=3ee44cd19957408fbd39eec0ad2711fc, role_id=1928787bfcc745419829cd315900ac44)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:16.379381 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44e4213-5fb4-4eeb-a35b-31496008e74a admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:16.421831 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 851/1720] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 22:39:16 2022] PUT /identity/v3/projects/4b2c6320838e4d61a62c2e3aa0e33218/users/3ee44cd19957408fbd39eec0ad2711fc/roles/1928787bfcc745419829cd315900ac44 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 22:39:16.438059 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b8bbe1-d379-4cc6-ad59-0728a326bba5 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:16.438355 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b8bbe1-d379-4cc6-ad59-0728a326bba5 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:16.438638 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b8bbe1-d379-4cc6-ad59-0728a326bba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:16.491771 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-39b8bbe1-d379-4cc6-ad59-0728a326bba5 None None] MFA Rules not processed for user `3ee44cd19957408fbd39eec0ad2711fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:39:16.494719 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-39b8bbe1-d379-4cc6-ad59-0728a326bba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:16.521669 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96358201-f8e1-430b-abd5-80dfb9f1b0b2 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:16.601766 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:39:16.608724 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7018fe0-d002-406f-9f6c-16bfdcd97f6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:16.609789 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7018fe0-d002-406f-9f6c-16bfdcd97f6b service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:16.610553 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 852/1721] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:39:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:39:16.612265 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7018fe0-d002-406f-9f6c-16bfdcd97f6b service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:16.612687 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7018fe0-d002-406f-9f6c-16bfdcd97f6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:16.616241 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b8bbe1-d379-4cc6-ad59-0728a326bba5 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:16.708255 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b8bbe1-d379-4cc6-ad59-0728a326bba5 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:16.728204 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7018fe0-d002-406f-9f6c-16bfdcd97f6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:16.733096 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8599b334-d93b-4b9c-8094-ad805be85abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:16.734234 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7018fe0-d002-406f-9f6c-16bfdcd97f6b service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:16.735085 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8599b334-d93b-4b9c-8094-ad805be85abe admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:16.735543 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8599b334-d93b-4b9c-8094-ad805be85abe admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:16.736089 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8599b334-d93b-4b9c-8094-ad805be85abe admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:16.737475 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8599b334-d93b-4b9c-8094-ad805be85abe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:16.740958 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8599b334-d93b-4b9c-8094-ad805be85abe admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:16.762207 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 870/1722] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:39:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:39:16.778576 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 853/1723] 10.222.0.36 () {60 vars in 1152 bytes} [Fri Jun 24 22:39:16 2022] POST /identity/v3/projects => generated 387 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:39:16.783191 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7018fe0-d002-406f-9f6c-16bfdcd97f6b service neutron] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:16.804417 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7018fe0-d002-406f-9f6c-16bfdcd97f6b service neutron] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:16.903195 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:39:16.915947 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832450b8-2ad6-4c48-91e8-9ac25f0a2dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:16.916661 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832450b8-2ad6-4c48-91e8-9ac25f0a2dc7 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:16.916999 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832450b8-2ad6-4c48-91e8-9ac25f0a2dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:16.917381 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832450b8-2ad6-4c48-91e8-9ac25f0a2dc7 admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:16.918309 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832450b8-2ad6-4c48-91e8-9ac25f0a2dc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:16.920644 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832450b8-2ad6-4c48-91e8-9ac25f0a2dc7 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:16.959115 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 871/1724] 10.222.0.36 () {60 vars in 1143 bytes} [Fri Jun 24 22:39:16 2022] POST /identity/v3/users => generated 294 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:39:16.963125 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8599b334-d93b-4b9c-8094-ad805be85abe admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:16.981471 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8599b334-d93b-4b9c-8094-ad805be85abe admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:16.995696 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fe4edf-31f3-46b1-8b87-c87bd7d4e37d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:16.996761 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fe4edf-31f3-46b1-8b87-c87bd7d4e37d admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:16.997147 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fe4edf-31f3-46b1-8b87-c87bd7d4e37d admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:16.997541 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fe4edf-31f3-46b1-8b87-c87bd7d4e37d admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:16.998443 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fe4edf-31f3-46b1-8b87-c87bd7d4e37d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:17.000560 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fe4edf-31f3-46b1-8b87-c87bd7d4e37d admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:17.022329 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832450b8-2ad6-4c48-91e8-9ac25f0a2dc7 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:17.041663 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 854/1725] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:39:16 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:39:17.051942 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832450b8-2ad6-4c48-91e8-9ac25f0a2dc7 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:17.072356 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98db66f3-7917-4d86-a29b-cc4c1050d7a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:17.073154 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98db66f3-7917-4d86-a29b-cc4c1050d7a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:17.074637 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98db66f3-7917-4d86-a29b-cc4c1050d7a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:17.075343 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98db66f3-7917-4d86-a29b-cc4c1050d7a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:17.076902 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98db66f3-7917-4d86-a29b-cc4c1050d7a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:17.079285 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98db66f3-7917-4d86-a29b-cc4c1050d7a1 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:17.095659 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 872/1726] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:39:17 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:39:17.099654 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fe4edf-31f3-46b1-8b87-c87bd7d4e37d admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:17.114667 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fe4edf-31f3-46b1-8b87-c87bd7d4e37d admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:17.120874 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7537d7d-5185-436f-bd3b-22a93864f101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:17.121954 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7537d7d-5185-436f-bd3b-22a93864f101 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:17.122308 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7537d7d-5185-436f-bd3b-22a93864f101 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:17.122722 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7537d7d-5185-436f-bd3b-22a93864f101 admin admin] PATH_INFO: `/v3/projects/b63f844db8414657a23c2781c18e6aab/users/36e1827b2d6a4b129fc78104b4e65cdf/roles/1928787bfcc745419829cd315900ac44` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:17.174009 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7537d7d-5185-436f-bd3b-22a93864f101 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b63f844db8414657a23c2781c18e6aab, user_id=36e1827b2d6a4b129fc78104b4e65cdf, role_id=1928787bfcc745419829cd315900ac44)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:17.180200 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7537d7d-5185-436f-bd3b-22a93864f101 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:17.232922 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 855/1727] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 22:39:17 2022] PUT /identity/v3/projects/b63f844db8414657a23c2781c18e6aab/users/36e1827b2d6a4b129fc78104b4e65cdf/roles/1928787bfcc745419829cd315900ac44 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:39:17.246876 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ffe6c-4e29-494e-bb67-017529be1519 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:17.247551 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ffe6c-4e29-494e-bb67-017529be1519 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:17.247939 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ffe6c-4e29-494e-bb67-017529be1519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:17.266832 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7537d7d-5185-436f-bd3b-22a93864f101 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:17.272326 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-e7537d7d-5185-436f-bd3b-22a93864f101 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:17.315933 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-5f6ffe6c-4e29-494e-bb67-017529be1519 None None] MFA Rules not processed for user `36e1827b2d6a4b129fc78104b4e65cdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:39:17.319958 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-5f6ffe6c-4e29-494e-bb67-017529be1519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:17.480088 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 873/1728] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:39:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:39:17.495378 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6ffe6c-4e29-494e-bb67-017529be1519 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:17.736152 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6ffe6c-4e29-494e-bb67-017529be1519 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:17.745724 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0851c87c-db2a-4f73-9ca4-55339b3226a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:17.746783 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0851c87c-db2a-4f73-9ca4-55339b3226a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:17.747071 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0851c87c-db2a-4f73-9ca4-55339b3226a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:17.747723 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0851c87c-db2a-4f73-9ca4-55339b3226a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:17.748104 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0851c87c-db2a-4f73-9ca4-55339b3226a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:17.750222 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0851c87c-db2a-4f73-9ca4-55339b3226a9 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:17.822311 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 874/1729] 10.222.0.36 () {60 vars in 1152 bytes} [Fri Jun 24 22:39:17 2022] POST /identity/v3/projects => generated 387 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:39:17.828895 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0851c87c-db2a-4f73-9ca4-55339b3226a9 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:17.846151 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7537d7d-5185-436f-bd3b-22a93864f101 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:17.920478 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:39:17.967110 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0851c87c-db2a-4f73-9ca4-55339b3226a9 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:17.970824 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:39:17.990480 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eb811d-74da-421e-850d-ca40d85415a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:17.993643 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb811d-74da-421e-850d-ca40d85415a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:17.994239 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb811d-74da-421e-850d-ca40d85415a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:17.994717 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb811d-74da-421e-850d-ca40d85415a4 admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:17.995154 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89768fa3-b4b5-4374-808f-3c7f7e7777a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:17.995959 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eb811d-74da-421e-850d-ca40d85415a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:17.996567 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89768fa3-b4b5-4374-808f-3c7f7e7777a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:17.996981 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89768fa3-b4b5-4374-808f-3c7f7e7777a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:17.997387 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89768fa3-b4b5-4374-808f-3c7f7e7777a2 admin admin] PATH_INFO: `/v3/projects/f5052436745d4ed99178070cf168499f` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:17.998882 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89768fa3-b4b5-4374-808f-3c7f7e7777a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5052436745d4ed99178070cf168499f)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:18.001211 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89768fa3-b4b5-4374-808f-3c7f7e7777a2 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:18.002206 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eb811d-74da-421e-850d-ca40d85415a4 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:18.050080 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 875/1730] 10.222.0.36 () {60 vars in 1143 bytes} [Fri Jun 24 22:39:17 2022] POST /identity/v3/users => generated 300 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:39:18.051545 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eb811d-74da-421e-850d-ca40d85415a4 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:18.063657 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-89768fa3-b4b5-4374-808f-3c7f7e7777a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5052436745d4ed99178070cf168499f', 'request_id': 'req-89768fa3-b4b5-4374-808f-3c7f7e7777a2'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:18.065103 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eb811d-74da-421e-850d-ca40d85415a4 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:18.083587 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-89768fa3-b4b5-4374-808f-3c7f7e7777a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5052436745d4ed99178070cf168499f', 'request_id': 'req-89768fa3-b4b5-4374-808f-3c7f7e7777a2'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:18.100880 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-89768fa3-b4b5-4374-808f-3c7f7e7777a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5052436745d4ed99178070cf168499f', 'request_id': 'req-89768fa3-b4b5-4374-808f-3c7f7e7777a2'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:18.125519 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-89768fa3-b4b5-4374-808f-3c7f7e7777a2 admin admin] The token cache is being invalidate because project f5052436745d4ed99178070cf168499f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 22:39:18.126025 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-89768fa3-b4b5-4374-808f-3c7f7e7777a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:18.127189 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-89768fa3-b4b5-4374-808f-3c7f7e7777a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:18.137390 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 856/1731] 10.222.0.36 () {58 vars in 1232 bytes} [Fri Jun 24 22:39:17 2022] DELETE /identity/v3/projects/f5052436745d4ed99178070cf168499f => generated 0 bytes in 868 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:39:18.142459 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e281826-def0-4e9b-83e5-51bd5ab4063d None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:18.142852 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e281826-def0-4e9b-83e5-51bd5ab4063d None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:18.144499 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e281826-def0-4e9b-83e5-51bd5ab4063d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:18.146680 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca4dda1-981a-485b-b2e3-1535a8749ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:18.147894 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca4dda1-981a-485b-b2e3-1535a8749ba4 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:18.148351 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca4dda1-981a-485b-b2e3-1535a8749ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:18.149121 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca4dda1-981a-485b-b2e3-1535a8749ba4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:18.150862 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca4dda1-981a-485b-b2e3-1535a8749ba4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:18.153087 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca4dda1-981a-485b-b2e3-1535a8749ba4 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:18.174573 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 876/1732] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:39:18 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:39:18.176129 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-5e281826-def0-4e9b-83e5-51bd5ab4063d None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:39:18.177360 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-5e281826-def0-4e9b-83e5-51bd5ab4063d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:18.181849 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca4dda1-981a-485b-b2e3-1535a8749ba4 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:18.184667 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-3ca4dda1-981a-485b-b2e3-1535a8749ba4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:18.194351 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 857/1733] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:39:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 22:39:18.196347 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d623206-6824-4d09-86f2-811cd285fcee None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:18.196634 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d623206-6824-4d09-86f2-811cd285fcee None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:18.196914 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d623206-6824-4d09-86f2-811cd285fcee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:18.206229 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca4dda1-981a-485b-b2e3-1535a8749ba4 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:18.211800 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186d778e-0b9c-4993-9246-ed4fff23d694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:18.212831 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186d778e-0b9c-4993-9246-ed4fff23d694 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:18.213185 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186d778e-0b9c-4993-9246-ed4fff23d694 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:18.213681 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186d778e-0b9c-4993-9246-ed4fff23d694 admin admin] PATH_INFO: `/v3/projects/758a59ef89424400bc4b3b21de7c0c63/users/6b14bf488f364e34b09eaa99d7bb0d21/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:18.220758 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-4d623206-6824-4d09-86f2-811cd285fcee None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:39:18.221978 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-4d623206-6824-4d09-86f2-811cd285fcee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:18.231456 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186d778e-0b9c-4993-9246-ed4fff23d694 admin admin] RBAC: Authorizing `identity:create_grant(project_id=758a59ef89424400bc4b3b21de7c0c63, user_id=6b14bf488f364e34b09eaa99d7bb0d21, role_id=1a1c43cc97a0407eb7a7c7a1333a9d4a)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:18.236026 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 858/1734] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:39:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:39:18.236166 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186d778e-0b9c-4993-9246-ed4fff23d694 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:18.237464 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d623206-6824-4d09-86f2-811cd285fcee None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:18.249248 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d623206-6824-4d09-86f2-811cd285fcee None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:18.256128 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 877/1735] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 22:39:18 2022] PUT /identity/v3/projects/758a59ef89424400bc4b3b21de7c0c63/users/6b14bf488f364e34b09eaa99d7bb0d21/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:39:18.257349 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186d778e-0b9c-4993-9246-ed4fff23d694 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:18.363920 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fdbe19-0f46-4f90-9b49-c46a85d485d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:18.365600 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fdbe19-0f46-4f90-9b49-c46a85d485d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:18.365885 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fdbe19-0f46-4f90-9b49-c46a85d485d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:18.366398 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fdbe19-0f46-4f90-9b49-c46a85d485d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:18.369748 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fdbe19-0f46-4f90-9b49-c46a85d485d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:39:18.370060 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fdbe19-0f46-4f90-9b49-c46a85d485d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:18.372451 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fdbe19-0f46-4f90-9b49-c46a85d485d7 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:18.411304 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186d778e-0b9c-4993-9246-ed4fff23d694 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:18.412092 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 859/1736] 10.222.0.36 () {58 vars in 1152 bytes} [Fri Jun 24 22:39:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 22:39:18.414850 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fdbe19-0f46-4f90-9b49-c46a85d485d7 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:18.436011 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdba2cbb-035d-4d4f-85cd-4da0f9c40531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:18.436777 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdba2cbb-035d-4d4f-85cd-4da0f9c40531 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:18.437075 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdba2cbb-035d-4d4f-85cd-4da0f9c40531 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:18.437350 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdba2cbb-035d-4d4f-85cd-4da0f9c40531 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:18.438101 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdba2cbb-035d-4d4f-85cd-4da0f9c40531 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:18.439793 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdba2cbb-035d-4d4f-85cd-4da0f9c40531 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:18.444068 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fdbe19-0f46-4f90-9b49-c46a85d485d7 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:18.465594 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bb6de5-6e42-4cf7-b95a-472593642821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:18.466289 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bb6de5-6e42-4cf7-b95a-472593642821 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:18.466577 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bb6de5-6e42-4cf7-b95a-472593642821 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:18.466856 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bb6de5-6e42-4cf7-b95a-472593642821 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:18.467594 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bb6de5-6e42-4cf7-b95a-472593642821 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:18.469989 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bb6de5-6e42-4cf7-b95a-472593642821 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:18.476911 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 878/1737] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:39:18 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 22:39:18.481562 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdba2cbb-035d-4d4f-85cd-4da0f9c40531 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:18.516046 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdba2cbb-035d-4d4f-85cd-4da0f9c40531 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:18.532049 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bf1d64-5f59-49be-89d5-d4a182d9a56c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:18.532981 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bf1d64-5f59-49be-89d5-d4a182d9a56c admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:18.533264 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bf1d64-5f59-49be-89d5-d4a182d9a56c admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:18.533546 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bf1d64-5f59-49be-89d5-d4a182d9a56c admin admin] PATH_INFO: `/v3/projects/758a59ef89424400bc4b3b21de7c0c63/users/6b14bf488f364e34b09eaa99d7bb0d21/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:18.548300 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bf1d64-5f59-49be-89d5-d4a182d9a56c admin admin] RBAC: Authorizing `identity:create_grant(project_id=758a59ef89424400bc4b3b21de7c0c63, user_id=6b14bf488f364e34b09eaa99d7bb0d21, role_id=1a1c43cc97a0407eb7a7c7a1333a9d4a)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:18.553675 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bf1d64-5f59-49be-89d5-d4a182d9a56c admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:18.565220 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 860/1738] 10.222.0.36 () {60 vars in 1152 bytes} [Fri Jun 24 22:39:18 2022] POST /identity/v3/projects => generated 405 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 22:39:18.572822 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bb6de5-6e42-4cf7-b95a-472593642821 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:18.583970 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 879/1739] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 22:39:18 2022] PUT /identity/v3/projects/758a59ef89424400bc4b3b21de7c0c63/users/6b14bf488f364e34b09eaa99d7bb0d21/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:39:18.594908 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17aac7b-adbb-4f6f-8762-e27769424b92 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:18.595144 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17aac7b-adbb-4f6f-8762-e27769424b92 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:18.595491 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17aac7b-adbb-4f6f-8762-e27769424b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:18.675216 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:39:18.695949 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-d17aac7b-adbb-4f6f-8762-e27769424b92 None None] MFA Rules not processed for user `6b14bf488f364e34b09eaa99d7bb0d21`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:39:18.700447 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-d17aac7b-adbb-4f6f-8762-e27769424b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:18.742470 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bb6de5-6e42-4cf7-b95a-472593642821 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:18.787791 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:39:18.878965 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e91e3fb-dc77-4a5f-944a-006563558304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:18.879841 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91e3fb-dc77-4a5f-944a-006563558304 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:18.880189 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91e3fb-dc77-4a5f-944a-006563558304 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:18.880587 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91e3fb-dc77-4a5f-944a-006563558304 admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:18.881348 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e91e3fb-dc77-4a5f-944a-006563558304 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:18.884302 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e91e3fb-dc77-4a5f-944a-006563558304 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:18.898092 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 880/1740] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:39:18 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:39:18.909088 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17aac7b-adbb-4f6f-8762-e27769424b92 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:18.912455 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-d17aac7b-adbb-4f6f-8762-e27769424b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:18.929573 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 861/1741] 10.222.0.36 () {60 vars in 1143 bytes} [Fri Jun 24 22:39:18 2022] POST /identity/v3/users => generated 303 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:39:18.933328 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e91e3fb-dc77-4a5f-944a-006563558304 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:18.946393 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e91e3fb-dc77-4a5f-944a-006563558304 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:18.952403 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4662df8-0fde-461f-b011-99d22c1d3ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:18.963515 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4662df8-0fde-461f-b011-99d22c1d3ad4 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:18.963764 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4662df8-0fde-461f-b011-99d22c1d3ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:18.964051 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4662df8-0fde-461f-b011-99d22c1d3ad4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:18.965697 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4662df8-0fde-461f-b011-99d22c1d3ad4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:18.969059 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4662df8-0fde-461f-b011-99d22c1d3ad4 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:18.984958 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 862/1742] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:39:18 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 22:39:18.989200 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4662df8-0fde-461f-b011-99d22c1d3ad4 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:19.003309 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4662df8-0fde-461f-b011-99d22c1d3ad4 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:19.010943 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465aac92-de9a-4f80-9b63-2f31a7ac9f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:19.013968 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465aac92-de9a-4f80-9b63-2f31a7ac9f5e admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:19.014098 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465aac92-de9a-4f80-9b63-2f31a7ac9f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:19.014281 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465aac92-de9a-4f80-9b63-2f31a7ac9f5e admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:19.015100 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465aac92-de9a-4f80-9b63-2f31a7ac9f5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:19.018397 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465aac92-de9a-4f80-9b63-2f31a7ac9f5e admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:19.042926 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17aac7b-adbb-4f6f-8762-e27769424b92 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:19.049682 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 863/1743] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:39:18 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 22:39:19.052225 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465aac92-de9a-4f80-9b63-2f31a7ac9f5e admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:19.122770 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3e1a64-dc69-435b-8e6e-c4139f290cca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a747e2a5684843a6ee9e3480badac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:19.126156 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e1a64-dc69-435b-8e6e-c4139f290cca service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:19.128024 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e1a64-dc69-435b-8e6e-c4139f290cca service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:19.129157 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e1a64-dc69-435b-8e6e-c4139f290cca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:19.160772 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465aac92-de9a-4f80-9b63-2f31a7ac9f5e admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:19.164963 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3e1a64-dc69-435b-8e6e-c4139f290cca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:19.166470 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3e1a64-dc69-435b-8e6e-c4139f290cca service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:19.173989 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5893ef3-1e6d-4fd6-960a-15ae4911ee0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:19.174917 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5893ef3-1e6d-4fd6-960a-15ae4911ee0f admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:19.175203 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5893ef3-1e6d-4fd6-960a-15ae4911ee0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:19.175578 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5893ef3-1e6d-4fd6-960a-15ae4911ee0f admin admin] PATH_INFO: `/v3/projects/dc8795fbaacf4fd087d5e00884f5ec2d/users/c1b8616c6d5c4ab4b5c06f4e8fb2c6d6/roles/1928787bfcc745419829cd315900ac44` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:19.196722 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 881/1744] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:39:18 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:39:19.205568 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5893ef3-1e6d-4fd6-960a-15ae4911ee0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc8795fbaacf4fd087d5e00884f5ec2d, user_id=c1b8616c6d5c4ab4b5c06f4e8fb2c6d6, role_id=1928787bfcc745419829cd315900ac44)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:19.208812 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5893ef3-1e6d-4fd6-960a-15ae4911ee0f admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:19.233766 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 864/1745] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 22:39:19 2022] PUT /identity/v3/projects/dc8795fbaacf4fd087d5e00884f5ec2d/users/c1b8616c6d5c4ab4b5c06f4e8fb2c6d6/roles/1928787bfcc745419829cd315900ac44 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:39:19.239953 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf8ee8f-6eb8-41a8-96a2-91b5cf0288e9 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:19.240364 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf8ee8f-6eb8-41a8-96a2-91b5cf0288e9 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:19.240708 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf8ee8f-6eb8-41a8-96a2-91b5cf0288e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:19.266811 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae2c315-ee9f-46eb-b07f-7cf9da158dea None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:19.267050 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae2c315-ee9f-46eb-b07f-7cf9da158dea None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:19.267353 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae2c315-ee9f-46eb-b07f-7cf9da158dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:19.305563 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-ebf8ee8f-6eb8-41a8-96a2-91b5cf0288e9 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:39:19.308912 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-ebf8ee8f-6eb8-41a8-96a2-91b5cf0288e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:19.332253 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-fae2c315-ee9f-46eb-b07f-7cf9da158dea None None] MFA Rules not processed for user `542ea2e5a8114792836d0cdfd36b4c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:39:19.335794 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-fae2c315-ee9f-46eb-b07f-7cf9da158dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:19.430841 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 865/1746] 10.222.0.36 () {58 vars in 1009 bytes} [Fri Jun 24 22:39:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:39:19.483127 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 882/1747] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:39:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:39:19.499407 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae2c315-ee9f-46eb-b07f-7cf9da158dea None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:19.502372 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-fae2c315-ee9f-46eb-b07f-7cf9da158dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:19.565960 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf8ee8f-6eb8-41a8-96a2-91b5cf0288e9 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:19.568690 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-ebf8ee8f-6eb8-41a8-96a2-91b5cf0288e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:19.592317 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:39:19.620999 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae2c315-ee9f-46eb-b07f-7cf9da158dea None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:19.627391 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90381ff-549c-4dc8-a55c-58beb1548bf2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:19.628354 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90381ff-549c-4dc8-a55c-58beb1548bf2 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:19.628830 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90381ff-549c-4dc8-a55c-58beb1548bf2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:19.629306 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90381ff-549c-4dc8-a55c-58beb1548bf2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:19.640940 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90381ff-549c-4dc8-a55c-58beb1548bf2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:19.643237 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90381ff-549c-4dc8-a55c-58beb1548bf2 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:19.666929 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 866/1748] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:39:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:39:19.808140 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:39:19.826119 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf8ee8f-6eb8-41a8-96a2-91b5cf0288e9 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:19.838998 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4dfa1c-b1f1-4025-b6f5-5f45fd7469d0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b95846f7f2a453f85ddb41a5d3327f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:19.839945 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4dfa1c-b1f1-4025-b6f5-5f45fd7469d0 service swift] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:19.840411 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4dfa1c-b1f1-4025-b6f5-5f45fd7469d0 service swift] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:19.843313 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4dfa1c-b1f1-4025-b6f5-5f45fd7469d0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:19.872547 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4dfa1c-b1f1-4025-b6f5-5f45fd7469d0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:19.874291 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4dfa1c-b1f1-4025-b6f5-5f45fd7469d0 service swift] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:19.926215 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 883/1749] 10.222.0.36 () {60 vars in 1384 bytes} [Fri Jun 24 22:39:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 24 22:39:20.674138 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9023165b-b827-4477-862e-89bbba06b52c None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:20.674761 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9023165b-b827-4477-862e-89bbba06b52c None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:20.674761 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9023165b-b827-4477-862e-89bbba06b52c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:20.691448 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4dfa1c-b1f1-4025-b6f5-5f45fd7469d0 service swift] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:20.728348 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-9023165b-b827-4477-862e-89bbba06b52c None None] MFA Rules not processed for user `b78f1fcce4174d1a931453d930d306f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:39:20.743386 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-9023165b-b827-4477-862e-89bbba06b52c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:20.778345 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 867/1750] 10.222.0.13 () {58 vars in 1015 bytes} [Fri Jun 24 22:39:20 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:39:20.826558 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4dfa1c-b1f1-4025-b6f5-5f45fd7469d0 service swift] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:20.831561 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5573b6fb-74b7-4a56-9509-fae574789be2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a747e2a5684843a6ee9e3480badac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:20.832468 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5573b6fb-74b7-4a56-9509-fae574789be2 service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:20.832893 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5573b6fb-74b7-4a56-9509-fae574789be2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:20.833350 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5573b6fb-74b7-4a56-9509-fae574789be2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:20.838708 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-5573b6fb-74b7-4a56-9509-fae574789be2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:20.948340 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5573b6fb-74b7-4a56-9509-fae574789be2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:20.951623 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5573b6fb-74b7-4a56-9509-fae574789be2 service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:20.975207 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 884/1751] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:39:20 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:39:21.732491 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9023165b-b827-4477-862e-89bbba06b52c None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:21.736564 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-9023165b-b827-4477-862e-89bbba06b52c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:21.812227 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9023165b-b827-4477-862e-89bbba06b52c None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:21.845367 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea093122-0c26-49d6-8bbc-0ae79194175c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:21.847968 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea093122-0c26-49d6-8bbc-0ae79194175c service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:21.848431 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea093122-0c26-49d6-8bbc-0ae79194175c service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:21.848723 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea093122-0c26-49d6-8bbc-0ae79194175c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:21.893822 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea093122-0c26-49d6-8bbc-0ae79194175c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:21.908678 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea093122-0c26-49d6-8bbc-0ae79194175c service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:21.957181 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 868/1752] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:39:21 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:39:23.018648 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5573b6fb-74b7-4a56-9509-fae574789be2 service cinder] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:23.021003 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-5573b6fb-74b7-4a56-9509-fae574789be2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:23.068343 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5573b6fb-74b7-4a56-9509-fae574789be2 service cinder] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:23.081683 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bd52df-7394-401d-af82-5ee42b3f6b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:23.082858 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd52df-7394-401d-af82-5ee42b3f6b6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:23.083239 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd52df-7394-401d-af82-5ee42b3f6b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:23.098207 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd52df-7394-401d-af82-5ee42b3f6b6e admin admin] PATH_INFO: `/v3/users/fd75ebe602d043a7b4cec67a5e90e9b4` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:23.111311 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bd52df-7394-401d-af82-5ee42b3f6b6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd75ebe602d043a7b4cec67a5e90e9b4)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:23.113494 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bd52df-7394-401d-af82-5ee42b3f6b6e admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:23.217227 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-81bd52df-7394-401d-af82-5ee42b3f6b6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd75ebe602d043a7b4cec67a5e90e9b4'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:23.236477 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-81bd52df-7394-401d-af82-5ee42b3f6b6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd75ebe602d043a7b4cec67a5e90e9b4'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:23.239349 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-81bd52df-7394-401d-af82-5ee42b3f6b6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd75ebe602d043a7b4cec67a5e90e9b4'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:23.240208 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-81bd52df-7394-401d-af82-5ee42b3f6b6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd75ebe602d043a7b4cec67a5e90e9b4'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:23.260261 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-81bd52df-7394-401d-af82-5ee42b3f6b6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd75ebe602d043a7b4cec67a5e90e9b4'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:23.290314 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 885/1753] 10.222.0.36 () {58 vars in 1223 bytes} [Fri Jun 24 22:39:23 2022] DELETE /identity/v3/users/fd75ebe602d043a7b4cec67a5e90e9b4 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:39:23.296373 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbef0cf-8153-4940-9ae2-79dde3022011 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:23.297647 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbef0cf-8153-4940-9ae2-79dde3022011 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:23.298134 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbef0cf-8153-4940-9ae2-79dde3022011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:23.337354 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-adbef0cf-8153-4940-9ae2-79dde3022011 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:39:23.338989 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-adbef0cf-8153-4940-9ae2-79dde3022011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:23.503728 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 869/1754] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:39:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:39:23.528551 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bd52df-7394-401d-af82-5ee42b3f6b6e admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:23.535119 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-81bd52df-7394-401d-af82-5ee42b3f6b6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:23.554049 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb17e80-fd4c-4dff-aa1f-ae734639c201 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:23.554580 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb17e80-fd4c-4dff-aa1f-ae734639c201 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:23.555066 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb17e80-fd4c-4dff-aa1f-ae734639c201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:23.593096 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-cdb17e80-fd4c-4dff-aa1f-ae734639c201 None None] MFA Rules not processed for user `c1b8616c6d5c4ab4b5c06f4e8fb2c6d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:39:23.595426 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-cdb17e80-fd4c-4dff-aa1f-ae734639c201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:23.610583 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:39:23.768883 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bd52df-7394-401d-af82-5ee42b3f6b6e admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:23.778784 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 870/1755] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:39:23 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:39:23.786183 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb17e80-fd4c-4dff-aa1f-ae734639c201 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:23.791447 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c200a8-8fc9-4dd7-a603-dd14b6564dcb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:23.794435 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-cdb17e80-fd4c-4dff-aa1f-ae734639c201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:23.796491 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c200a8-8fc9-4dd7-a603-dd14b6564dcb service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:23.796781 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c200a8-8fc9-4dd7-a603-dd14b6564dcb service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:23.797228 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c200a8-8fc9-4dd7-a603-dd14b6564dcb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:23.820678 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c200a8-8fc9-4dd7-a603-dd14b6564dcb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:23.822163 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c200a8-8fc9-4dd7-a603-dd14b6564dcb service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:23.829561 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb17e80-fd4c-4dff-aa1f-ae734639c201 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:23.843284 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 886/1756] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:39:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:39:23.844821 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a6beb8-199a-4681-b885-466f41551ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:23.845572 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a6beb8-199a-4681-b885-466f41551ed7 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:23.845920 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a6beb8-199a-4681-b885-466f41551ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:23.846259 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a6beb8-199a-4681-b885-466f41551ed7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:23.847182 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a6beb8-199a-4681-b885-466f41551ed7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:23.860225 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a6beb8-199a-4681-b885-466f41551ed7 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:23.944097 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c200a8-8fc9-4dd7-a603-dd14b6564dcb service neutron] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:23.949997 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 871/1757] 10.222.0.36 () {60 vars in 1152 bytes} [Fri Jun 24 22:39:23 2022] POST /identity/v3/projects => generated 403 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:39:23.960701 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c200a8-8fc9-4dd7-a603-dd14b6564dcb service neutron] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:24.168089 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d7310b-b5b2-4b93-b23a-82f9e690fd23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:24.168792 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d7310b-b5b2-4b93-b23a-82f9e690fd23 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:24.169105 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d7310b-b5b2-4b93-b23a-82f9e690fd23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:24.169384 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d7310b-b5b2-4b93-b23a-82f9e690fd23 admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:24.170138 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d7310b-b5b2-4b93-b23a-82f9e690fd23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:24.172489 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d7310b-b5b2-4b93-b23a-82f9e690fd23 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:24.231784 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a6beb8-199a-4681-b885-466f41551ed7 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:24.239667 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 887/1758] 10.222.0.36 () {60 vars in 1143 bytes} [Fri Jun 24 22:39:23 2022] POST /identity/v3/users => generated 308 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:39:24.245554 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a6beb8-199a-4681-b885-466f41551ed7 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:24.252780 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afd5482-2027-45ff-94d3-5040def5ecec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:24.253541 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd5482-2027-45ff-94d3-5040def5ecec admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:24.253933 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd5482-2027-45ff-94d3-5040def5ecec admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:24.254319 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd5482-2027-45ff-94d3-5040def5ecec admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:24.255548 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afd5482-2027-45ff-94d3-5040def5ecec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:24.257477 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afd5482-2027-45ff-94d3-5040def5ecec admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:24.276819 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d7310b-b5b2-4b93-b23a-82f9e690fd23 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:24.278088 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 872/1759] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:39:24 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:39:24.288907 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d7310b-b5b2-4b93-b23a-82f9e690fd23 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:24.294145 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6453e927-df6d-4622-a688-83527e1a56d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:24.296159 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6453e927-df6d-4622-a688-83527e1a56d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:24.296159 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6453e927-df6d-4622-a688-83527e1a56d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:24.297055 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6453e927-df6d-4622-a688-83527e1a56d2 admin admin] PATH_INFO: `/v3/projects/62148d75863b4201b8f77915f4ed3cdb/users/e67933f1203f4a58b89af79ac8ff6d39/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:24.316909 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6453e927-df6d-4622-a688-83527e1a56d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62148d75863b4201b8f77915f4ed3cdb, user_id=e67933f1203f4a58b89af79ac8ff6d39, role_id=1a1c43cc97a0407eb7a7c7a1333a9d4a)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:24.320198 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6453e927-df6d-4622-a688-83527e1a56d2 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:24.334749 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 888/1760] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 22:39:24 2022] PUT /identity/v3/projects/62148d75863b4201b8f77915f4ed3cdb/users/e67933f1203f4a58b89af79ac8ff6d39/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:39:24.338882 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afd5482-2027-45ff-94d3-5040def5ecec admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:24.352512 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afd5482-2027-45ff-94d3-5040def5ecec admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:24.372092 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:39:24.415565 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1931a0f-2121-4fb3-9648-8ed007bdfc0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:24.416360 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1931a0f-2121-4fb3-9648-8ed007bdfc0c admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:24.416738 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1931a0f-2121-4fb3-9648-8ed007bdfc0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:24.417137 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1931a0f-2121-4fb3-9648-8ed007bdfc0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:24.424019 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1931a0f-2121-4fb3-9648-8ed007bdfc0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:24.425764 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1931a0f-2121-4fb3-9648-8ed007bdfc0c admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:24.457746 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 873/1761] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:39:24 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:39:24.459011 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6453e927-df6d-4622-a688-83527e1a56d2 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:24.469548 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6453e927-df6d-4622-a688-83527e1a56d2 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:24.475407 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6332a058-6a49-4103-b35a-db37bbafcb14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:24.476365 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6332a058-6a49-4103-b35a-db37bbafcb14 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:24.476657 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6332a058-6a49-4103-b35a-db37bbafcb14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:24.476940 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6332a058-6a49-4103-b35a-db37bbafcb14 admin admin] PATH_INFO: `/v3/projects/62148d75863b4201b8f77915f4ed3cdb/users/e67933f1203f4a58b89af79ac8ff6d39/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:24.478935 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6332a058-6a49-4103-b35a-db37bbafcb14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62148d75863b4201b8f77915f4ed3cdb, user_id=e67933f1203f4a58b89af79ac8ff6d39, role_id=1a1c43cc97a0407eb7a7c7a1333a9d4a)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:24.481683 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6332a058-6a49-4103-b35a-db37bbafcb14 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:24.492687 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 889/1762] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 22:39:24 2022] PUT /identity/v3/projects/62148d75863b4201b8f77915f4ed3cdb/users/e67933f1203f4a58b89af79ac8ff6d39/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:39:24.935601 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6432a0-3fed-43d1-89a4-b689fa02b6f9 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:24.937228 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6432a0-3fed-43d1-89a4-b689fa02b6f9 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:24.939947 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6432a0-3fed-43d1-89a4-b689fa02b6f9 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:24.941911 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 874/1763] 10.222.0.36 () {54 vars in 921 bytes} [Fri Jun 24 22:39:24 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:39:24.959670 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a687bcf-23aa-47c0-ab87-98262ce253ca None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:24.959960 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a687bcf-23aa-47c0-ab87-98262ce253ca None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:24.960238 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a687bcf-23aa-47c0-ab87-98262ce253ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:24.989053 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-6a687bcf-23aa-47c0-ab87-98262ce253ca None None] MFA Rules not processed for user `214d9071042c4bad886bf060a079b6e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:39:24.993827 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-6a687bcf-23aa-47c0-ab87-98262ce253ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:25.113625 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 890/1764] 10.222.0.36 () {58 vars in 1018 bytes} [Fri Jun 24 22:39:24 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:39:25.168324 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6432a0-3fed-43d1-89a4-b689fa02b6f9 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:25.172023 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-9c6432a0-3fed-43d1-89a4-b689fa02b6f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:25.190043 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a687bcf-23aa-47c0-ab87-98262ce253ca None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:25.192773 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-6a687bcf-23aa-47c0-ab87-98262ce253ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:25.208034 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:39:25.219315 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a687bcf-23aa-47c0-ab87-98262ce253ca None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:25.238689 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa18adb3-fdaa-4d08-be77-84fd56435fe6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214d9071042c4bad886bf060a079b6e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:25.240576 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18adb3-fdaa-4d08-be77-84fd56435fe6 service nova] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:25.240874 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18adb3-fdaa-4d08-be77-84fd56435fe6 service nova] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:25.241154 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18adb3-fdaa-4d08-be77-84fd56435fe6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:25.263999 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa18adb3-fdaa-4d08-be77-84fd56435fe6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:25.266315 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa18adb3-fdaa-4d08-be77-84fd56435fe6 service nova] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:25.280366 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 891/1765] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:39:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:39:25.311340 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a5a7d6-cd03-4670-887a-10a7f399a865 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:25.311731 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a5a7d6-cd03-4670-887a-10a7f399a865 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:25.311959 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a5a7d6-cd03-4670-887a-10a7f399a865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:25.344852 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-c0a5a7d6-cd03-4670-887a-10a7f399a865 None None] MFA Rules not processed for user `e67933f1203f4a58b89af79ac8ff6d39`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:39:25.345356 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6432a0-3fed-43d1-89a4-b689fa02b6f9 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:25.346679 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-c0a5a7d6-cd03-4670-887a-10a7f399a865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:25.356968 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b242b0e-b1a9-4118-821f-879fe11489bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:25.357870 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b242b0e-b1a9-4118-821f-879fe11489bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:25.358152 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b242b0e-b1a9-4118-821f-879fe11489bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:25.358812 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b242b0e-b1a9-4118-821f-879fe11489bf admin admin] PATH_INFO: `/v3/projects/8d9dc69886954d808518d0da82a04c78` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:25.361273 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b242b0e-b1a9-4118-821f-879fe11489bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d9dc69886954d808518d0da82a04c78)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:25.377779 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b242b0e-b1a9-4118-821f-879fe11489bf admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:25.473600 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-0b242b0e-b1a9-4118-821f-879fe11489bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d9dc69886954d808518d0da82a04c78', 'request_id': 'req-0b242b0e-b1a9-4118-821f-879fe11489bf'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:25.482276 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-0b242b0e-b1a9-4118-821f-879fe11489bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d9dc69886954d808518d0da82a04c78', 'request_id': 'req-0b242b0e-b1a9-4118-821f-879fe11489bf'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:25.491012 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 892/1766] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:39:25 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 22:39:25.496278 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-0b242b0e-b1a9-4118-821f-879fe11489bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d9dc69886954d808518d0da82a04c78', 'request_id': 'req-0b242b0e-b1a9-4118-821f-879fe11489bf'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:25.519965 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-0b242b0e-b1a9-4118-821f-879fe11489bf admin admin] The token cache is being invalidate because project 8d9dc69886954d808518d0da82a04c78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 22:39:25.520493 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-0b242b0e-b1a9-4118-821f-879fe11489bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:25.521919 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-0b242b0e-b1a9-4118-821f-879fe11489bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:25.523856 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 875/1767] 10.222.0.36 () {58 vars in 1232 bytes} [Fri Jun 24 22:39:25 2022] DELETE /identity/v3/projects/8d9dc69886954d808518d0da82a04c78 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:39:25.529044 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f481af75-3c35-437e-be22-6008bbcddb46 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:25.529379 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f481af75-3c35-437e-be22-6008bbcddb46 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:25.529640 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f481af75-3c35-437e-be22-6008bbcddb46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:25.549789 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-f481af75-3c35-437e-be22-6008bbcddb46 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:39:25.551881 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-f481af75-3c35-437e-be22-6008bbcddb46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:25.623320 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 893/1768] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:39:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:39:25.631710 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407ceab7-f1e0-4fd1-8d63-cac1381a587d None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:25.631995 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407ceab7-f1e0-4fd1-8d63-cac1381a587d None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:25.632271 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407ceab7-f1e0-4fd1-8d63-cac1381a587d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:25.665310 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-407ceab7-f1e0-4fd1-8d63-cac1381a587d None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:39:25.666482 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-407ceab7-f1e0-4fd1-8d63-cac1381a587d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:25.688915 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 876/1769] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:39:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:39:25.695842 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f481af75-3c35-437e-be22-6008bbcddb46 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:25.709134 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f481af75-3c35-437e-be22-6008bbcddb46 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:25.714897 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8937f829-922d-48a9-a5ff-3e4836193d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:25.715926 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937f829-922d-48a9-a5ff-3e4836193d1f admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:25.716284 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937f829-922d-48a9-a5ff-3e4836193d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:25.717058 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937f829-922d-48a9-a5ff-3e4836193d1f admin admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:25.718030 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8937f829-922d-48a9-a5ff-3e4836193d1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:39:25.718417 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8937f829-922d-48a9-a5ff-3e4836193d1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:25.720546 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8937f829-922d-48a9-a5ff-3e4836193d1f admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:25.737750 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 894/1770] 10.222.0.36 () {58 vars in 1152 bytes} [Fri Jun 24 22:39:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:39:25.741802 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407ceab7-f1e0-4fd1-8d63-cac1381a587d None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:25.754338 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407ceab7-f1e0-4fd1-8d63-cac1381a587d None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:25.760654 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958ca85e-2a2e-42d8-859b-372fdd0f4139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:25.761586 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958ca85e-2a2e-42d8-859b-372fdd0f4139 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:25.762097 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958ca85e-2a2e-42d8-859b-372fdd0f4139 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:25.762587 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958ca85e-2a2e-42d8-859b-372fdd0f4139 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:25.763594 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958ca85e-2a2e-42d8-859b-372fdd0f4139 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:25.766193 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958ca85e-2a2e-42d8-859b-372fdd0f4139 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:25.796396 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 877/1771] 10.222.0.36 () {60 vars in 1152 bytes} [Fri Jun 24 22:39:25 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:39:25.800697 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8937f829-922d-48a9-a5ff-3e4836193d1f admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:25.816065 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8937f829-922d-48a9-a5ff-3e4836193d1f admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:25.885486 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66228482-5c6b-46db-925e-912f3f145a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:25.886193 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66228482-5c6b-46db-925e-912f3f145a06 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:25.886497 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66228482-5c6b-46db-925e-912f3f145a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:25.886754 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66228482-5c6b-46db-925e-912f3f145a06 admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:25.887453 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66228482-5c6b-46db-925e-912f3f145a06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:25.889579 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66228482-5c6b-46db-925e-912f3f145a06 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:25.899180 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:39:25.922531 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 895/1772] 10.222.0.36 () {60 vars in 1143 bytes} [Fri Jun 24 22:39:25 2022] POST /identity/v3/users => generated 287 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:39:25.926725 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958ca85e-2a2e-42d8-859b-372fdd0f4139 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:25.941496 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958ca85e-2a2e-42d8-859b-372fdd0f4139 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:25.946187 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5971df2-80f4-4bc5-98e3-aeda75e062a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:25.947059 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5971df2-80f4-4bc5-98e3-aeda75e062a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:25.947515 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5971df2-80f4-4bc5-98e3-aeda75e062a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:25.947923 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5971df2-80f4-4bc5-98e3-aeda75e062a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:25.948791 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5971df2-80f4-4bc5-98e3-aeda75e062a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:25.950669 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5971df2-80f4-4bc5-98e3-aeda75e062a9 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:25.964275 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 878/1773] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:39:25 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:39:25.968451 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66228482-5c6b-46db-925e-912f3f145a06 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:25.981124 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66228482-5c6b-46db-925e-912f3f145a06 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:25.986418 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced2f13b-a0ae-4289-b238-c91d974b72e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:25.987151 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced2f13b-a0ae-4289-b238-c91d974b72e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:25.987463 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced2f13b-a0ae-4289-b238-c91d974b72e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:25.987737 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced2f13b-a0ae-4289-b238-c91d974b72e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:25.988461 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced2f13b-a0ae-4289-b238-c91d974b72e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:25.990111 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced2f13b-a0ae-4289-b238-c91d974b72e3 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:26.011711 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 896/1774] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:39:25 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:39:26.019193 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5971df2-80f4-4bc5-98e3-aeda75e062a9 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:26.029317 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5971df2-80f4-4bc5-98e3-aeda75e062a9 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:26.034017 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab8c16c-113b-48db-97d9-7036006fea77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:26.034922 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab8c16c-113b-48db-97d9-7036006fea77 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:26.035202 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab8c16c-113b-48db-97d9-7036006fea77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:26.035522 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab8c16c-113b-48db-97d9-7036006fea77 admin admin] PATH_INFO: `/v3/projects/9647a2c75f61480d8e1bc8aca876aded/users/30e106e5b6ec4c77ada9da1da9894a5f/roles/1928787bfcc745419829cd315900ac44` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:26.037851 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:39:26.052666 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab8c16c-113b-48db-97d9-7036006fea77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9647a2c75f61480d8e1bc8aca876aded, user_id=30e106e5b6ec4c77ada9da1da9894a5f, role_id=1928787bfcc745419829cd315900ac44)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:26.055278 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab8c16c-113b-48db-97d9-7036006fea77 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:26.069137 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 879/1775] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 22:39:26 2022] PUT /identity/v3/projects/9647a2c75f61480d8e1bc8aca876aded/users/30e106e5b6ec4c77ada9da1da9894a5f/roles/1928787bfcc745419829cd315900ac44 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:39:26.079658 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0172be24-8b85-4caa-b2cf-e669ccf4aed2 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:26.079951 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0172be24-8b85-4caa-b2cf-e669ccf4aed2 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:26.080224 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0172be24-8b85-4caa-b2cf-e669ccf4aed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:26.105996 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-0172be24-8b85-4caa-b2cf-e669ccf4aed2 None None] MFA Rules not processed for user `30e106e5b6ec4c77ada9da1da9894a5f`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:39:26.107450 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-0172be24-8b85-4caa-b2cf-e669ccf4aed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:26.176144 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 897/1776] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:39:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:39:26.180763 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab8c16c-113b-48db-97d9-7036006fea77 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:26.244549 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab8c16c-113b-48db-97d9-7036006fea77 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:26.250041 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e912c6c-5578-47a9-953d-2f5e60f83bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:26.250750 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e912c6c-5578-47a9-953d-2f5e60f83bb1 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:26.251011 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e912c6c-5578-47a9-953d-2f5e60f83bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:26.251296 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e912c6c-5578-47a9-953d-2f5e60f83bb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:26.252474 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e912c6c-5578-47a9-953d-2f5e60f83bb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:26.254540 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e912c6c-5578-47a9-953d-2f5e60f83bb1 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:26.283313 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 880/1777] 10.222.0.36 () {60 vars in 1152 bytes} [Fri Jun 24 22:39:26 2022] POST /identity/v3/projects => generated 373 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:39:26.287478 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0172be24-8b85-4caa-b2cf-e669ccf4aed2 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:26.299469 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0172be24-8b85-4caa-b2cf-e669ccf4aed2 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:26.360589 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6bfa2d-0d4b-420d-9c25-2c8aa8db8c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:26.361334 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6bfa2d-0d4b-420d-9c25-2c8aa8db8c77 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:26.361615 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6bfa2d-0d4b-420d-9c25-2c8aa8db8c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:26.361882 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6bfa2d-0d4b-420d-9c25-2c8aa8db8c77 admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:26.362590 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6bfa2d-0d4b-420d-9c25-2c8aa8db8c77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:26.365103 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6bfa2d-0d4b-420d-9c25-2c8aa8db8c77 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:26.376684 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e32c455-97b2-48a6-b188-c2e56ad41dbe None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:26.377248 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e32c455-97b2-48a6-b188-c2e56ad41dbe None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:26.377355 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e32c455-97b2-48a6-b188-c2e56ad41dbe None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:26.379544 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 881/1778] 10.222.0.36 () {54 vars in 921 bytes} [Fri Jun 24 22:39:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 22:39:26.388851 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d97d243-cd91-40b6-b2a3-c3c4e181bc3b None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:26.389229 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d97d243-cd91-40b6-b2a3-c3c4e181bc3b None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:26.392497 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d97d243-cd91-40b6-b2a3-c3c4e181bc3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:26.393437 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 898/1779] 10.222.0.36 () {60 vars in 1143 bytes} [Fri Jun 24 22:39:26 2022] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:39:26.393520 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6bfa2d-0d4b-420d-9c25-2c8aa8db8c77 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:26.405208 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6bfa2d-0d4b-420d-9c25-2c8aa8db8c77 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:26.412063 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a037d768-6e06-4d02-98a2-4052452c790a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:26.412799 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a037d768-6e06-4d02-98a2-4052452c790a admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:26.413122 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a037d768-6e06-4d02-98a2-4052452c790a admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:26.413446 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a037d768-6e06-4d02-98a2-4052452c790a admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:26.414277 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a037d768-6e06-4d02-98a2-4052452c790a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:26.415015 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-1d97d243-cd91-40b6-b2a3-c3c4e181bc3b None None] MFA Rules not processed for user `0233b357708643be94c0ade17ac1fb3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:39:26.415938 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a037d768-6e06-4d02-98a2-4052452c790a admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:26.416541 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-1d97d243-cd91-40b6-b2a3-c3c4e181bc3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:26.438761 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 899/1780] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:39:26 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 22:39:26.439276 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a037d768-6e06-4d02-98a2-4052452c790a admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:26.460839 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a037d768-6e06-4d02-98a2-4052452c790a admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:26.469029 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d2f75a-5c3c-4a76-a73c-c9d3bb690a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:26.469896 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d2f75a-5c3c-4a76-a73c-c9d3bb690a92 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:26.470319 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d2f75a-5c3c-4a76-a73c-c9d3bb690a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:26.470654 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d2f75a-5c3c-4a76-a73c-c9d3bb690a92 admin admin] PATH_INFO: `/v3/projects/a1c9dd6250b3459297dae887db068b22/users/89297268ba6842b9ac106b70cbc177e8/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:26.494617 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d2f75a-5c3c-4a76-a73c-c9d3bb690a92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1c9dd6250b3459297dae887db068b22, user_id=89297268ba6842b9ac106b70cbc177e8, role_id=1a1c43cc97a0407eb7a7c7a1333a9d4a)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:26.497530 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d2f75a-5c3c-4a76-a73c-c9d3bb690a92 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:26.514327 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 900/1781] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 22:39:26 2022] PUT /identity/v3/projects/a1c9dd6250b3459297dae887db068b22/users/89297268ba6842b9ac106b70cbc177e8/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:39:26.518899 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d2f75a-5c3c-4a76-a73c-c9d3bb690a92 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:26.547418 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 882/1782] 10.222.0.36 () {58 vars in 1018 bytes} [Fri Jun 24 22:39:26 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 22:39:26.548063 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:39:26.560007 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d97d243-cd91-40b6-b2a3-c3c4e181bc3b None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:26.561821 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-1d97d243-cd91-40b6-b2a3-c3c4e181bc3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:26.576275 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d97d243-cd91-40b6-b2a3-c3c4e181bc3b None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:26.585379 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d2f75a-5c3c-4a76-a73c-c9d3bb690a92 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:26.591537 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19745246-25ba-450d-9b07-4eb443a73230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:26.592231 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19745246-25ba-450d-9b07-4eb443a73230 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:26.592522 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19745246-25ba-450d-9b07-4eb443a73230 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:26.593331 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19745246-25ba-450d-9b07-4eb443a73230 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:26.594370 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19745246-25ba-450d-9b07-4eb443a73230 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:26.595873 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19745246-25ba-450d-9b07-4eb443a73230 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:26.609142 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 901/1783] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:39:26 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:39:26.613106 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19745246-25ba-450d-9b07-4eb443a73230 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:26.624880 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19745246-25ba-450d-9b07-4eb443a73230 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:26.630540 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f66af58-788e-4a19-b546-a3a19d446e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:26.631783 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f66af58-788e-4a19-b546-a3a19d446e2c admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:26.632156 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f66af58-788e-4a19-b546-a3a19d446e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:26.632342 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f66af58-788e-4a19-b546-a3a19d446e2c admin admin] PATH_INFO: `/v3/projects/a1c9dd6250b3459297dae887db068b22/users/89297268ba6842b9ac106b70cbc177e8/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:26.635326 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f66af58-788e-4a19-b546-a3a19d446e2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1c9dd6250b3459297dae887db068b22, user_id=89297268ba6842b9ac106b70cbc177e8, role_id=1a1c43cc97a0407eb7a7c7a1333a9d4a)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:26.638089 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f66af58-788e-4a19-b546-a3a19d446e2c admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:26.650335 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 902/1784] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 22:39:26 2022] PUT /identity/v3/projects/a1c9dd6250b3459297dae887db068b22/users/89297268ba6842b9ac106b70cbc177e8/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 22:39:26.661996 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4169aa6-df9f-4909-a8fc-f44de30ccd82 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:26.662370 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4169aa6-df9f-4909-a8fc-f44de30ccd82 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:26.662722 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4169aa6-df9f-4909-a8fc-f44de30ccd82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:26.663583 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f9aa65-2874-4191-9ab0-9296b1525db0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0233b357708643be94c0ade17ac1fb3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:26.664330 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f9aa65-2874-4191-9ab0-9296b1525db0 service placement] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:26.664778 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f9aa65-2874-4191-9ab0-9296b1525db0 service placement] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:26.665255 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f9aa65-2874-4191-9ab0-9296b1525db0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:26.671643 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:39:26.683023 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f9aa65-2874-4191-9ab0-9296b1525db0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:26.684712 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f9aa65-2874-4191-9ab0-9296b1525db0 service placement] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:26.697449 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-b4169aa6-df9f-4909-a8fc-f44de30ccd82 None None] MFA Rules not processed for user `89297268ba6842b9ac106b70cbc177e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:39:26.699319 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-b4169aa6-df9f-4909-a8fc-f44de30ccd82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:26.715148 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 883/1785] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:39:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 22:39:26.807598 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 903/1786] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:39:26 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 22:39:26.817811 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f9aa65-2874-4191-9ab0-9296b1525db0 service placement] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:26.819324 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-f4f9aa65-2874-4191-9ab0-9296b1525db0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:26.901496 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f9aa65-2874-4191-9ab0-9296b1525db0 service placement] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:26.957944 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43e2ae6-ed98-4cf0-982a-0fa0497db23f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a747e2a5684843a6ee9e3480badac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:26.958605 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43e2ae6-ed98-4cf0-982a-0fa0497db23f service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:26.958884 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43e2ae6-ed98-4cf0-982a-0fa0497db23f service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:26.959157 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43e2ae6-ed98-4cf0-982a-0fa0497db23f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:26.972534 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43e2ae6-ed98-4cf0-982a-0fa0497db23f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:26.979710 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43e2ae6-ed98-4cf0-982a-0fa0497db23f service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:26.993216 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 884/1787] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:39:26 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:39:27.089989 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4169aa6-df9f-4909-a8fc-f44de30ccd82 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:27.091649 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-b4169aa6-df9f-4909-a8fc-f44de30ccd82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:27.100339 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43e2ae6-ed98-4cf0-982a-0fa0497db23f service cinder] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:27.111075 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43e2ae6-ed98-4cf0-982a-0fa0497db23f service cinder] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:27.116594 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cb520c-fb64-4732-aea6-b685ad42380d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a747e2a5684843a6ee9e3480badac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:27.117940 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb520c-fb64-4732-aea6-b685ad42380d service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:27.118295 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb520c-fb64-4732-aea6-b685ad42380d service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:27.118646 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb520c-fb64-4732-aea6-b685ad42380d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:27.174866 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4169aa6-df9f-4909-a8fc-f44de30ccd82 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:27.180396 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bcf01a-d899-43e0-8669-9829954dc772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:27.181448 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bcf01a-d899-43e0-8669-9829954dc772 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:27.182033 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bcf01a-d899-43e0-8669-9829954dc772 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:27.182320 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bcf01a-d899-43e0-8669-9829954dc772 admin admin] PATH_INFO: `/v3/users/c1b8616c6d5c4ab4b5c06f4e8fb2c6d6` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:27.184219 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bcf01a-d899-43e0-8669-9829954dc772 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1b8616c6d5c4ab4b5c06f4e8fb2c6d6)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:27.185780 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bcf01a-d899-43e0-8669-9829954dc772 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:27.192105 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cb520c-fb64-4732-aea6-b685ad42380d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:27.193761 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cb520c-fb64-4732-aea6-b685ad42380d service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:27.203733 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 885/1788] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:39:27 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:39:27.240265 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:39:27.256574 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-27bcf01a-d899-43e0-8669-9829954dc772 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1b8616c6d5c4ab4b5c06f4e8fb2c6d6'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:27.266165 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-27bcf01a-d899-43e0-8669-9829954dc772 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1b8616c6d5c4ab4b5c06f4e8fb2c6d6'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:27.266892 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-27bcf01a-d899-43e0-8669-9829954dc772 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1b8616c6d5c4ab4b5c06f4e8fb2c6d6'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:27.267538 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-27bcf01a-d899-43e0-8669-9829954dc772 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1b8616c6d5c4ab4b5c06f4e8fb2c6d6'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:27.281651 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-27bcf01a-d899-43e0-8669-9829954dc772 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1b8616c6d5c4ab4b5c06f4e8fb2c6d6'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:27.297325 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 904/1789] 10.222.0.36 () {58 vars in 1223 bytes} [Fri Jun 24 22:39:27 2022] DELETE /identity/v3/users/c1b8616c6d5c4ab4b5c06f4e8fb2c6d6 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 22:39:27.473535 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cb520c-fb64-4732-aea6-b685ad42380d service cinder] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:27.489268 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cb520c-fb64-4732-aea6-b685ad42380d service cinder] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:27.549511 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:39:27.559405 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86204e1-6a69-4402-9173-02e378911176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:27.560284 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86204e1-6a69-4402-9173-02e378911176 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:27.560567 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86204e1-6a69-4402-9173-02e378911176 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:27.560839 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86204e1-6a69-4402-9173-02e378911176 admin admin] PATH_INFO: `/v3/projects/dc8795fbaacf4fd087d5e00884f5ec2d` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:27.562031 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86204e1-6a69-4402-9173-02e378911176 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc8795fbaacf4fd087d5e00884f5ec2d)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:27.563988 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86204e1-6a69-4402-9173-02e378911176 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:27.612475 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-f86204e1-6a69-4402-9173-02e378911176 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc8795fbaacf4fd087d5e00884f5ec2d', 'request_id': 'req-f86204e1-6a69-4402-9173-02e378911176'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:27.618726 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-f86204e1-6a69-4402-9173-02e378911176 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc8795fbaacf4fd087d5e00884f5ec2d', 'request_id': 'req-f86204e1-6a69-4402-9173-02e378911176'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:27.628586 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-f86204e1-6a69-4402-9173-02e378911176 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc8795fbaacf4fd087d5e00884f5ec2d', 'request_id': 'req-f86204e1-6a69-4402-9173-02e378911176'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:27.639225 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-f86204e1-6a69-4402-9173-02e378911176 admin admin] The token cache is being invalidate because project dc8795fbaacf4fd087d5e00884f5ec2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 22:39:27.639633 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-f86204e1-6a69-4402-9173-02e378911176 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:27.640341 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-f86204e1-6a69-4402-9173-02e378911176 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:27.642038 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 886/1790] 10.222.0.36 () {58 vars in 1232 bytes} [Fri Jun 24 22:39:27 2022] DELETE /identity/v3/projects/dc8795fbaacf4fd087d5e00884f5ec2d => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:39:27.646230 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bcf01a-d899-43e0-8669-9829954dc772 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:27.647897 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-27bcf01a-d899-43e0-8669-9829954dc772 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:27.661661 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bcf01a-d899-43e0-8669-9829954dc772 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:27.724211 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6223576a-c7df-4dde-8c6f-61e69e0fa462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:27.725101 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6223576a-c7df-4dde-8c6f-61e69e0fa462 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:27.725383 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6223576a-c7df-4dde-8c6f-61e69e0fa462 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:27.725655 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6223576a-c7df-4dde-8c6f-61e69e0fa462 admin admin] PATH_INFO: `/v3/users/e67933f1203f4a58b89af79ac8ff6d39` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:27.726931 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6223576a-c7df-4dde-8c6f-61e69e0fa462 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e67933f1203f4a58b89af79ac8ff6d39)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:27.728939 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6223576a-c7df-4dde-8c6f-61e69e0fa462 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:27.780653 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-6223576a-c7df-4dde-8c6f-61e69e0fa462 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e67933f1203f4a58b89af79ac8ff6d39'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:27.787507 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-6223576a-c7df-4dde-8c6f-61e69e0fa462 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e67933f1203f4a58b89af79ac8ff6d39'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:27.788180 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-6223576a-c7df-4dde-8c6f-61e69e0fa462 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e67933f1203f4a58b89af79ac8ff6d39'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:27.788799 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-6223576a-c7df-4dde-8c6f-61e69e0fa462 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e67933f1203f4a58b89af79ac8ff6d39'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:27.801062 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-6223576a-c7df-4dde-8c6f-61e69e0fa462 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e67933f1203f4a58b89af79ac8ff6d39'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:27.817225 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 905/1791] 10.222.0.36 () {58 vars in 1223 bytes} [Fri Jun 24 22:39:27 2022] DELETE /identity/v3/users/e67933f1203f4a58b89af79ac8ff6d39 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:39:28.026610 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86204e1-6a69-4402-9173-02e378911176 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:28.028311 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-f86204e1-6a69-4402-9173-02e378911176 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:28.058624 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86204e1-6a69-4402-9173-02e378911176 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:28.164801 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4307120-8a44-4558-b623-1f034fcb34e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:28.165839 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4307120-8a44-4558-b623-1f034fcb34e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:28.166154 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4307120-8a44-4558-b623-1f034fcb34e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:28.166431 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4307120-8a44-4558-b623-1f034fcb34e3 admin admin] PATH_INFO: `/v3/projects/62148d75863b4201b8f77915f4ed3cdb` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:28.167687 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4307120-8a44-4558-b623-1f034fcb34e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62148d75863b4201b8f77915f4ed3cdb)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:28.169818 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4307120-8a44-4558-b623-1f034fcb34e3 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:28.260915 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-a4307120-8a44-4558-b623-1f034fcb34e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62148d75863b4201b8f77915f4ed3cdb', 'request_id': 'req-a4307120-8a44-4558-b623-1f034fcb34e3'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:28.269132 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-a4307120-8a44-4558-b623-1f034fcb34e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62148d75863b4201b8f77915f4ed3cdb', 'request_id': 'req-a4307120-8a44-4558-b623-1f034fcb34e3'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:28.281577 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-a4307120-8a44-4558-b623-1f034fcb34e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62148d75863b4201b8f77915f4ed3cdb', 'request_id': 'req-a4307120-8a44-4558-b623-1f034fcb34e3'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:28.311547 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-a4307120-8a44-4558-b623-1f034fcb34e3 admin admin] The token cache is being invalidate because project 62148d75863b4201b8f77915f4ed3cdb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 22:39:28.311877 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-a4307120-8a44-4558-b623-1f034fcb34e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:28.312499 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-a4307120-8a44-4558-b623-1f034fcb34e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:28.319392 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 887/1792] 10.222.0.36 () {58 vars in 1232 bytes} [Fri Jun 24 22:39:28 2022] DELETE /identity/v3/projects/62148d75863b4201b8f77915f4ed3cdb => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:39:28.319869 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c99be6-77c6-48f8-a3a0-7e5d9b6695fe None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:28.320365 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c99be6-77c6-48f8-a3a0-7e5d9b6695fe None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:28.320445 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c99be6-77c6-48f8-a3a0-7e5d9b6695fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:28.355652 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-e0c99be6-77c6-48f8-a3a0-7e5d9b6695fe None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:39:28.357231 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-e0c99be6-77c6-48f8-a3a0-7e5d9b6695fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:28.411639 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:39:28.466581 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 906/1793] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:39:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:39:28.474294 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0826d2b8-cd83-427e-b91a-df44a6ae9cd2 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:28.475203 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0826d2b8-cd83-427e-b91a-df44a6ae9cd2 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:28.475512 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0826d2b8-cd83-427e-b91a-df44a6ae9cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:28.503543 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-0826d2b8-cd83-427e-b91a-df44a6ae9cd2 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:39:28.505218 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-0826d2b8-cd83-427e-b91a-df44a6ae9cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:28.516364 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 888/1794] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:39:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:39:28.520833 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c99be6-77c6-48f8-a3a0-7e5d9b6695fe None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:28.533472 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c99be6-77c6-48f8-a3a0-7e5d9b6695fe None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:28.540459 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c09251f-f703-4bfa-abe0-db2fa20f71ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:28.542253 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c09251f-f703-4bfa-abe0-db2fa20f71ab admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:28.542542 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c09251f-f703-4bfa-abe0-db2fa20f71ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:28.543939 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c09251f-f703-4bfa-abe0-db2fa20f71ab admin admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:28.544636 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c09251f-f703-4bfa-abe0-db2fa20f71ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:39:28.544947 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c09251f-f703-4bfa-abe0-db2fa20f71ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:28.552234 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c09251f-f703-4bfa-abe0-db2fa20f71ab admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:28.592048 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 907/1795] 10.222.0.36 () {58 vars in 1152 bytes} [Fri Jun 24 22:39:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:39:28.597966 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0826d2b8-cd83-427e-b91a-df44a6ae9cd2 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:28.605559 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:39:28.613179 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0826d2b8-cd83-427e-b91a-df44a6ae9cd2 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:28.626040 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf7a96a-85e2-4b58-ac27-74becd20628d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:28.626959 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf7a96a-85e2-4b58-ac27-74becd20628d admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:28.627262 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf7a96a-85e2-4b58-ac27-74becd20628d admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:28.627573 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf7a96a-85e2-4b58-ac27-74becd20628d admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:28.635785 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf7a96a-85e2-4b58-ac27-74becd20628d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:28.638159 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf7a96a-85e2-4b58-ac27-74becd20628d admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:28.693948 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 889/1796] 10.222.0.36 () {60 vars in 1152 bytes} [Fri Jun 24 22:39:28 2022] POST /identity/v3/projects => generated 381 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:39:28.695103 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c09251f-f703-4bfa-abe0-db2fa20f71ab admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:28.714813 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c09251f-f703-4bfa-abe0-db2fa20f71ab admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:28.789521 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cd66e6-32cc-4624-b316-cbeec897306e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:28.790233 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd66e6-32cc-4624-b316-cbeec897306e admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:28.790511 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd66e6-32cc-4624-b316-cbeec897306e admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:28.790907 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd66e6-32cc-4624-b316-cbeec897306e admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:28.791620 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cd66e6-32cc-4624-b316-cbeec897306e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:28.795737 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cd66e6-32cc-4624-b316-cbeec897306e admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:28.828670 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 908/1797] 10.222.0.36 () {60 vars in 1143 bytes} [Fri Jun 24 22:39:28 2022] POST /identity/v3/users => generated 291 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:39:28.833575 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf7a96a-85e2-4b58-ac27-74becd20628d admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:28.852160 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf7a96a-85e2-4b58-ac27-74becd20628d admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:28.858274 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a6960d-eade-4f0c-aacf-d68287338a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:28.859142 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a6960d-eade-4f0c-aacf-d68287338a76 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:28.859766 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a6960d-eade-4f0c-aacf-d68287338a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:28.860051 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a6960d-eade-4f0c-aacf-d68287338a76 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:28.861178 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a6960d-eade-4f0c-aacf-d68287338a76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:28.863025 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a6960d-eade-4f0c-aacf-d68287338a76 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:28.890950 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 890/1798] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:39:28 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:39:28.892673 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cd66e6-32cc-4624-b316-cbeec897306e admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:28.904189 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cd66e6-32cc-4624-b316-cbeec897306e admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:28.911091 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5f3f39-9940-4b15-8e33-cb3f3e7d3e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:28.912062 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f3f39-9940-4b15-8e33-cb3f3e7d3e33 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:28.912372 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f3f39-9940-4b15-8e33-cb3f3e7d3e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:28.913439 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f3f39-9940-4b15-8e33-cb3f3e7d3e33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:28.913696 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5f3f39-9940-4b15-8e33-cb3f3e7d3e33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:28.915764 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5f3f39-9940-4b15-8e33-cb3f3e7d3e33 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:28.935999 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 909/1799] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:39:28 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:39:28.937316 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a6960d-eade-4f0c-aacf-d68287338a76 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:28.954701 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a6960d-eade-4f0c-aacf-d68287338a76 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:28.963498 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0c34a9-bd35-49a0-b8a2-3d754e7a1a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:28.964729 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0c34a9-bd35-49a0-b8a2-3d754e7a1a0e admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:28.965000 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0c34a9-bd35-49a0-b8a2-3d754e7a1a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:28.965387 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0c34a9-bd35-49a0-b8a2-3d754e7a1a0e admin admin] PATH_INFO: `/v3/projects/7f5ac4fd414a4b44932eb121f57200d2/users/7a3d4781fbe849358a09946e3cd3de9e/roles/1928787bfcc745419829cd315900ac44` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:28.994757 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0c34a9-bd35-49a0-b8a2-3d754e7a1a0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f5ac4fd414a4b44932eb121f57200d2, user_id=7a3d4781fbe849358a09946e3cd3de9e, role_id=1928787bfcc745419829cd315900ac44)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:28.998098 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0c34a9-bd35-49a0-b8a2-3d754e7a1a0e admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:29.045901 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 891/1800] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 22:39:28 2022] PUT /identity/v3/projects/7f5ac4fd414a4b44932eb121f57200d2/users/7a3d4781fbe849358a09946e3cd3de9e/roles/1928787bfcc745419829cd315900ac44 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 22:39:29.056465 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17540021-3aa5-43b4-8d15-2001cc9ccc80 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:29.056944 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17540021-3aa5-43b4-8d15-2001cc9ccc80 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:29.057068 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17540021-3aa5-43b4-8d15-2001cc9ccc80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:29.108633 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-17540021-3aa5-43b4-8d15-2001cc9ccc80 None None] MFA Rules not processed for user `7a3d4781fbe849358a09946e3cd3de9e`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:39:29.110114 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-17540021-3aa5-43b4-8d15-2001cc9ccc80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:29.246813 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 910/1801] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:39:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:39:29.252213 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0c34a9-bd35-49a0-b8a2-3d754e7a1a0e admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:29.341718 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0c34a9-bd35-49a0-b8a2-3d754e7a1a0e admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:29.351770 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4db96f0-04c2-4496-86ce-1bc1af41486e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:29.352586 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4db96f0-04c2-4496-86ce-1bc1af41486e admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:29.352912 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4db96f0-04c2-4496-86ce-1bc1af41486e admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:29.353241 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4db96f0-04c2-4496-86ce-1bc1af41486e admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:29.354031 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4db96f0-04c2-4496-86ce-1bc1af41486e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:29.355999 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4db96f0-04c2-4496-86ce-1bc1af41486e admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:29.398185 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 892/1802] 10.222.0.36 () {60 vars in 1152 bytes} [Fri Jun 24 22:39:29 2022] POST /identity/v3/projects => generated 381 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:39:29.402623 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17540021-3aa5-43b4-8d15-2001cc9ccc80 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:29.414801 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17540021-3aa5-43b4-8d15-2001cc9ccc80 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:29.447067 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:39:29.494941 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89437efd-e78e-4a51-a920-efed113cd48b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:29.495676 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89437efd-e78e-4a51-a920-efed113cd48b admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:29.495960 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89437efd-e78e-4a51-a920-efed113cd48b admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:29.496243 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89437efd-e78e-4a51-a920-efed113cd48b admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:29.496943 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89437efd-e78e-4a51-a920-efed113cd48b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:29.499086 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89437efd-e78e-4a51-a920-efed113cd48b admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:29.526055 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 911/1803] 10.222.0.36 () {60 vars in 1143 bytes} [Fri Jun 24 22:39:29 2022] POST /identity/v3/users => generated 297 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:39:29.527400 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4db96f0-04c2-4496-86ce-1bc1af41486e admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:29.540357 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4db96f0-04c2-4496-86ce-1bc1af41486e admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:29.549471 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c1b3f9-63b8-45a6-a031-a73d93f0d670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:29.550172 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c1b3f9-63b8-45a6-a031-a73d93f0d670 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:29.550455 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c1b3f9-63b8-45a6-a031-a73d93f0d670 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:29.550728 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c1b3f9-63b8-45a6-a031-a73d93f0d670 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:29.551594 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c1b3f9-63b8-45a6-a031-a73d93f0d670 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:29.553236 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c1b3f9-63b8-45a6-a031-a73d93f0d670 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:29.567810 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 893/1804] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:39:29 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 22:39:29.572821 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89437efd-e78e-4a51-a920-efed113cd48b admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:29.584546 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89437efd-e78e-4a51-a920-efed113cd48b admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:29.598750 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eb0d31-1edc-40f2-b3a0-a3a41786de01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:29.599914 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb0d31-1edc-40f2-b3a0-a3a41786de01 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:29.600357 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb0d31-1edc-40f2-b3a0-a3a41786de01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:29.600781 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb0d31-1edc-40f2-b3a0-a3a41786de01 admin admin] PATH_INFO: `/v3/projects/d36edfe0da91475d9add07e4700f02fb/users/5c020f1aeec64860801f472355e69f72/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:29.655476 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eb0d31-1edc-40f2-b3a0-a3a41786de01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d36edfe0da91475d9add07e4700f02fb, user_id=5c020f1aeec64860801f472355e69f72, role_id=1a1c43cc97a0407eb7a7c7a1333a9d4a)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:29.664220 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eb0d31-1edc-40f2-b3a0-a3a41786de01 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:29.717001 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 912/1805] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 22:39:29 2022] PUT /identity/v3/projects/d36edfe0da91475d9add07e4700f02fb/users/5c020f1aeec64860801f472355e69f72/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:39:29.729593 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c1b3f9-63b8-45a6-a031-a73d93f0d670 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:29.751043 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c1b3f9-63b8-45a6-a031-a73d93f0d670 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:29.835803 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6586818e-709e-439e-8b10-458c7ed49e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:29.836559 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6586818e-709e-439e-8b10-458c7ed49e4a admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:29.836848 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6586818e-709e-439e-8b10-458c7ed49e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:29.837120 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6586818e-709e-439e-8b10-458c7ed49e4a admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:29.837915 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6586818e-709e-439e-8b10-458c7ed49e4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:29.839891 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6586818e-709e-439e-8b10-458c7ed49e4a admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:29.859825 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 894/1806] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:39:29 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:39:29.863712 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eb0d31-1edc-40f2-b3a0-a3a41786de01 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:29.891706 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eb0d31-1edc-40f2-b3a0-a3a41786de01 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:29.901607 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb8edc1-67dc-49b6-90cf-c94d4e74cd1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:29.902713 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb8edc1-67dc-49b6-90cf-c94d4e74cd1f admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:29.903203 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb8edc1-67dc-49b6-90cf-c94d4e74cd1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:29.903645 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb8edc1-67dc-49b6-90cf-c94d4e74cd1f admin admin] PATH_INFO: `/v3/projects/d36edfe0da91475d9add07e4700f02fb/users/5c020f1aeec64860801f472355e69f72/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:29.906384 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb8edc1-67dc-49b6-90cf-c94d4e74cd1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d36edfe0da91475d9add07e4700f02fb, user_id=5c020f1aeec64860801f472355e69f72, role_id=1a1c43cc97a0407eb7a7c7a1333a9d4a)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:29.909846 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb8edc1-67dc-49b6-90cf-c94d4e74cd1f admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:29.939160 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 913/1807] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 22:39:29 2022] PUT /identity/v3/projects/d36edfe0da91475d9add07e4700f02fb/users/5c020f1aeec64860801f472355e69f72/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:39:29.950944 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4758df9-d87f-4490-852c-50ec5750705f None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:29.951358 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4758df9-d87f-4490-852c-50ec5750705f None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:29.951538 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4758df9-d87f-4490-852c-50ec5750705f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:30.001884 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-e4758df9-d87f-4490-852c-50ec5750705f None None] MFA Rules not processed for user `5c020f1aeec64860801f472355e69f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:39:30.005220 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-e4758df9-d87f-4490-852c-50ec5750705f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:30.029827 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:39:30.180017 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 895/1808] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:39:29 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:39:30.195213 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb8edc1-67dc-49b6-90cf-c94d4e74cd1f admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:30.197266 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-abb8edc1-67dc-49b6-90cf-c94d4e74cd1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:30.310586 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb8edc1-67dc-49b6-90cf-c94d4e74cd1f admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:30.318525 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9def5b0-de77-4870-964b-c701bfb29312 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a747e2a5684843a6ee9e3480badac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:30.319652 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9def5b0-de77-4870-964b-c701bfb29312 service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:30.320237 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9def5b0-de77-4870-964b-c701bfb29312 service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:30.320967 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9def5b0-de77-4870-964b-c701bfb29312 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:30.339965 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9def5b0-de77-4870-964b-c701bfb29312 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:30.342393 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9def5b0-de77-4870-964b-c701bfb29312 service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:30.359468 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 914/1809] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:39:30 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:39:30.501687 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4758df9-d87f-4490-852c-50ec5750705f None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:30.514935 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4758df9-d87f-4490-852c-50ec5750705f None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:30.519598 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc446fe-b256-4cdc-9a7f-cf4f1c532ea1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a747e2a5684843a6ee9e3480badac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:30.520456 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc446fe-b256-4cdc-9a7f-cf4f1c532ea1 service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:30.520785 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc446fe-b256-4cdc-9a7f-cf4f1c532ea1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:30.521106 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc446fe-b256-4cdc-9a7f-cf4f1c532ea1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:30.596269 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc446fe-b256-4cdc-9a7f-cf4f1c532ea1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:30.597829 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc446fe-b256-4cdc-9a7f-cf4f1c532ea1 service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:30.621377 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 896/1810] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:39:30 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:39:31.487779 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9def5b0-de77-4870-964b-c701bfb29312 service cinder] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:31.496449 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9def5b0-de77-4870-964b-c701bfb29312 service cinder] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:31.500411 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a34a1be-7b0f-48f0-8b50-7956d2719f74 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a747e2a5684843a6ee9e3480badac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:31.501073 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a34a1be-7b0f-48f0-8b50-7956d2719f74 service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:31.501731 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a34a1be-7b0f-48f0-8b50-7956d2719f74 service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:31.502016 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a34a1be-7b0f-48f0-8b50-7956d2719f74 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:31.503843 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-1a34a1be-7b0f-48f0-8b50-7956d2719f74 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:31.570774 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a34a1be-7b0f-48f0-8b50-7956d2719f74 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:31.572279 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a34a1be-7b0f-48f0-8b50-7956d2719f74 service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:31.581678 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 915/1811] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:39:31 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:39:38.950283 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee4412f-3afd-4ba4-8f83-a45722b9cd72 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:38.950831 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee4412f-3afd-4ba4-8f83-a45722b9cd72 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:38.951081 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee4412f-3afd-4ba4-8f83-a45722b9cd72 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:38.952561 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 897/1812] 10.222.0.36 () {54 vars in 921 bytes} [Fri Jun 24 22:39:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:39:38.975863 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7271c5ff-272a-4aa9-8159-1fdffde1ed80 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:38.977991 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7271c5ff-272a-4aa9-8159-1fdffde1ed80 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:38.979986 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7271c5ff-272a-4aa9-8159-1fdffde1ed80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:39.011678 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-7271c5ff-272a-4aa9-8159-1fdffde1ed80 None None] MFA Rules not processed for user `214d9071042c4bad886bf060a079b6e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:39:39.013334 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-7271c5ff-272a-4aa9-8159-1fdffde1ed80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:39.058392 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:39:39.160869 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 916/1813] 10.222.0.36 () {58 vars in 1018 bytes} [Fri Jun 24 22:39:38 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:39:39.279665 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee4412f-3afd-4ba4-8f83-a45722b9cd72 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:39.281402 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-0ee4412f-3afd-4ba4-8f83-a45722b9cd72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:39.306216 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee4412f-3afd-4ba4-8f83-a45722b9cd72 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:39.322510 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd57b787-d344-46ff-aff2-bc4be506c67e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214d9071042c4bad886bf060a079b6e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:39.323985 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd57b787-d344-46ff-aff2-bc4be506c67e service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:39.324522 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd57b787-d344-46ff-aff2-bc4be506c67e service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:39.325012 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd57b787-d344-46ff-aff2-bc4be506c67e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:39.341005 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd57b787-d344-46ff-aff2-bc4be506c67e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:39.342797 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd57b787-d344-46ff-aff2-bc4be506c67e service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:39.359445 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 898/1814] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:39:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:39:44.717799 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7271c5ff-272a-4aa9-8159-1fdffde1ed80 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:44.719328 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-7271c5ff-272a-4aa9-8159-1fdffde1ed80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:44.791487 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7271c5ff-272a-4aa9-8159-1fdffde1ed80 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:44.797137 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d915c9d6-179a-4df9-bf08-67ef5b381024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:44.798132 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d915c9d6-179a-4df9-bf08-67ef5b381024 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:44.798595 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d915c9d6-179a-4df9-bf08-67ef5b381024 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:44.798871 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d915c9d6-179a-4df9-bf08-67ef5b381024 admin admin] PATH_INFO: `/v3/users/3ee44cd19957408fbd39eec0ad2711fc` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:44.800160 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d915c9d6-179a-4df9-bf08-67ef5b381024 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ee44cd19957408fbd39eec0ad2711fc)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:44.802117 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d915c9d6-179a-4df9-bf08-67ef5b381024 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:44.856718 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-d915c9d6-179a-4df9-bf08-67ef5b381024 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ee44cd19957408fbd39eec0ad2711fc'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:44.863884 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-d915c9d6-179a-4df9-bf08-67ef5b381024 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ee44cd19957408fbd39eec0ad2711fc'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:44.864727 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-d915c9d6-179a-4df9-bf08-67ef5b381024 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ee44cd19957408fbd39eec0ad2711fc'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:44.865412 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-d915c9d6-179a-4df9-bf08-67ef5b381024 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ee44cd19957408fbd39eec0ad2711fc'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:44.878738 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-d915c9d6-179a-4df9-bf08-67ef5b381024 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ee44cd19957408fbd39eec0ad2711fc'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:44.895498 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 917/1815] 10.222.0.36 () {58 vars in 1223 bytes} [Fri Jun 24 22:39:44 2022] DELETE /identity/v3/users/3ee44cd19957408fbd39eec0ad2711fc => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:39:44.900439 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e615a46-1562-4eaa-8407-0dfda178038a None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:44.901553 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e615a46-1562-4eaa-8407-0dfda178038a None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:44.901767 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e615a46-1562-4eaa-8407-0dfda178038a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:44.923499 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-3e615a46-1562-4eaa-8407-0dfda178038a None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:39:44.923499 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-3e615a46-1562-4eaa-8407-0dfda178038a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:45.002584 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 899/1816] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:39:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:39:45.012127 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d915c9d6-179a-4df9-bf08-67ef5b381024 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:45.013628 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-d915c9d6-179a-4df9-bf08-67ef5b381024 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:45.068445 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:39:45.097669 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d915c9d6-179a-4df9-bf08-67ef5b381024 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:45.105585 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b591e36-9eed-4911-8a61-58067fc335b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:45.106252 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b591e36-9eed-4911-8a61-58067fc335b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:45.106532 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b591e36-9eed-4911-8a61-58067fc335b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:45.106803 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b591e36-9eed-4911-8a61-58067fc335b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:45.117099 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b591e36-9eed-4911-8a61-58067fc335b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:45.119959 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b591e36-9eed-4911-8a61-58067fc335b4 service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:45.132577 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 918/1817] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:39:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:39:45.445599 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e615a46-1562-4eaa-8407-0dfda178038a None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:45.447305 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-3e615a46-1562-4eaa-8407-0dfda178038a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:45.464158 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e615a46-1562-4eaa-8407-0dfda178038a None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:45.470931 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f7bbfd-f165-49d9-8221-c40614371f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:45.472447 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7bbfd-f165-49d9-8221-c40614371f23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:45.472731 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7bbfd-f165-49d9-8221-c40614371f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:45.473014 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7bbfd-f165-49d9-8221-c40614371f23 admin admin] PATH_INFO: `/v3/projects/4b2c6320838e4d61a62c2e3aa0e33218` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:45.474529 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f7bbfd-f165-49d9-8221-c40614371f23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b2c6320838e4d61a62c2e3aa0e33218)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:45.476521 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f7bbfd-f165-49d9-8221-c40614371f23 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:45.504738 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:39:45.531897 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-20f7bbfd-f165-49d9-8221-c40614371f23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b2c6320838e4d61a62c2e3aa0e33218', 'request_id': 'req-20f7bbfd-f165-49d9-8221-c40614371f23'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:45.538988 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-20f7bbfd-f165-49d9-8221-c40614371f23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b2c6320838e4d61a62c2e3aa0e33218', 'request_id': 'req-20f7bbfd-f165-49d9-8221-c40614371f23'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:45.548568 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-20f7bbfd-f165-49d9-8221-c40614371f23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b2c6320838e4d61a62c2e3aa0e33218', 'request_id': 'req-20f7bbfd-f165-49d9-8221-c40614371f23'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:45.559501 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-20f7bbfd-f165-49d9-8221-c40614371f23 admin admin] The token cache is being invalidate because project 4b2c6320838e4d61a62c2e3aa0e33218 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 22:39:45.559791 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-20f7bbfd-f165-49d9-8221-c40614371f23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:45.560451 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-20f7bbfd-f165-49d9-8221-c40614371f23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:45.562176 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 900/1818] 10.222.0.36 () {58 vars in 1232 bytes} [Fri Jun 24 22:39:45 2022] DELETE /identity/v3/projects/4b2c6320838e4d61a62c2e3aa0e33218 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:39:45.566340 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b591e36-9eed-4911-8a61-58067fc335b4 service neutron] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:45.577432 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b591e36-9eed-4911-8a61-58067fc335b4 service neutron] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:45.638631 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182f1b6f-c53a-466a-95c5-880a02c9e13a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:45.639561 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182f1b6f-c53a-466a-95c5-880a02c9e13a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:45.639845 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182f1b6f-c53a-466a-95c5-880a02c9e13a admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:45.640120 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182f1b6f-c53a-466a-95c5-880a02c9e13a admin admin] PATH_INFO: `/v3/users/36e1827b2d6a4b129fc78104b4e65cdf` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:45.641585 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182f1b6f-c53a-466a-95c5-880a02c9e13a admin admin] RBAC: Authorizing `identity:delete_user(user_id=36e1827b2d6a4b129fc78104b4e65cdf)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:45.644071 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182f1b6f-c53a-466a-95c5-880a02c9e13a admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:45.696319 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-182f1b6f-c53a-466a-95c5-880a02c9e13a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36e1827b2d6a4b129fc78104b4e65cdf'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:45.703950 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-182f1b6f-c53a-466a-95c5-880a02c9e13a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36e1827b2d6a4b129fc78104b4e65cdf'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:45.704887 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-182f1b6f-c53a-466a-95c5-880a02c9e13a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36e1827b2d6a4b129fc78104b4e65cdf'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:45.705772 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-182f1b6f-c53a-466a-95c5-880a02c9e13a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36e1827b2d6a4b129fc78104b4e65cdf'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:45.719377 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-182f1b6f-c53a-466a-95c5-880a02c9e13a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36e1827b2d6a4b129fc78104b4e65cdf'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:45.738938 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 919/1819] 10.222.0.36 () {58 vars in 1223 bytes} [Fri Jun 24 22:39:45 2022] DELETE /identity/v3/users/36e1827b2d6a4b129fc78104b4e65cdf => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:39:46.034954 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f7bbfd-f165-49d9-8221-c40614371f23 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:46.036528 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-20f7bbfd-f165-49d9-8221-c40614371f23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:46.052786 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f7bbfd-f165-49d9-8221-c40614371f23 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:46.112202 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4936ac5f-1906-41b4-88f1-c29baf7b48fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:46.113092 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4936ac5f-1906-41b4-88f1-c29baf7b48fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:46.113390 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4936ac5f-1906-41b4-88f1-c29baf7b48fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:46.113661 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4936ac5f-1906-41b4-88f1-c29baf7b48fa admin admin] PATH_INFO: `/v3/projects/b63f844db8414657a23c2781c18e6aab` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:46.114977 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4936ac5f-1906-41b4-88f1-c29baf7b48fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=b63f844db8414657a23c2781c18e6aab)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:46.116973 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4936ac5f-1906-41b4-88f1-c29baf7b48fa admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:46.167155 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-4936ac5f-1906-41b4-88f1-c29baf7b48fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b63f844db8414657a23c2781c18e6aab', 'request_id': 'req-4936ac5f-1906-41b4-88f1-c29baf7b48fa'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:46.174371 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-4936ac5f-1906-41b4-88f1-c29baf7b48fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b63f844db8414657a23c2781c18e6aab', 'request_id': 'req-4936ac5f-1906-41b4-88f1-c29baf7b48fa'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:46.183044 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-4936ac5f-1906-41b4-88f1-c29baf7b48fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b63f844db8414657a23c2781c18e6aab', 'request_id': 'req-4936ac5f-1906-41b4-88f1-c29baf7b48fa'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:46.194585 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-4936ac5f-1906-41b4-88f1-c29baf7b48fa admin admin] The token cache is being invalidate because project b63f844db8414657a23c2781c18e6aab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 22:39:46.194883 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-4936ac5f-1906-41b4-88f1-c29baf7b48fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:46.195566 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-4936ac5f-1906-41b4-88f1-c29baf7b48fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:46.197149 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 901/1820] 10.222.0.36 () {58 vars in 1232 bytes} [Fri Jun 24 22:39:46 2022] DELETE /identity/v3/projects/b63f844db8414657a23c2781c18e6aab => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:39:46.201440 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182f1b6f-c53a-466a-95c5-880a02c9e13a admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:46.202896 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-182f1b6f-c53a-466a-95c5-880a02c9e13a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:46.216751 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182f1b6f-c53a-466a-95c5-880a02c9e13a admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:46.276561 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:39:46.289181 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c5d1c4-1124-4f5c-a211-cc3a414ce19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:46.290277 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c5d1c4-1124-4f5c-a211-cc3a414ce19a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:46.290730 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c5d1c4-1124-4f5c-a211-cc3a414ce19a admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:46.291213 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c5d1c4-1124-4f5c-a211-cc3a414ce19a admin admin] PATH_INFO: `/v3/users/6b14bf488f364e34b09eaa99d7bb0d21` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:46.292498 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c5d1c4-1124-4f5c-a211-cc3a414ce19a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b14bf488f364e34b09eaa99d7bb0d21)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:46.294453 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c5d1c4-1124-4f5c-a211-cc3a414ce19a admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:46.349672 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-e1c5d1c4-1124-4f5c-a211-cc3a414ce19a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b14bf488f364e34b09eaa99d7bb0d21'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:46.356761 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-e1c5d1c4-1124-4f5c-a211-cc3a414ce19a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b14bf488f364e34b09eaa99d7bb0d21'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:46.357433 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-e1c5d1c4-1124-4f5c-a211-cc3a414ce19a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b14bf488f364e34b09eaa99d7bb0d21'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:46.358036 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-e1c5d1c4-1124-4f5c-a211-cc3a414ce19a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b14bf488f364e34b09eaa99d7bb0d21'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:46.371821 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-e1c5d1c4-1124-4f5c-a211-cc3a414ce19a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b14bf488f364e34b09eaa99d7bb0d21'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:46.387175 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 920/1821] 10.222.0.36 () {58 vars in 1223 bytes} [Fri Jun 24 22:39:46 2022] DELETE /identity/v3/users/6b14bf488f364e34b09eaa99d7bb0d21 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:39:46.760230 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4936ac5f-1906-41b4-88f1-c29baf7b48fa admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:46.762168 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-4936ac5f-1906-41b4-88f1-c29baf7b48fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:46.775912 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4936ac5f-1906-41b4-88f1-c29baf7b48fa admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:46.828862 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:39:46.857131 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165ec944-68eb-455c-8c15-40a20e75575b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:46.858034 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ec944-68eb-455c-8c15-40a20e75575b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:46.858482 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ec944-68eb-455c-8c15-40a20e75575b admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:46.858768 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ec944-68eb-455c-8c15-40a20e75575b admin admin] PATH_INFO: `/v3/projects/758a59ef89424400bc4b3b21de7c0c63` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:46.860579 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165ec944-68eb-455c-8c15-40a20e75575b admin admin] RBAC: Authorizing `identity:delete_project(project_id=758a59ef89424400bc4b3b21de7c0c63)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:46.863107 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165ec944-68eb-455c-8c15-40a20e75575b admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:46.917855 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-165ec944-68eb-455c-8c15-40a20e75575b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '758a59ef89424400bc4b3b21de7c0c63', 'request_id': 'req-165ec944-68eb-455c-8c15-40a20e75575b'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:46.925609 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-165ec944-68eb-455c-8c15-40a20e75575b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '758a59ef89424400bc4b3b21de7c0c63', 'request_id': 'req-165ec944-68eb-455c-8c15-40a20e75575b'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:46.936807 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-165ec944-68eb-455c-8c15-40a20e75575b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '758a59ef89424400bc4b3b21de7c0c63', 'request_id': 'req-165ec944-68eb-455c-8c15-40a20e75575b'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:46.950403 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-165ec944-68eb-455c-8c15-40a20e75575b admin admin] The token cache is being invalidate because project 758a59ef89424400bc4b3b21de7c0c63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 22:39:46.950717 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-165ec944-68eb-455c-8c15-40a20e75575b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:46.951402 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-165ec944-68eb-455c-8c15-40a20e75575b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:46.953378 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 902/1822] 10.222.0.36 () {58 vars in 1232 bytes} [Fri Jun 24 22:39:46 2022] DELETE /identity/v3/projects/758a59ef89424400bc4b3b21de7c0c63 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:39:46.959864 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafbee9e-a791-478b-9f10-7f68d549131b None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:46.960386 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafbee9e-a791-478b-9f10-7f68d549131b None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:46.960386 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafbee9e-a791-478b-9f10-7f68d549131b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:46.980386 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-bafbee9e-a791-478b-9f10-7f68d549131b None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:39:46.981671 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-bafbee9e-a791-478b-9f10-7f68d549131b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:47.051515 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 921/1823] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:39:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 22:39:47.060151 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427bbacf-25ea-4069-96c8-e86c61904f11 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:47.060670 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427bbacf-25ea-4069-96c8-e86c61904f11 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:47.060759 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427bbacf-25ea-4069-96c8-e86c61904f11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:47.079627 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-427bbacf-25ea-4069-96c8-e86c61904f11 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:39:47.080862 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-427bbacf-25ea-4069-96c8-e86c61904f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:47.090097 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 903/1824] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:39:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:39:47.094671 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafbee9e-a791-478b-9f10-7f68d549131b None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:47.104666 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafbee9e-a791-478b-9f10-7f68d549131b None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:47.109392 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1682d4-0f53-4700-a51e-1ef03c99f2c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:47.110095 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1682d4-0f53-4700-a51e-1ef03c99f2c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:47.110392 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1682d4-0f53-4700-a51e-1ef03c99f2c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:47.110675 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1682d4-0f53-4700-a51e-1ef03c99f2c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:47.111437 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1682d4-0f53-4700-a51e-1ef03c99f2c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:39:47.111773 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1682d4-0f53-4700-a51e-1ef03c99f2c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:47.113380 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1682d4-0f53-4700-a51e-1ef03c99f2c2 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:47.124873 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 922/1825] 10.222.0.36 () {58 vars in 1152 bytes} [Fri Jun 24 22:39:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:39:47.129688 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427bbacf-25ea-4069-96c8-e86c61904f11 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:47.138971 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427bbacf-25ea-4069-96c8-e86c61904f11 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:47.143794 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c87125b-de18-4e99-8f3e-6e1d2920cf5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:47.144455 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c87125b-de18-4e99-8f3e-6e1d2920cf5d admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:47.144736 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c87125b-de18-4e99-8f3e-6e1d2920cf5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:47.145013 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c87125b-de18-4e99-8f3e-6e1d2920cf5d admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:47.145712 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c87125b-de18-4e99-8f3e-6e1d2920cf5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:47.147669 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c87125b-de18-4e99-8f3e-6e1d2920cf5d admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:47.177627 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 904/1826] 10.222.0.36 () {60 vars in 1152 bytes} [Fri Jun 24 22:39:47 2022] POST /identity/v3/projects => generated 393 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:39:47.181939 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1682d4-0f53-4700-a51e-1ef03c99f2c2 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:47.193558 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1682d4-0f53-4700-a51e-1ef03c99f2c2 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:47.254375 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb60942-c967-4eff-b743-3505e94a6d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:47.255086 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb60942-c967-4eff-b743-3505e94a6d30 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:47.255400 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb60942-c967-4eff-b743-3505e94a6d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:47.255791 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb60942-c967-4eff-b743-3505e94a6d30 admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:47.256696 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb60942-c967-4eff-b743-3505e94a6d30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:47.259241 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb60942-c967-4eff-b743-3505e94a6d30 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:47.267020 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:39:47.283431 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 923/1827] 10.222.0.36 () {60 vars in 1143 bytes} [Fri Jun 24 22:39:47 2022] POST /identity/v3/users => generated 297 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:39:47.287903 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c87125b-de18-4e99-8f3e-6e1d2920cf5d admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:47.298871 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c87125b-de18-4e99-8f3e-6e1d2920cf5d admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:47.303521 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f09be6-7527-41fd-9219-9a0a671172df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:47.304216 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f09be6-7527-41fd-9219-9a0a671172df admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:47.304476 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f09be6-7527-41fd-9219-9a0a671172df admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:47.305108 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f09be6-7527-41fd-9219-9a0a671172df admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:47.305864 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f09be6-7527-41fd-9219-9a0a671172df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:47.307508 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f09be6-7527-41fd-9219-9a0a671172df admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:47.318372 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 905/1828] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:39:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:39:47.323919 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb60942-c967-4eff-b743-3505e94a6d30 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:47.334566 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb60942-c967-4eff-b743-3505e94a6d30 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:47.339360 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0a648a-9f91-408b-9d6b-c785ead85112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:47.340283 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a648a-9f91-408b-9d6b-c785ead85112 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:47.340283 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a648a-9f91-408b-9d6b-c785ead85112 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:47.340549 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a648a-9f91-408b-9d6b-c785ead85112 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:47.341282 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0a648a-9f91-408b-9d6b-c785ead85112 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:47.342911 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0a648a-9f91-408b-9d6b-c785ead85112 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:47.354195 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 924/1829] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:39:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:39:47.358941 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f09be6-7527-41fd-9219-9a0a671172df admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:47.369532 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f09be6-7527-41fd-9219-9a0a671172df admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:47.374398 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b23dc9f-70ea-4db2-8943-88edb01fe280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:47.375353 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b23dc9f-70ea-4db2-8943-88edb01fe280 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:47.375636 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b23dc9f-70ea-4db2-8943-88edb01fe280 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:47.375910 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b23dc9f-70ea-4db2-8943-88edb01fe280 admin admin] PATH_INFO: `/v3/projects/5788e8a6e49e492785f654d4933eb58c/users/f7fe129a9ed5410bb281ec58462e8270/roles/1928787bfcc745419829cd315900ac44` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:47.391336 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b23dc9f-70ea-4db2-8943-88edb01fe280 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5788e8a6e49e492785f654d4933eb58c, user_id=f7fe129a9ed5410bb281ec58462e8270, role_id=1928787bfcc745419829cd315900ac44)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:47.394024 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b23dc9f-70ea-4db2-8943-88edb01fe280 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:47.417529 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 906/1830] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 22:39:47 2022] PUT /identity/v3/projects/5788e8a6e49e492785f654d4933eb58c/users/f7fe129a9ed5410bb281ec58462e8270/roles/1928787bfcc745419829cd315900ac44 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:39:47.428815 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93603a1e-f015-4a70-a1eb-56bc0f0a0b48 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:47.429113 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93603a1e-f015-4a70-a1eb-56bc0f0a0b48 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:47.429392 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93603a1e-f015-4a70-a1eb-56bc0f0a0b48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:47.459087 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-93603a1e-f015-4a70-a1eb-56bc0f0a0b48 None None] MFA Rules not processed for user `f7fe129a9ed5410bb281ec58462e8270`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:39:47.460343 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-93603a1e-f015-4a70-a1eb-56bc0f0a0b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:47.526721 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 925/1831] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:39:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:39:47.531235 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b23dc9f-70ea-4db2-8943-88edb01fe280 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:47.604632 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b23dc9f-70ea-4db2-8943-88edb01fe280 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:47.609980 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c735a17-60b2-4d72-b464-fbbdb3b3853e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:47.610656 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c735a17-60b2-4d72-b464-fbbdb3b3853e admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:47.610940 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c735a17-60b2-4d72-b464-fbbdb3b3853e admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:47.611201 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c735a17-60b2-4d72-b464-fbbdb3b3853e admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:47.611958 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c735a17-60b2-4d72-b464-fbbdb3b3853e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:47.613878 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c735a17-60b2-4d72-b464-fbbdb3b3853e admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:47.628686 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:39:47.649542 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 907/1832] 10.222.0.36 () {60 vars in 1152 bytes} [Fri Jun 24 22:39:47 2022] POST /identity/v3/projects => generated 391 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 22:39:47.650957 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93603a1e-f015-4a70-a1eb-56bc0f0a0b48 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:47.662287 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93603a1e-f015-4a70-a1eb-56bc0f0a0b48 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:47.724713 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeebb757-c22b-45a8-8887-2510882b9f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:47.725401 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeebb757-c22b-45a8-8887-2510882b9f4d admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:47.725684 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeebb757-c22b-45a8-8887-2510882b9f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:47.725960 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeebb757-c22b-45a8-8887-2510882b9f4d admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:47.726655 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeebb757-c22b-45a8-8887-2510882b9f4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:47.728666 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeebb757-c22b-45a8-8887-2510882b9f4d admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:47.752883 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 926/1833] 10.222.0.36 () {60 vars in 1143 bytes} [Fri Jun 24 22:39:47 2022] POST /identity/v3/users => generated 302 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:39:47.756764 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c735a17-60b2-4d72-b464-fbbdb3b3853e admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:47.767789 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c735a17-60b2-4d72-b464-fbbdb3b3853e admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:47.772350 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748ca054-d350-4e2a-9783-c7af6fe2c729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:47.773017 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ca054-d350-4e2a-9783-c7af6fe2c729 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:47.773302 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ca054-d350-4e2a-9783-c7af6fe2c729 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:47.773576 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ca054-d350-4e2a-9783-c7af6fe2c729 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:47.774305 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748ca054-d350-4e2a-9783-c7af6fe2c729 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:47.775962 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748ca054-d350-4e2a-9783-c7af6fe2c729 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:47.787177 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 908/1834] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:39:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:39:47.791491 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeebb757-c22b-45a8-8887-2510882b9f4d admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:47.802705 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeebb757-c22b-45a8-8887-2510882b9f4d admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:47.807612 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1889a2c0-0f9f-4d20-8d8c-0158eb1a8c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:47.808510 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889a2c0-0f9f-4d20-8d8c-0158eb1a8c40 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:47.808789 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889a2c0-0f9f-4d20-8d8c-0158eb1a8c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:47.809061 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889a2c0-0f9f-4d20-8d8c-0158eb1a8c40 admin admin] PATH_INFO: `/v3/projects/065484fd244e4744a5bb9471208082c3/users/0ec9a48965514338b16c1c8961e2f953/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:47.825038 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1889a2c0-0f9f-4d20-8d8c-0158eb1a8c40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=065484fd244e4744a5bb9471208082c3, user_id=0ec9a48965514338b16c1c8961e2f953, role_id=1a1c43cc97a0407eb7a7c7a1333a9d4a)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:47.827711 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1889a2c0-0f9f-4d20-8d8c-0158eb1a8c40 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:47.843051 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 927/1835] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 22:39:47 2022] PUT /identity/v3/projects/065484fd244e4744a5bb9471208082c3/users/0ec9a48965514338b16c1c8961e2f953/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:39:47.847880 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748ca054-d350-4e2a-9783-c7af6fe2c729 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:47.861576 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748ca054-d350-4e2a-9783-c7af6fe2c729 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:47.921937 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975cd9a7-4c1f-4fc7-a77e-e170a18f5e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:47.922624 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975cd9a7-4c1f-4fc7-a77e-e170a18f5e17 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:47.922964 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975cd9a7-4c1f-4fc7-a77e-e170a18f5e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:47.923276 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975cd9a7-4c1f-4fc7-a77e-e170a18f5e17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:47.924061 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975cd9a7-4c1f-4fc7-a77e-e170a18f5e17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:47.925648 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975cd9a7-4c1f-4fc7-a77e-e170a18f5e17 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:47.936069 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 909/1836] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:39:47 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 22:39:47.940745 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1889a2c0-0f9f-4d20-8d8c-0158eb1a8c40 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:47.951732 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1889a2c0-0f9f-4d20-8d8c-0158eb1a8c40 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:47.957021 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9cd444-a7bf-4285-9706-5a67c07d8c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:47.957923 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9cd444-a7bf-4285-9706-5a67c07d8c3e admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:47.958298 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9cd444-a7bf-4285-9706-5a67c07d8c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:47.958574 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9cd444-a7bf-4285-9706-5a67c07d8c3e admin admin] PATH_INFO: `/v3/projects/065484fd244e4744a5bb9471208082c3/users/0ec9a48965514338b16c1c8961e2f953/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:47.960776 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9cd444-a7bf-4285-9706-5a67c07d8c3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=065484fd244e4744a5bb9471208082c3, user_id=0ec9a48965514338b16c1c8961e2f953, role_id=1a1c43cc97a0407eb7a7c7a1333a9d4a)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:47.963495 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9cd444-a7bf-4285-9706-5a67c07d8c3e admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:47.974545 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 928/1837] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 22:39:47 2022] PUT /identity/v3/projects/065484fd244e4744a5bb9471208082c3/users/0ec9a48965514338b16c1c8961e2f953/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 22:39:47.986486 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad7b48e-919d-4f9a-a920-1d81636e5ac0 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:47.986776 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad7b48e-919d-4f9a-a920-1d81636e5ac0 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:47.987053 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad7b48e-919d-4f9a-a920-1d81636e5ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:48.017159 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-7ad7b48e-919d-4f9a-a920-1d81636e5ac0 None None] MFA Rules not processed for user `0ec9a48965514338b16c1c8961e2f953`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:39:48.018584 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-7ad7b48e-919d-4f9a-a920-1d81636e5ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:48.089009 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 910/1838] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:39:47 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:39:48.100197 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9cd444-a7bf-4285-9706-5a67c07d8c3e admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:48.102035 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-ed9cd444-a7bf-4285-9706-5a67c07d8c3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:48.128806 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:39:48.179241 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9cd444-a7bf-4285-9706-5a67c07d8c3e admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:48.182837 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3792b47e-2268-4c61-b58a-7c2749726504 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a747e2a5684843a6ee9e3480badac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:48.183538 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3792b47e-2268-4c61-b58a-7c2749726504 service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:48.183803 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3792b47e-2268-4c61-b58a-7c2749726504 service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:48.184077 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3792b47e-2268-4c61-b58a-7c2749726504 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:48.194035 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3792b47e-2268-4c61-b58a-7c2749726504 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:48.195690 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3792b47e-2268-4c61-b58a-7c2749726504 service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:48.205463 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 929/1839] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:39:48 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:39:48.256280 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad7b48e-919d-4f9a-a920-1d81636e5ac0 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:48.258351 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-7ad7b48e-919d-4f9a-a920-1d81636e5ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:48.272004 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad7b48e-919d-4f9a-a920-1d81636e5ac0 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:48.276365 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b982ae5-c4fa-4f48-a8da-8e2470fe01ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a747e2a5684843a6ee9e3480badac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:48.277027 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b982ae5-c4fa-4f48-a8da-8e2470fe01ec service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:48.277315 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b982ae5-c4fa-4f48-a8da-8e2470fe01ec service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:48.277589 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b982ae5-c4fa-4f48-a8da-8e2470fe01ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:48.346780 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b982ae5-c4fa-4f48-a8da-8e2470fe01ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:48.348188 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b982ae5-c4fa-4f48-a8da-8e2470fe01ec service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:48.357542 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 911/1840] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:39:48 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:39:51.656770 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3792b47e-2268-4c61-b58a-7c2749726504 service cinder] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:51.658871 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-3792b47e-2268-4c61-b58a-7c2749726504 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:51.773970 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3792b47e-2268-4c61-b58a-7c2749726504 service cinder] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:51.780978 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aaae85-d361-4cbc-bf4f-ae689ab0283a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:51.782133 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aaae85-d361-4cbc-bf4f-ae689ab0283a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:51.782726 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aaae85-d361-4cbc-bf4f-ae689ab0283a admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:51.783146 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aaae85-d361-4cbc-bf4f-ae689ab0283a admin admin] PATH_INFO: `/v3/users/f0a40e9390da47f38bc80446387197c0` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:51.785366 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44aaae85-d361-4cbc-bf4f-ae689ab0283a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0a40e9390da47f38bc80446387197c0)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:51.789166 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44aaae85-d361-4cbc-bf4f-ae689ab0283a admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:51.866004 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-44aaae85-d361-4cbc-bf4f-ae689ab0283a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0a40e9390da47f38bc80446387197c0'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:51.881923 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-44aaae85-d361-4cbc-bf4f-ae689ab0283a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0a40e9390da47f38bc80446387197c0'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:51.881923 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-44aaae85-d361-4cbc-bf4f-ae689ab0283a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0a40e9390da47f38bc80446387197c0'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:51.881923 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-44aaae85-d361-4cbc-bf4f-ae689ab0283a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0a40e9390da47f38bc80446387197c0'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:51.890618 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-44aaae85-d361-4cbc-bf4f-ae689ab0283a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0a40e9390da47f38bc80446387197c0'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:51.906568 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 930/1841] 10.222.0.36 () {58 vars in 1223 bytes} [Fri Jun 24 22:39:51 2022] DELETE /identity/v3/users/f0a40e9390da47f38bc80446387197c0 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:39:51.911682 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7856e06e-2f51-4ed1-a527-682841c2e747 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:51.912217 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7856e06e-2f51-4ed1-a527-682841c2e747 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:51.912509 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7856e06e-2f51-4ed1-a527-682841c2e747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:51.919207 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:39:51.933491 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-7856e06e-2f51-4ed1-a527-682841c2e747 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:39:51.934837 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-7856e06e-2f51-4ed1-a527-682841c2e747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:51.999741 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 912/1842] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:39:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:39:52.010158 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aaae85-d361-4cbc-bf4f-ae689ab0283a admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:52.011741 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-44aaae85-d361-4cbc-bf4f-ae689ab0283a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:52.065711 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:39:52.084699 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aaae85-d361-4cbc-bf4f-ae689ab0283a admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:52.089786 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9edc68-49b7-4b67-9d5c-7ca65839a879 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:52.090473 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9edc68-49b7-4b67-9d5c-7ca65839a879 service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:52.090756 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9edc68-49b7-4b67-9d5c-7ca65839a879 service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:52.091034 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9edc68-49b7-4b67-9d5c-7ca65839a879 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:52.103979 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9edc68-49b7-4b67-9d5c-7ca65839a879 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:52.105590 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9edc68-49b7-4b67-9d5c-7ca65839a879 service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:52.117265 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 931/1843] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:39:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:39:52.510435 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7856e06e-2f51-4ed1-a527-682841c2e747 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:52.512015 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-7856e06e-2f51-4ed1-a527-682841c2e747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:52.527329 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7856e06e-2f51-4ed1-a527-682841c2e747 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:52.533981 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1a2920-28a1-4a58-94c9-097665ac4b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:52.535060 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1a2920-28a1-4a58-94c9-097665ac4b4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:52.535410 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1a2920-28a1-4a58-94c9-097665ac4b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:52.535752 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1a2920-28a1-4a58-94c9-097665ac4b4f admin admin] PATH_INFO: `/v3/projects/bab7480a07b1499fa565fac1ff380ca5` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:52.537089 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1a2920-28a1-4a58-94c9-097665ac4b4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=bab7480a07b1499fa565fac1ff380ca5)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:52.538995 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1a2920-28a1-4a58-94c9-097665ac4b4f admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:52.604787 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-1f1a2920-28a1-4a58-94c9-097665ac4b4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bab7480a07b1499fa565fac1ff380ca5', 'request_id': 'req-1f1a2920-28a1-4a58-94c9-097665ac4b4f'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:52.611040 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-1f1a2920-28a1-4a58-94c9-097665ac4b4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bab7480a07b1499fa565fac1ff380ca5', 'request_id': 'req-1f1a2920-28a1-4a58-94c9-097665ac4b4f'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:52.620382 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-1f1a2920-28a1-4a58-94c9-097665ac4b4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bab7480a07b1499fa565fac1ff380ca5', 'request_id': 'req-1f1a2920-28a1-4a58-94c9-097665ac4b4f'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:52.632465 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-1f1a2920-28a1-4a58-94c9-097665ac4b4f admin admin] The token cache is being invalidate because project bab7480a07b1499fa565fac1ff380ca5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 22:39:52.632767 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-1f1a2920-28a1-4a58-94c9-097665ac4b4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:52.633486 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-1f1a2920-28a1-4a58-94c9-097665ac4b4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:52.635298 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 913/1844] 10.222.0.36 () {58 vars in 1232 bytes} [Fri Jun 24 22:39:52 2022] DELETE /identity/v3/projects/bab7480a07b1499fa565fac1ff380ca5 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:39:52.639909 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9edc68-49b7-4b67-9d5c-7ca65839a879 service neutron] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:52.653229 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9edc68-49b7-4b67-9d5c-7ca65839a879 service neutron] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:52.742562 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b04c06-23c5-487f-b5b5-55f9895159fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:52.743899 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b04c06-23c5-487f-b5b5-55f9895159fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:52.744672 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b04c06-23c5-487f-b5b5-55f9895159fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:52.744969 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b04c06-23c5-487f-b5b5-55f9895159fc admin admin] PATH_INFO: `/v3/users/0ee8721f3ee74efcb70c54475887ddca` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:52.746237 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b04c06-23c5-487f-b5b5-55f9895159fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ee8721f3ee74efcb70c54475887ddca)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:52.748411 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b04c06-23c5-487f-b5b5-55f9895159fc admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:52.822397 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-65b04c06-23c5-487f-b5b5-55f9895159fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ee8721f3ee74efcb70c54475887ddca'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:52.837731 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-65b04c06-23c5-487f-b5b5-55f9895159fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ee8721f3ee74efcb70c54475887ddca'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:52.838323 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-65b04c06-23c5-487f-b5b5-55f9895159fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ee8721f3ee74efcb70c54475887ddca'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:52.839332 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-65b04c06-23c5-487f-b5b5-55f9895159fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ee8721f3ee74efcb70c54475887ddca'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:52.865612 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-65b04c06-23c5-487f-b5b5-55f9895159fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ee8721f3ee74efcb70c54475887ddca'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:52.889208 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 932/1845] 10.222.0.36 () {58 vars in 1223 bytes} [Fri Jun 24 22:39:52 2022] DELETE /identity/v3/users/0ee8721f3ee74efcb70c54475887ddca => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:39:52.944714 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1a2920-28a1-4a58-94c9-097665ac4b4f admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:52.946939 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-1f1a2920-28a1-4a58-94c9-097665ac4b4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:52.969091 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1a2920-28a1-4a58-94c9-097665ac4b4f admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:53.056066 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e4f5de-2524-4687-9e90-11aa194f5da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:53.058406 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e4f5de-2524-4687-9e90-11aa194f5da3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:53.058855 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e4f5de-2524-4687-9e90-11aa194f5da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:53.059315 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e4f5de-2524-4687-9e90-11aa194f5da3 admin admin] PATH_INFO: `/v3/users/f7fe129a9ed5410bb281ec58462e8270` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:53.061209 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e4f5de-2524-4687-9e90-11aa194f5da3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7fe129a9ed5410bb281ec58462e8270)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:53.063757 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e4f5de-2524-4687-9e90-11aa194f5da3 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:53.103741 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:39:53.133734 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-31e4f5de-2524-4687-9e90-11aa194f5da3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7fe129a9ed5410bb281ec58462e8270'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:53.141352 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-31e4f5de-2524-4687-9e90-11aa194f5da3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7fe129a9ed5410bb281ec58462e8270'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:53.142215 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-31e4f5de-2524-4687-9e90-11aa194f5da3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7fe129a9ed5410bb281ec58462e8270'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:53.142847 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-31e4f5de-2524-4687-9e90-11aa194f5da3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7fe129a9ed5410bb281ec58462e8270'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:53.157231 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-31e4f5de-2524-4687-9e90-11aa194f5da3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7fe129a9ed5410bb281ec58462e8270'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:53.184092 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 914/1846] 10.222.0.36 () {58 vars in 1223 bytes} [Fri Jun 24 22:39:52 2022] DELETE /identity/v3/users/f7fe129a9ed5410bb281ec58462e8270 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:39:53.187090 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c7c66e-c1bb-4e0a-a6f5-d613a74ad736 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:53.187090 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c7c66e-c1bb-4e0a-a6f5-d613a74ad736 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:53.187442 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c7c66e-c1bb-4e0a-a6f5-d613a74ad736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:53.194433 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e4f5de-2524-4687-9e90-11aa194f5da3 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:53.200333 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-31e4f5de-2524-4687-9e90-11aa194f5da3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:53.209605 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-c0c7c66e-c1bb-4e0a-a6f5-d613a74ad736 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:39:53.210718 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-c0c7c66e-c1bb-4e0a-a6f5-d613a74ad736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:53.286476 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e4f5de-2524-4687-9e90-11aa194f5da3 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:53.287038 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 933/1847] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:39:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 22:39:53.288734 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c7c66e-c1bb-4e0a-a6f5-d613a74ad736 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:53.291555 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-c0c7c66e-c1bb-4e0a-a6f5-d613a74ad736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:53.297009 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1e2547-3d27-4dd5-bb2d-6702d5cc84e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:53.297925 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e2547-3d27-4dd5-bb2d-6702d5cc84e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:53.298207 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e2547-3d27-4dd5-bb2d-6702d5cc84e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:53.298484 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e2547-3d27-4dd5-bb2d-6702d5cc84e1 admin admin] PATH_INFO: `/v3/users/7a3d4781fbe849358a09946e3cd3de9e` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:53.299759 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1e2547-3d27-4dd5-bb2d-6702d5cc84e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a3d4781fbe849358a09946e3cd3de9e)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:53.301701 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1e2547-3d27-4dd5-bb2d-6702d5cc84e1 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:53.302626 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:39:53.307690 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c7c66e-c1bb-4e0a-a6f5-d613a74ad736 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:53.314083 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e5ee9a-9b96-4973-b9eb-155f2d3cf94a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:53.315165 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e5ee9a-9b96-4973-b9eb-155f2d3cf94a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:53.315783 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e5ee9a-9b96-4973-b9eb-155f2d3cf94a admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:53.316257 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e5ee9a-9b96-4973-b9eb-155f2d3cf94a admin admin] PATH_INFO: `/v3/projects/8feee3db563446a1ac0aad9aaa99b20f` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:53.317661 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e5ee9a-9b96-4973-b9eb-155f2d3cf94a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8feee3db563446a1ac0aad9aaa99b20f)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:53.319938 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e5ee9a-9b96-4973-b9eb-155f2d3cf94a admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:53.368795 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-f0e5ee9a-9b96-4973-b9eb-155f2d3cf94a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8feee3db563446a1ac0aad9aaa99b20f', 'request_id': 'req-f0e5ee9a-9b96-4973-b9eb-155f2d3cf94a'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:53.370869 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-dd1e2547-3d27-4dd5-bb2d-6702d5cc84e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a3d4781fbe849358a09946e3cd3de9e'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:53.375229 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-f0e5ee9a-9b96-4973-b9eb-155f2d3cf94a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8feee3db563446a1ac0aad9aaa99b20f', 'request_id': 'req-f0e5ee9a-9b96-4973-b9eb-155f2d3cf94a'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:53.383375 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-dd1e2547-3d27-4dd5-bb2d-6702d5cc84e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a3d4781fbe849358a09946e3cd3de9e'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:53.384251 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-dd1e2547-3d27-4dd5-bb2d-6702d5cc84e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a3d4781fbe849358a09946e3cd3de9e'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:53.384975 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-dd1e2547-3d27-4dd5-bb2d-6702d5cc84e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a3d4781fbe849358a09946e3cd3de9e'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:53.386954 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-f0e5ee9a-9b96-4973-b9eb-155f2d3cf94a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8feee3db563446a1ac0aad9aaa99b20f', 'request_id': 'req-f0e5ee9a-9b96-4973-b9eb-155f2d3cf94a'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:53.397606 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-f0e5ee9a-9b96-4973-b9eb-155f2d3cf94a admin admin] The token cache is being invalidate because project 8feee3db563446a1ac0aad9aaa99b20f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 22:39:53.397901 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-f0e5ee9a-9b96-4973-b9eb-155f2d3cf94a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:53.398564 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-f0e5ee9a-9b96-4973-b9eb-155f2d3cf94a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:53.399602 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-dd1e2547-3d27-4dd5-bb2d-6702d5cc84e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a3d4781fbe849358a09946e3cd3de9e'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:53.400433 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 934/1848] 10.222.0.36 () {58 vars in 1232 bytes} [Fri Jun 24 22:39:53 2022] DELETE /identity/v3/projects/8feee3db563446a1ac0aad9aaa99b20f => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:39:53.404292 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e5ee9a-9b96-4973-b9eb-155f2d3cf94a admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:53.405781 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-f0e5ee9a-9b96-4973-b9eb-155f2d3cf94a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:53.419437 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 915/1849] 10.222.0.36 () {58 vars in 1223 bytes} [Fri Jun 24 22:39:53 2022] DELETE /identity/v3/users/7a3d4781fbe849358a09946e3cd3de9e => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:39:53.420079 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a0b20c-223a-4cbd-9eb9-31a23c728763 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:53.420355 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a0b20c-223a-4cbd-9eb9-31a23c728763 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:53.420644 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a0b20c-223a-4cbd-9eb9-31a23c728763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:53.447221 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-45a0b20c-223a-4cbd-9eb9-31a23c728763 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:39:53.448855 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-45a0b20c-223a-4cbd-9eb9-31a23c728763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:53.470144 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:39:53.474535 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e5ee9a-9b96-4973-b9eb-155f2d3cf94a admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:53.513552 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 916/1850] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:39:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:39:53.515058 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecda9f5-df53-49e9-913f-78eadbf78f35 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:53.515379 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecda9f5-df53-49e9-913f-78eadbf78f35 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:53.515786 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecda9f5-df53-49e9-913f-78eadbf78f35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:53.531222 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba145d8-bdab-4c2a-b1f9-bb788135429f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:53.531907 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba145d8-bdab-4c2a-b1f9-bb788135429f service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:53.532187 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba145d8-bdab-4c2a-b1f9-bb788135429f service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:53.532464 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba145d8-bdab-4c2a-b1f9-bb788135429f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:53.534232 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-7ecda9f5-df53-49e9-913f-78eadbf78f35 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:39:53.534359 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-fba145d8-bdab-4c2a-b1f9-bb788135429f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:53.535498 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-7ecda9f5-df53-49e9-913f-78eadbf78f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:53.542953 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 917/1851] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:39:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:39:53.544180 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f79286f-8b30-4d63-baab-227661f097fa None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:53.544467 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f79286f-8b30-4d63-baab-227661f097fa None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:53.544740 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f79286f-8b30-4d63-baab-227661f097fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:53.549020 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba145d8-bdab-4c2a-b1f9-bb788135429f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:53.550658 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba145d8-bdab-4c2a-b1f9-bb788135429f service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:53.562293 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 935/1852] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:39:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:39:53.562859 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-1f79286f-8b30-4d63-baab-227661f097fa None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:39:53.563154 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba145d8-bdab-4c2a-b1f9-bb788135429f service neutron] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:53.564076 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-1f79286f-8b30-4d63-baab-227661f097fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:53.572594 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 918/1853] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:39:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:39:53.572933 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba145d8-bdab-4c2a-b1f9-bb788135429f service neutron] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:53.576661 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f79286f-8b30-4d63-baab-227661f097fa None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:53.577050 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9127bdab-dfcf-41bb-8957-9632ef4eee1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:53.578028 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9127bdab-dfcf-41bb-8957-9632ef4eee1d service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:53.578318 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9127bdab-dfcf-41bb-8957-9632ef4eee1d service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:53.578596 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9127bdab-dfcf-41bb-8957-9632ef4eee1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:53.587680 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f79286f-8b30-4d63-baab-227661f097fa None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:53.588548 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9127bdab-dfcf-41bb-8957-9632ef4eee1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:53.590164 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9127bdab-dfcf-41bb-8957-9632ef4eee1d service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:53.593447 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc49a04-55a9-4b50-b7b7-ccece6aedd9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:53.594116 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc49a04-55a9-4b50-b7b7-ccece6aedd9f admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:53.594408 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc49a04-55a9-4b50-b7b7-ccece6aedd9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:53.594670 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc49a04-55a9-4b50-b7b7-ccece6aedd9f admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:53.595461 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc49a04-55a9-4b50-b7b7-ccece6aedd9f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:39:53.595767 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc49a04-55a9-4b50-b7b7-ccece6aedd9f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:53.597781 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc49a04-55a9-4b50-b7b7-ccece6aedd9f admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:53.602261 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 936/1854] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:39:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:39:53.610469 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 919/1855] 10.222.0.36 () {58 vars in 1152 bytes} [Fri Jun 24 22:39:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:39:53.614961 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9127bdab-dfcf-41bb-8957-9632ef4eee1d service neutron] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:53.624757 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9127bdab-dfcf-41bb-8957-9632ef4eee1d service neutron] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:53.630356 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26ed586-7276-4690-bf30-c9e2837a029b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:53.631100 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ed586-7276-4690-bf30-c9e2837a029b admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:53.631621 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ed586-7276-4690-bf30-c9e2837a029b admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:53.631963 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ed586-7276-4690-bf30-c9e2837a029b admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:53.632750 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26ed586-7276-4690-bf30-c9e2837a029b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:53.634686 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26ed586-7276-4690-bf30-c9e2837a029b admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:53.663307 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 937/1856] 10.222.0.36 () {60 vars in 1152 bytes} [Fri Jun 24 22:39:53 2022] POST /identity/v3/projects => generated 409 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:39:53.666521 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc49a04-55a9-4b50-b7b7-ccece6aedd9f admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:53.676748 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc49a04-55a9-4b50-b7b7-ccece6aedd9f admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:53.738928 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d510d571-8d9e-4dc9-b732-4df247947109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:53.739804 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d510d571-8d9e-4dc9-b732-4df247947109 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:53.740151 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d510d571-8d9e-4dc9-b732-4df247947109 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:53.740796 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d510d571-8d9e-4dc9-b732-4df247947109 admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:53.741398 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d510d571-8d9e-4dc9-b732-4df247947109 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:53.743805 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d510d571-8d9e-4dc9-b732-4df247947109 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:53.781334 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 920/1857] 10.222.0.36 () {60 vars in 1143 bytes} [Fri Jun 24 22:39:53 2022] POST /identity/v3/users => generated 305 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 22:39:53.785341 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26ed586-7276-4690-bf30-c9e2837a029b admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:53.798115 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26ed586-7276-4690-bf30-c9e2837a029b admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:53.804734 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef8e7db-321e-4587-8fc9-0b9e3726435f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:53.805517 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef8e7db-321e-4587-8fc9-0b9e3726435f admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:53.805788 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef8e7db-321e-4587-8fc9-0b9e3726435f admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:53.806295 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef8e7db-321e-4587-8fc9-0b9e3726435f admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:53.806981 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef8e7db-321e-4587-8fc9-0b9e3726435f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:53.808808 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef8e7db-321e-4587-8fc9-0b9e3726435f admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:53.815178 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:39:53.827175 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d510d571-8d9e-4dc9-b732-4df247947109 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:53.839772 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 938/1858] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:39:53 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:39:53.841157 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d510d571-8d9e-4dc9-b732-4df247947109 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:53.847751 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdf6ee3-671e-4133-b7a4-3cbdc67d5a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:53.848825 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf6ee3-671e-4133-b7a4-3cbdc67d5a37 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:53.849213 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf6ee3-671e-4133-b7a4-3cbdc67d5a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:53.849754 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf6ee3-671e-4133-b7a4-3cbdc67d5a37 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:53.850666 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdf6ee3-671e-4133-b7a4-3cbdc67d5a37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:53.852671 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdf6ee3-671e-4133-b7a4-3cbdc67d5a37 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:53.872117 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef8e7db-321e-4587-8fc9-0b9e3726435f admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:53.873362 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 921/1859] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:39:53 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:39:53.885587 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef8e7db-321e-4587-8fc9-0b9e3726435f admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:53.897223 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1d231f-74a3-492c-9245-11349b54462e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:53.898371 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1d231f-74a3-492c-9245-11349b54462e admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:53.898741 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1d231f-74a3-492c-9245-11349b54462e admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:53.899227 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1d231f-74a3-492c-9245-11349b54462e admin admin] PATH_INFO: `/v3/projects/af176dc803504f388b06f5914bf000cb/users/a50e10318c664b41ade9626e84c01256/roles/1928787bfcc745419829cd315900ac44` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:53.917854 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1d231f-74a3-492c-9245-11349b54462e admin admin] RBAC: Authorizing `identity:create_grant(project_id=af176dc803504f388b06f5914bf000cb, user_id=a50e10318c664b41ade9626e84c01256, role_id=1928787bfcc745419829cd315900ac44)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:53.923536 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1d231f-74a3-492c-9245-11349b54462e admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:53.947962 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 939/1860] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 22:39:53 2022] PUT /identity/v3/projects/af176dc803504f388b06f5914bf000cb/users/a50e10318c664b41ade9626e84c01256/roles/1928787bfcc745419829cd315900ac44 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:39:53.961026 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c44b29b-00e4-4946-b813-e2555976a465 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:53.961539 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c44b29b-00e4-4946-b813-e2555976a465 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:53.961539 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c44b29b-00e4-4946-b813-e2555976a465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:54.007768 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-7c44b29b-00e4-4946-b813-e2555976a465 None None] MFA Rules not processed for user `a50e10318c664b41ade9626e84c01256`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:39:54.007768 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-7c44b29b-00e4-4946-b813-e2555976a465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:54.040317 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b84c42-af1f-4a03-9d3d-584ecb18081b None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:54.041038 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b84c42-af1f-4a03-9d3d-584ecb18081b None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:54.041861 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b84c42-af1f-4a03-9d3d-584ecb18081b None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:54.044865 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 940/1861] 10.222.0.36 () {54 vars in 921 bytes} [Fri Jun 24 22:39:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:39:54.057819 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d4ba1b-bceb-454d-a11d-de2774a94eac None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:54.058956 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d4ba1b-bceb-454d-a11d-de2774a94eac None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:54.059530 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d4ba1b-bceb-454d-a11d-de2774a94eac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:54.077895 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 922/1862] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:39:53 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:39:54.082710 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c44b29b-00e4-4946-b813-e2555976a465 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:54.093858 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:39:54.100233 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-85d4ba1b-bceb-454d-a11d-de2774a94eac None None] MFA Rules not processed for user `214d9071042c4bad886bf060a079b6e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:39:54.102500 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-85d4ba1b-bceb-454d-a11d-de2774a94eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:54.296665 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c44b29b-00e4-4946-b813-e2555976a465 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:54.303861 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0248b0-87f9-488b-8908-e4f871a62335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:54.304705 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0248b0-87f9-488b-8908-e4f871a62335 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:54.305027 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0248b0-87f9-488b-8908-e4f871a62335 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:54.305387 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0248b0-87f9-488b-8908-e4f871a62335 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:54.306204 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0248b0-87f9-488b-8908-e4f871a62335 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:54.306778 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 941/1863] 10.222.0.36 () {58 vars in 1018 bytes} [Fri Jun 24 22:39:54 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 22:39:54.315070 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0248b0-87f9-488b-8908-e4f871a62335 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:54.347942 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d4ba1b-bceb-454d-a11d-de2774a94eac None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:54.350223 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-85d4ba1b-bceb-454d-a11d-de2774a94eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:54.356195 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 923/1864] 10.222.0.36 () {60 vars in 1152 bytes} [Fri Jun 24 22:39:54 2022] POST /identity/v3/projects => generated 407 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 22:39:54.357393 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0248b0-87f9-488b-8908-e4f871a62335 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:54.377017 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d4ba1b-bceb-454d-a11d-de2774a94eac None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:54.443907 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0248b0-87f9-488b-8908-e4f871a62335 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:54.449182 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a495b1-fcce-4f60-a843-bafff0f42451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:54.449875 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a495b1-fcce-4f60-a843-bafff0f42451 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:54.450319 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a495b1-fcce-4f60-a843-bafff0f42451 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:54.450595 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a495b1-fcce-4f60-a843-bafff0f42451 admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:54.451389 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a495b1-fcce-4f60-a843-bafff0f42451 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:54.453348 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a495b1-fcce-4f60-a843-bafff0f42451 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:54.455188 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca62947-0c51-48fc-a583-82b4f6ecb41c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:54.456931 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca62947-0c51-48fc-a583-82b4f6ecb41c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:54.457437 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca62947-0c51-48fc-a583-82b4f6ecb41c admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:54.457804 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca62947-0c51-48fc-a583-82b4f6ecb41c admin admin] PATH_INFO: `/v3/projects/5788e8a6e49e492785f654d4933eb58c` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:54.459132 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca62947-0c51-48fc-a583-82b4f6ecb41c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5788e8a6e49e492785f654d4933eb58c)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:54.461317 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca62947-0c51-48fc-a583-82b4f6ecb41c admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:54.479145 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 924/1865] 10.222.0.36 () {60 vars in 1143 bytes} [Fri Jun 24 22:39:54 2022] POST /identity/v3/users => generated 310 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:39:54.480291 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a495b1-fcce-4f60-a843-bafff0f42451 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:54.481924 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-05a495b1-fcce-4f60-a843-bafff0f42451 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:54.533538 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-4ca62947-0c51-48fc-a583-82b4f6ecb41c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5788e8a6e49e492785f654d4933eb58c', 'request_id': 'req-4ca62947-0c51-48fc-a583-82b4f6ecb41c'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:54.550707 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-4ca62947-0c51-48fc-a583-82b4f6ecb41c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5788e8a6e49e492785f654d4933eb58c', 'request_id': 'req-4ca62947-0c51-48fc-a583-82b4f6ecb41c'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:54.565577 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-4ca62947-0c51-48fc-a583-82b4f6ecb41c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5788e8a6e49e492785f654d4933eb58c', 'request_id': 'req-4ca62947-0c51-48fc-a583-82b4f6ecb41c'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:54.580533 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:39:54.583595 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a495b1-fcce-4f60-a843-bafff0f42451 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:54.586489 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-4ca62947-0c51-48fc-a583-82b4f6ecb41c admin admin] The token cache is being invalidate because project 5788e8a6e49e492785f654d4933eb58c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 22:39:54.587087 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-4ca62947-0c51-48fc-a583-82b4f6ecb41c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:54.590920 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-4ca62947-0c51-48fc-a583-82b4f6ecb41c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:54.590920 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 942/1866] 10.222.0.36 () {58 vars in 1232 bytes} [Fri Jun 24 22:39:54 2022] DELETE /identity/v3/projects/5788e8a6e49e492785f654d4933eb58c => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:39:54.591137 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca62947-0c51-48fc-a583-82b4f6ecb41c admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:54.595051 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-4ca62947-0c51-48fc-a583-82b4f6ecb41c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:54.609236 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:39:54.664040 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd5f864-0172-485b-aa29-c2efec2303c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214d9071042c4bad886bf060a079b6e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:54.664710 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd5f864-0172-485b-aa29-c2efec2303c8 service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:54.664996 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd5f864-0172-485b-aa29-c2efec2303c8 service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:54.665421 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd5f864-0172-485b-aa29-c2efec2303c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:54.667875 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-ddd5f864-0172-485b-aa29-c2efec2303c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:54.670223 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca62947-0c51-48fc-a583-82b4f6ecb41c admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:54.676353 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b07520f-0ce9-47fe-b031-b9a10445945f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:54.677176 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b07520f-0ce9-47fe-b031-b9a10445945f admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:54.677468 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b07520f-0ce9-47fe-b031-b9a10445945f admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:54.678100 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b07520f-0ce9-47fe-b031-b9a10445945f admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:54.678954 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b07520f-0ce9-47fe-b031-b9a10445945f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:54.680302 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd5f864-0172-485b-aa29-c2efec2303c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:54.680925 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b07520f-0ce9-47fe-b031-b9a10445945f admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:54.681895 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd5f864-0172-485b-aa29-c2efec2303c8 service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:54.693040 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 925/1867] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:39:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:39:54.696737 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 943/1868] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:39:54 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:39:54.696863 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd5f864-0172-485b-aa29-c2efec2303c8 service nova] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:54.696967 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b07520f-0ce9-47fe-b031-b9a10445945f admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:54.696967 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-5b07520f-0ce9-47fe-b031-b9a10445945f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:54.698206 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-ddd5f864-0172-485b-aa29-c2efec2303c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:54.715960 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b07520f-0ce9-47fe-b031-b9a10445945f admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:54.716078 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd5f864-0172-485b-aa29-c2efec2303c8 service nova] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:54.716169 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05190c86-1219-40ca-8d5f-45fe0a3a635f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:54.716169 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05190c86-1219-40ca-8d5f-45fe0a3a635f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:54.716169 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05190c86-1219-40ca-8d5f-45fe0a3a635f admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:54.716416 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05190c86-1219-40ca-8d5f-45fe0a3a635f admin admin] PATH_INFO: `/v3/users/0ec9a48965514338b16c1c8961e2f953` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:54.717232 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa82829-2c9e-4901-8b15-c5752af750a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:54.717568 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05190c86-1219-40ca-8d5f-45fe0a3a635f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ec9a48965514338b16c1c8961e2f953)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:54.718099 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa82829-2c9e-4901-8b15-c5752af750a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:54.718383 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa82829-2c9e-4901-8b15-c5752af750a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:54.718657 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa82829-2c9e-4901-8b15-c5752af750a6 admin admin] PATH_INFO: `/v3/projects/7f5ac4fd414a4b44932eb121f57200d2` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:54.719534 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05190c86-1219-40ca-8d5f-45fe0a3a635f admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:54.719915 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa82829-2c9e-4901-8b15-c5752af750a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f5ac4fd414a4b44932eb121f57200d2)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:54.721898 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa82829-2c9e-4901-8b15-c5752af750a6 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:54.770385 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-05190c86-1219-40ca-8d5f-45fe0a3a635f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ec9a48965514338b16c1c8961e2f953'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:54.773654 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-1fa82829-2c9e-4901-8b15-c5752af750a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f5ac4fd414a4b44932eb121f57200d2', 'request_id': 'req-1fa82829-2c9e-4901-8b15-c5752af750a6'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:54.777188 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-05190c86-1219-40ca-8d5f-45fe0a3a635f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ec9a48965514338b16c1c8961e2f953'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:54.777866 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-05190c86-1219-40ca-8d5f-45fe0a3a635f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ec9a48965514338b16c1c8961e2f953'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:54.778488 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-05190c86-1219-40ca-8d5f-45fe0a3a635f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ec9a48965514338b16c1c8961e2f953'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:54.780275 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-1fa82829-2c9e-4901-8b15-c5752af750a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f5ac4fd414a4b44932eb121f57200d2', 'request_id': 'req-1fa82829-2c9e-4901-8b15-c5752af750a6'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:54.788680 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-1fa82829-2c9e-4901-8b15-c5752af750a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f5ac4fd414a4b44932eb121f57200d2', 'request_id': 'req-1fa82829-2c9e-4901-8b15-c5752af750a6'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:54.791591 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-05190c86-1219-40ca-8d5f-45fe0a3a635f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ec9a48965514338b16c1c8961e2f953'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:54.799945 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-1fa82829-2c9e-4901-8b15-c5752af750a6 admin admin] The token cache is being invalidate because project 7f5ac4fd414a4b44932eb121f57200d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 22:39:54.800236 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-1fa82829-2c9e-4901-8b15-c5752af750a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:54.800911 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-1fa82829-2c9e-4901-8b15-c5752af750a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:54.802670 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 926/1869] 10.222.0.36 () {58 vars in 1232 bytes} [Fri Jun 24 22:39:54 2022] DELETE /identity/v3/projects/7f5ac4fd414a4b44932eb121f57200d2 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:39:54.803436 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa82829-2c9e-4901-8b15-c5752af750a6 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:54.804741 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-1fa82829-2c9e-4901-8b15-c5752af750a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:54.807219 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 944/1870] 10.222.0.36 () {58 vars in 1223 bytes} [Fri Jun 24 22:39:54 2022] DELETE /identity/v3/users/0ec9a48965514338b16c1c8961e2f953 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:39:54.808043 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05190c86-1219-40ca-8d5f-45fe0a3a635f admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:54.809345 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-05190c86-1219-40ca-8d5f-45fe0a3a635f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:54.881014 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05190c86-1219-40ca-8d5f-45fe0a3a635f admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:54.884355 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa82829-2c9e-4901-8b15-c5752af750a6 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:54.886472 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d0275e-cc19-46a1-92b4-0593d6563cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:54.887286 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d0275e-cc19-46a1-92b4-0593d6563cda admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:54.887674 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d0275e-cc19-46a1-92b4-0593d6563cda admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:54.887902 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d0275e-cc19-46a1-92b4-0593d6563cda admin admin] PATH_INFO: `/v3/users/5c020f1aeec64860801f472355e69f72` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:54.889414 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d0275e-cc19-46a1-92b4-0593d6563cda admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c020f1aeec64860801f472355e69f72)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:54.890699 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d520c70a-657c-4c51-bc62-fede28f1b437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:54.891916 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d0275e-cc19-46a1-92b4-0593d6563cda admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:54.892046 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d520c70a-657c-4c51-bc62-fede28f1b437 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:54.892046 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d520c70a-657c-4c51-bc62-fede28f1b437 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:54.892203 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d520c70a-657c-4c51-bc62-fede28f1b437 admin admin] PATH_INFO: `/v3/projects/c94197ceacc344b2b7e1351002041dd1/users/fcf97c6921064ffc909616fc4a1dde26/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:54.898249 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:39:54.913912 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d520c70a-657c-4c51-bc62-fede28f1b437 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c94197ceacc344b2b7e1351002041dd1, user_id=fcf97c6921064ffc909616fc4a1dde26, role_id=1a1c43cc97a0407eb7a7c7a1333a9d4a)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:54.917131 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d520c70a-657c-4c51-bc62-fede28f1b437 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:54.932668 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 927/1871] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 22:39:54 2022] PUT /identity/v3/projects/c94197ceacc344b2b7e1351002041dd1/users/fcf97c6921064ffc909616fc4a1dde26/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:39:54.936625 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d520c70a-657c-4c51-bc62-fede28f1b437 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:54.949908 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:39:54.952094 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-03d0275e-cc19-46a1-92b4-0593d6563cda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c020f1aeec64860801f472355e69f72'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:54.961888 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-03d0275e-cc19-46a1-92b4-0593d6563cda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c020f1aeec64860801f472355e69f72'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:54.962858 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-03d0275e-cc19-46a1-92b4-0593d6563cda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c020f1aeec64860801f472355e69f72'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:54.964314 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-03d0275e-cc19-46a1-92b4-0593d6563cda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c020f1aeec64860801f472355e69f72'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:54.984473 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-03d0275e-cc19-46a1-92b4-0593d6563cda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c020f1aeec64860801f472355e69f72'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:55.010525 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 945/1872] 10.222.0.36 () {58 vars in 1223 bytes} [Fri Jun 24 22:39:54 2022] DELETE /identity/v3/users/5c020f1aeec64860801f472355e69f72 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:39:55.030074 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d520c70a-657c-4c51-bc62-fede28f1b437 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:55.108949 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17984f0a-5821-46b2-b3f0-f7fdfdb2b69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:55.109395 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17984f0a-5821-46b2-b3f0-f7fdfdb2b69d admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:55.109685 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17984f0a-5821-46b2-b3f0-f7fdfdb2b69d admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:55.109961 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17984f0a-5821-46b2-b3f0-f7fdfdb2b69d admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:55.110790 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17984f0a-5821-46b2-b3f0-f7fdfdb2b69d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:55.119070 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17984f0a-5821-46b2-b3f0-f7fdfdb2b69d admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:55.134899 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 928/1873] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:39:54 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:39:55.136151 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d0275e-cc19-46a1-92b4-0593d6563cda admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:55.137728 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-03d0275e-cc19-46a1-92b4-0593d6563cda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:55.152572 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d0275e-cc19-46a1-92b4-0593d6563cda admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:55.158107 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874bc996-6938-463f-990f-c495d5118dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:55.159158 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874bc996-6938-463f-990f-c495d5118dd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:55.159468 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874bc996-6938-463f-990f-c495d5118dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:55.159749 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874bc996-6938-463f-990f-c495d5118dd4 admin admin] PATH_INFO: `/v3/projects/c94197ceacc344b2b7e1351002041dd1/users/fcf97c6921064ffc909616fc4a1dde26/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:55.161823 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874bc996-6938-463f-990f-c495d5118dd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c94197ceacc344b2b7e1351002041dd1, user_id=fcf97c6921064ffc909616fc4a1dde26, role_id=1a1c43cc97a0407eb7a7c7a1333a9d4a)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:55.164920 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874bc996-6938-463f-990f-c495d5118dd4 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:55.177476 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 946/1874] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 22:39:55 2022] PUT /identity/v3/projects/c94197ceacc344b2b7e1351002041dd1/users/fcf97c6921064ffc909616fc4a1dde26/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:39:55.188332 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21203847-5e06-4d46-927a-f62f5732b647 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:55.188633 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21203847-5e06-4d46-927a-f62f5732b647 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:55.189405 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21203847-5e06-4d46-927a-f62f5732b647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:55.227192 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874bc996-6938-463f-990f-c495d5118dd4 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:55.229304 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-874bc996-6938-463f-990f-c495d5118dd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:55.248706 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-21203847-5e06-4d46-927a-f62f5732b647 None None] MFA Rules not processed for user `fcf97c6921064ffc909616fc4a1dde26`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:39:55.249945 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-21203847-5e06-4d46-927a-f62f5732b647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:55.339544 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874bc996-6938-463f-990f-c495d5118dd4 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:55.345001 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c633675-8c80-4a42-b0a2-de2d3d24423e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:55.345152 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 929/1875] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:39:55 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:39:55.345884 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c633675-8c80-4a42-b0a2-de2d3d24423e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:55.346168 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c633675-8c80-4a42-b0a2-de2d3d24423e admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:55.346515 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c633675-8c80-4a42-b0a2-de2d3d24423e admin admin] PATH_INFO: `/v3/projects/065484fd244e4744a5bb9471208082c3` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:55.347894 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c633675-8c80-4a42-b0a2-de2d3d24423e admin admin] RBAC: Authorizing `identity:delete_project(project_id=065484fd244e4744a5bb9471208082c3)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:55.351311 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c633675-8c80-4a42-b0a2-de2d3d24423e admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:55.358116 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21203847-5e06-4d46-927a-f62f5732b647 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:55.359327 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-21203847-5e06-4d46-927a-f62f5732b647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:55.413925 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-6c633675-8c80-4a42-b0a2-de2d3d24423e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '065484fd244e4744a5bb9471208082c3', 'request_id': 'req-6c633675-8c80-4a42-b0a2-de2d3d24423e'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:55.420918 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-6c633675-8c80-4a42-b0a2-de2d3d24423e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '065484fd244e4744a5bb9471208082c3', 'request_id': 'req-6c633675-8c80-4a42-b0a2-de2d3d24423e'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:55.423550 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:39:55.442580 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-6c633675-8c80-4a42-b0a2-de2d3d24423e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '065484fd244e4744a5bb9471208082c3', 'request_id': 'req-6c633675-8c80-4a42-b0a2-de2d3d24423e'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:55.453927 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21203847-5e06-4d46-927a-f62f5732b647 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:55.455066 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-6c633675-8c80-4a42-b0a2-de2d3d24423e admin admin] The token cache is being invalidate because project 065484fd244e4744a5bb9471208082c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 22:39:55.455509 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-6c633675-8c80-4a42-b0a2-de2d3d24423e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:55.456520 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-6c633675-8c80-4a42-b0a2-de2d3d24423e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:55.458507 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 947/1876] 10.222.0.36 () {58 vars in 1232 bytes} [Fri Jun 24 22:39:55 2022] DELETE /identity/v3/projects/065484fd244e4744a5bb9471208082c3 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:39:55.459017 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c633675-8c80-4a42-b0a2-de2d3d24423e admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:55.460619 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-6c633675-8c80-4a42-b0a2-de2d3d24423e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:55.467709 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:39:55.523705 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b925046a-e1ab-4285-bf61-57f94606e006 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a747e2a5684843a6ee9e3480badac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:55.524760 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b925046a-e1ab-4285-bf61-57f94606e006 service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:55.525275 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b925046a-e1ab-4285-bf61-57f94606e006 service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:55.525713 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b925046a-e1ab-4285-bf61-57f94606e006 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:55.527607 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-b925046a-e1ab-4285-bf61-57f94606e006 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:55.588848 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c633675-8c80-4a42-b0a2-de2d3d24423e admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:55.598041 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00799463-4705-448f-95dd-c992459a7213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:55.599690 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00799463-4705-448f-95dd-c992459a7213 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:55.599690 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00799463-4705-448f-95dd-c992459a7213 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:55.599690 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00799463-4705-448f-95dd-c992459a7213 admin admin] PATH_INFO: `/v3/projects/d36edfe0da91475d9add07e4700f02fb` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:55.601086 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00799463-4705-448f-95dd-c992459a7213 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d36edfe0da91475d9add07e4700f02fb)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:55.603557 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00799463-4705-448f-95dd-c992459a7213 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:55.637774 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b925046a-e1ab-4285-bf61-57f94606e006 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:55.639867 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b925046a-e1ab-4285-bf61-57f94606e006 service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:55.655048 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 930/1877] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:39:55 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 22:39:55.667094 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780a1933-1787-4565-b2d1-72a0b5704fd5 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:55.667519 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780a1933-1787-4565-b2d1-72a0b5704fd5 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:55.667696 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780a1933-1787-4565-b2d1-72a0b5704fd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:55.687882 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-00799463-4705-448f-95dd-c992459a7213 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd36edfe0da91475d9add07e4700f02fb', 'request_id': 'req-00799463-4705-448f-95dd-c992459a7213'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:55.695298 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-00799463-4705-448f-95dd-c992459a7213 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd36edfe0da91475d9add07e4700f02fb', 'request_id': 'req-00799463-4705-448f-95dd-c992459a7213'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:55.715671 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-780a1933-1787-4565-b2d1-72a0b5704fd5 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:39:55.720890 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-00799463-4705-448f-95dd-c992459a7213 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd36edfe0da91475d9add07e4700f02fb', 'request_id': 'req-00799463-4705-448f-95dd-c992459a7213'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:55.732727 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-780a1933-1787-4565-b2d1-72a0b5704fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:55.744947 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-00799463-4705-448f-95dd-c992459a7213 admin admin] The token cache is being invalidate because project d36edfe0da91475d9add07e4700f02fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 22:39:55.745231 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-00799463-4705-448f-95dd-c992459a7213 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:55.749172 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-00799463-4705-448f-95dd-c992459a7213 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:55.762214 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 948/1878] 10.222.0.36 () {58 vars in 1232 bytes} [Fri Jun 24 22:39:55 2022] DELETE /identity/v3/projects/d36edfe0da91475d9add07e4700f02fb => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:39:55.767198 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56403d76-0a44-4f1e-9e12-62b6f1c2f674 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:55.768793 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56403d76-0a44-4f1e-9e12-62b6f1c2f674 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:55.770183 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56403d76-0a44-4f1e-9e12-62b6f1c2f674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:55.824122 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-56403d76-0a44-4f1e-9e12-62b6f1c2f674 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:39:55.825721 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-56403d76-0a44-4f1e-9e12-62b6f1c2f674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:55.892161 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 931/1879] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:39:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:39:55.902337 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d9e96-0814-424b-9b2f-b83dcd47f1dc None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:55.902709 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d9e96-0814-424b-9b2f-b83dcd47f1dc None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:55.903129 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d9e96-0814-424b-9b2f-b83dcd47f1dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:55.947120 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-3f2d9e96-0814-424b-9b2f-b83dcd47f1dc None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:39:55.948741 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-3f2d9e96-0814-424b-9b2f-b83dcd47f1dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:55.961845 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 932/1880] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:39:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:39:55.964169 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2d9e96-0814-424b-9b2f-b83dcd47f1dc None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:55.965912 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-3f2d9e96-0814-424b-9b2f-b83dcd47f1dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:55.990267 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 949/1881] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:39:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:39:55.991415 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56403d76-0a44-4f1e-9e12-62b6f1c2f674 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:56.009919 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56403d76-0a44-4f1e-9e12-62b6f1c2f674 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:56.022395 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:39:56.026638 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d235cb-fa26-4b01-80bf-770618396052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:56.028354 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d235cb-fa26-4b01-80bf-770618396052 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:56.029236 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d235cb-fa26-4b01-80bf-770618396052 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:56.030871 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d235cb-fa26-4b01-80bf-770618396052 admin admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:56.032440 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d235cb-fa26-4b01-80bf-770618396052 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:39:56.032945 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d235cb-fa26-4b01-80bf-770618396052 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:56.034802 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d235cb-fa26-4b01-80bf-770618396052 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:56.058426 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 950/1882] 10.222.0.36 () {58 vars in 1152 bytes} [Fri Jun 24 22:39:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:39:56.059991 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd996e9-1409-417b-84aa-886017f3789f None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:56.060317 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd996e9-1409-417b-84aa-886017f3789f None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:56.060558 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd996e9-1409-417b-84aa-886017f3789f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:56.061417 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2d9e96-0814-424b-9b2f-b83dcd47f1dc None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:56.066561 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e44eee-b4d1-4d23-8bae-0f2559eacc1f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a747e2a5684843a6ee9e3480badac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:56.067358 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e44eee-b4d1-4d23-8bae-0f2559eacc1f service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:56.067706 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e44eee-b4d1-4d23-8bae-0f2559eacc1f service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:56.068170 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e44eee-b4d1-4d23-8bae-0f2559eacc1f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:56.070428 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-95e44eee-b4d1-4d23-8bae-0f2559eacc1f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:56.085858 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-0cd996e9-1409-417b-84aa-886017f3789f None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:39:56.087471 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-0cd996e9-1409-417b-84aa-886017f3789f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:56.102062 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 951/1883] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:39:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:39:56.102062 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd996e9-1409-417b-84aa-886017f3789f None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:56.113430 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd996e9-1409-417b-84aa-886017f3789f None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:56.118827 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2364c3a-755a-485b-87ef-82af0e98d183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:56.119644 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2364c3a-755a-485b-87ef-82af0e98d183 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:56.119999 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2364c3a-755a-485b-87ef-82af0e98d183 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:56.120342 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2364c3a-755a-485b-87ef-82af0e98d183 admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:56.121124 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2364c3a-755a-485b-87ef-82af0e98d183 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:56.123307 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2364c3a-755a-485b-87ef-82af0e98d183 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:56.135175 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:39:56.152304 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e44eee-b4d1-4d23-8bae-0f2559eacc1f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:56.153937 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e44eee-b4d1-4d23-8bae-0f2559eacc1f service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:56.162918 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 952/1884] 10.222.0.36 () {60 vars in 1152 bytes} [Fri Jun 24 22:39:56 2022] POST /identity/v3/projects => generated 371 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:39:56.164454 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2364c3a-755a-485b-87ef-82af0e98d183 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:56.173275 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 933/1885] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:39:55 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:39:56.174204 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e44eee-b4d1-4d23-8bae-0f2559eacc1f service cinder] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:56.188215 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e44eee-b4d1-4d23-8bae-0f2559eacc1f service cinder] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:56.262891 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2364c3a-755a-485b-87ef-82af0e98d183 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:56.268001 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae6b185-3554-4a1e-ace5-b9550287b990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:56.270075 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae6b185-3554-4a1e-ace5-b9550287b990 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:56.270075 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae6b185-3554-4a1e-ace5-b9550287b990 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:56.270075 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae6b185-3554-4a1e-ace5-b9550287b990 admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:56.270579 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b52267-37dc-4d60-914c-5ad34827a3c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:56.270683 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae6b185-3554-4a1e-ace5-b9550287b990 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:56.270826 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b52267-37dc-4d60-914c-5ad34827a3c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:56.271077 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b52267-37dc-4d60-914c-5ad34827a3c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:56.271392 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b52267-37dc-4d60-914c-5ad34827a3c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:56.272173 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b52267-37dc-4d60-914c-5ad34827a3c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:39:56.272548 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b52267-37dc-4d60-914c-5ad34827a3c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:56.273984 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae6b185-3554-4a1e-ace5-b9550287b990 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:56.274212 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b52267-37dc-4d60-914c-5ad34827a3c3 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:56.294406 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 953/1886] 10.222.0.36 () {58 vars in 1152 bytes} [Fri Jun 24 22:39:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:39:56.298173 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b52267-37dc-4d60-914c-5ad34827a3c3 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:56.306139 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 934/1887] 10.222.0.36 () {60 vars in 1143 bytes} [Fri Jun 24 22:39:56 2022] POST /identity/v3/users => generated 286 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:39:56.310760 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae6b185-3554-4a1e-ace5-b9550287b990 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:56.313411 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b52267-37dc-4d60-914c-5ad34827a3c3 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:56.320110 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fee7e7-35eb-4ced-bd0c-7efe167f0da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:56.321632 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fee7e7-35eb-4ced-bd0c-7efe167f0da7 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:56.321922 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fee7e7-35eb-4ced-bd0c-7efe167f0da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:56.322204 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fee7e7-35eb-4ced-bd0c-7efe167f0da7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:56.322950 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fee7e7-35eb-4ced-bd0c-7efe167f0da7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:56.325798 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae6b185-3554-4a1e-ace5-b9550287b990 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:56.326205 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fee7e7-35eb-4ced-bd0c-7efe167f0da7 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:56.333243 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2c564a-a7a5-4f25-a063-d0972f176674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:56.334299 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2c564a-a7a5-4f25-a063-d0972f176674 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:56.334789 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2c564a-a7a5-4f25-a063-d0972f176674 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:56.335184 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2c564a-a7a5-4f25-a063-d0972f176674 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:56.336151 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2c564a-a7a5-4f25-a063-d0972f176674 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:56.337927 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2c564a-a7a5-4f25-a063-d0972f176674 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:56.351960 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 935/1888] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:39:56 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 22:39:56.355846 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2c564a-a7a5-4f25-a063-d0972f176674 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:56.370917 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2c564a-a7a5-4f25-a063-d0972f176674 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:56.377437 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5aec83-d9a8-4b68-8e61-1107c8c50c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:56.378464 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5aec83-d9a8-4b68-8e61-1107c8c50c55 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:56.378824 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5aec83-d9a8-4b68-8e61-1107c8c50c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:56.379163 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5aec83-d9a8-4b68-8e61-1107c8c50c55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:56.379554 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 954/1889] 10.222.0.36 () {60 vars in 1152 bytes} [Fri Jun 24 22:39:56 2022] POST /identity/v3/projects => generated 373 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:39:56.380990 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fee7e7-35eb-4ced-bd0c-7efe167f0da7 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:56.381170 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5aec83-d9a8-4b68-8e61-1107c8c50c55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:56.383978 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5aec83-d9a8-4b68-8e61-1107c8c50c55 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:56.403721 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 936/1890] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:39:56 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 22:39:56.407639 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5aec83-d9a8-4b68-8e61-1107c8c50c55 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:56.424081 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5aec83-d9a8-4b68-8e61-1107c8c50c55 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:56.503664 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fee7e7-35eb-4ced-bd0c-7efe167f0da7 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:56.510510 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9354db2-fd52-4459-ba88-9dd8b7df4bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:56.511374 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9354db2-fd52-4459-ba88-9dd8b7df4bc9 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:56.512056 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9354db2-fd52-4459-ba88-9dd8b7df4bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:56.512363 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9354db2-fd52-4459-ba88-9dd8b7df4bc9 admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:56.513196 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9354db2-fd52-4459-ba88-9dd8b7df4bc9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:56.515204 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9354db2-fd52-4459-ba88-9dd8b7df4bc9 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:56.547667 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 955/1891] 10.222.0.36 () {60 vars in 1143 bytes} [Fri Jun 24 22:39:56 2022] POST /identity/v3/users => generated 287 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:39:56.547848 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705b393f-99e8-4e7f-ab80-e07d7bef18bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:56.547848 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705b393f-99e8-4e7f-ab80-e07d7bef18bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:56.547848 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705b393f-99e8-4e7f-ab80-e07d7bef18bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:56.547848 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705b393f-99e8-4e7f-ab80-e07d7bef18bb admin admin] PATH_INFO: `/v3/projects/a668174e78924a4399dcd46f3da0ab84/users/8e228712b57a48ab82eca668c21444f2/roles/1928787bfcc745419829cd315900ac44` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:56.549417 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9354db2-fd52-4459-ba88-9dd8b7df4bc9 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:56.550947 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:39:56.568657 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705b393f-99e8-4e7f-ab80-e07d7bef18bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=a668174e78924a4399dcd46f3da0ab84, user_id=8e228712b57a48ab82eca668c21444f2, role_id=1928787bfcc745419829cd315900ac44)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:56.573373 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705b393f-99e8-4e7f-ab80-e07d7bef18bb admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:56.579806 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9354db2-fd52-4459-ba88-9dd8b7df4bc9 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:56.591119 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af4529e-2c4d-48b2-a6f1-94d0b69dd3da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:56.595505 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af4529e-2c4d-48b2-a6f1-94d0b69dd3da admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:56.595505 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af4529e-2c4d-48b2-a6f1-94d0b69dd3da admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:56.595505 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af4529e-2c4d-48b2-a6f1-94d0b69dd3da admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:56.595859 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af4529e-2c4d-48b2-a6f1-94d0b69dd3da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:56.599789 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af4529e-2c4d-48b2-a6f1-94d0b69dd3da admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:56.602169 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 937/1892] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 22:39:56 2022] PUT /identity/v3/projects/a668174e78924a4399dcd46f3da0ab84/users/8e228712b57a48ab82eca668c21444f2/roles/1928787bfcc745419829cd315900ac44 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 22:39:56.615627 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 956/1893] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:39:56 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:39:56.616870 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da456bb3-95d0-4a81-a80f-1eb3a7976379 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:56.617173 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da456bb3-95d0-4a81-a80f-1eb3a7976379 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:56.617458 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da456bb3-95d0-4a81-a80f-1eb3a7976379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:56.627114 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af4529e-2c4d-48b2-a6f1-94d0b69dd3da admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:56.657248 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af4529e-2c4d-48b2-a6f1-94d0b69dd3da admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:56.685275 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-da456bb3-95d0-4a81-a80f-1eb3a7976379 None None] MFA Rules not processed for user `8e228712b57a48ab82eca668c21444f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:39:56.686506 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-da456bb3-95d0-4a81-a80f-1eb3a7976379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:56.750249 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:39:56.800001 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3280b9-152b-4270-9a46-5bce8e0e8a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:56.800911 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3280b9-152b-4270-9a46-5bce8e0e8a53 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:56.801332 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3280b9-152b-4270-9a46-5bce8e0e8a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:56.801902 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3280b9-152b-4270-9a46-5bce8e0e8a53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:56.803275 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3280b9-152b-4270-9a46-5bce8e0e8a53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:56.804968 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3280b9-152b-4270-9a46-5bce8e0e8a53 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:56.821132 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 938/1894] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:39:56 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:39:56.827100 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 957/1895] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:39:56 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:39:56.828464 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da456bb3-95d0-4a81-a80f-1eb3a7976379 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:56.830258 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3280b9-152b-4270-9a46-5bce8e0e8a53 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:56.841874 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da456bb3-95d0-4a81-a80f-1eb3a7976379 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:56.846719 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfdabbd-17f2-4898-80b7-97ed727b9d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:56.847404 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfdabbd-17f2-4898-80b7-97ed727b9d61 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:56.847678 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfdabbd-17f2-4898-80b7-97ed727b9d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:56.847948 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfdabbd-17f2-4898-80b7-97ed727b9d61 admin admin] PATH_INFO: `/v3/projects/396ddd20fa724fbb92d868b87f7b916b/users/bec04c8b9cc54a45b115156380a79b33/roles/1928787bfcc745419829cd315900ac44` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:56.865217 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfdabbd-17f2-4898-80b7-97ed727b9d61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=396ddd20fa724fbb92d868b87f7b916b, user_id=bec04c8b9cc54a45b115156380a79b33, role_id=1928787bfcc745419829cd315900ac44)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:56.868217 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfdabbd-17f2-4898-80b7-97ed727b9d61 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:56.883937 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 939/1896] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 22:39:56 2022] PUT /identity/v3/projects/396ddd20fa724fbb92d868b87f7b916b/users/bec04c8b9cc54a45b115156380a79b33/roles/1928787bfcc745419829cd315900ac44 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:39:56.894134 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d2404b-48b6-451e-9686-93984043d399 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:56.894407 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d2404b-48b6-451e-9686-93984043d399 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:56.894663 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d2404b-48b6-451e-9686-93984043d399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:56.901114 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3280b9-152b-4270-9a46-5bce8e0e8a53 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:56.921718 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-80d2404b-48b6-451e-9686-93984043d399 None None] MFA Rules not processed for user `bec04c8b9cc54a45b115156380a79b33`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:39:56.923161 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-80d2404b-48b6-451e-9686-93984043d399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:56.961819 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea0872b-01a9-4aee-b911-e8a3df5228cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a747e2a5684843a6ee9e3480badac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:56.962587 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0872b-01a9-4aee-b911-e8a3df5228cb service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:56.962943 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0872b-01a9-4aee-b911-e8a3df5228cb service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:56.963317 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0872b-01a9-4aee-b911-e8a3df5228cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:57.010247 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 940/1897] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:39:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 22:39:57.015240 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d2404b-48b6-451e-9686-93984043d399 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:57.040983 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea0872b-01a9-4aee-b911-e8a3df5228cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:57.043425 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea0872b-01a9-4aee-b911-e8a3df5228cb service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:57.060927 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 958/1898] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:39:56 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:39:57.084821 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:39:57.086004 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea0872b-01a9-4aee-b911-e8a3df5228cb service cinder] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:57.120615 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d2404b-48b6-451e-9686-93984043d399 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:57.127343 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d9a6ef-6a39-49ff-97dc-dbe7105d46d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:57.128351 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d9a6ef-6a39-49ff-97dc-dbe7105d46d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:57.128715 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d9a6ef-6a39-49ff-97dc-dbe7105d46d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:57.129003 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d9a6ef-6a39-49ff-97dc-dbe7105d46d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:57.129715 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d9a6ef-6a39-49ff-97dc-dbe7105d46d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:57.131740 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d9a6ef-6a39-49ff-97dc-dbe7105d46d4 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:57.157586 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:39:57.168079 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 941/1899] 10.222.0.36 () {60 vars in 1152 bytes} [Fri Jun 24 22:39:57 2022] POST /identity/v3/projects => generated 373 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:39:57.172399 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d9a6ef-6a39-49ff-97dc-dbe7105d46d4 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:57.179883 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea0872b-01a9-4aee-b911-e8a3df5228cb service cinder] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:57.260216 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b806e9b-2341-4303-9958-68c492dbc427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:57.261447 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b806e9b-2341-4303-9958-68c492dbc427 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:57.261967 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b806e9b-2341-4303-9958-68c492dbc427 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:57.262294 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b806e9b-2341-4303-9958-68c492dbc427 admin admin] PATH_INFO: `/v3/users/8e228712b57a48ab82eca668c21444f2` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:57.263948 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b806e9b-2341-4303-9958-68c492dbc427 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e228712b57a48ab82eca668c21444f2)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:57.266678 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b806e9b-2341-4303-9958-68c492dbc427 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:57.270353 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d9a6ef-6a39-49ff-97dc-dbe7105d46d4 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:57.276223 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6cf511-ff31-4099-8e47-65d98cc6632f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:57.277224 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6cf511-ff31-4099-8e47-65d98cc6632f admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:57.277747 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6cf511-ff31-4099-8e47-65d98cc6632f admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:57.278360 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6cf511-ff31-4099-8e47-65d98cc6632f admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:57.279571 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6cf511-ff31-4099-8e47-65d98cc6632f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:57.281874 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6cf511-ff31-4099-8e47-65d98cc6632f admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:57.314970 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 942/1900] 10.222.0.36 () {60 vars in 1143 bytes} [Fri Jun 24 22:39:57 2022] POST /identity/v3/users => generated 293 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:39:57.320054 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6cf511-ff31-4099-8e47-65d98cc6632f admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:57.333328 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6cf511-ff31-4099-8e47-65d98cc6632f admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:57.338231 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57f2f71-90c8-4a32-ae2f-8932ca6681c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:57.338910 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f2f71-90c8-4a32-ae2f-8932ca6681c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:57.339270 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f2f71-90c8-4a32-ae2f-8932ca6681c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:57.339533 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f2f71-90c8-4a32-ae2f-8932ca6681c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:57.340444 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57f2f71-90c8-4a32-ae2f-8932ca6681c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:57.349170 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57f2f71-90c8-4a32-ae2f-8932ca6681c8 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:57.352748 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-8b806e9b-2341-4303-9958-68c492dbc427 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e228712b57a48ab82eca668c21444f2'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:57.367873 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-8b806e9b-2341-4303-9958-68c492dbc427 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e228712b57a48ab82eca668c21444f2'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:57.368970 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-8b806e9b-2341-4303-9958-68c492dbc427 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e228712b57a48ab82eca668c21444f2'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:57.369707 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-8b806e9b-2341-4303-9958-68c492dbc427 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e228712b57a48ab82eca668c21444f2'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:57.375689 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 943/1901] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:39:57 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 22:39:57.379146 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57f2f71-90c8-4a32-ae2f-8932ca6681c8 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:57.382488 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-f57f2f71-90c8-4a32-ae2f-8932ca6681c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:57.388959 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-8b806e9b-2341-4303-9958-68c492dbc427 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e228712b57a48ab82eca668c21444f2'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:57.395037 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57f2f71-90c8-4a32-ae2f-8932ca6681c8 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:57.400335 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208809ab-33be-48a3-bb17-a8cbe7ea9374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:57.401320 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208809ab-33be-48a3-bb17-a8cbe7ea9374 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:57.401915 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208809ab-33be-48a3-bb17-a8cbe7ea9374 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:57.402262 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208809ab-33be-48a3-bb17-a8cbe7ea9374 admin admin] PATH_INFO: `/v3/projects/1b7e68c277d740d2b3e6c23d5b4adcea/users/d1d548ade8114e2393b34c14f36717ce/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:57.415778 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 959/1902] 10.222.0.36 () {58 vars in 1223 bytes} [Fri Jun 24 22:39:57 2022] DELETE /identity/v3/users/8e228712b57a48ab82eca668c21444f2 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 22:39:57.420111 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce7e9f-5401-48c5-99f8-a456498a58b4 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:57.423435 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce7e9f-5401-48c5-99f8-a456498a58b4 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:57.423760 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce7e9f-5401-48c5-99f8-a456498a58b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:57.428977 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208809ab-33be-48a3-bb17-a8cbe7ea9374 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b7e68c277d740d2b3e6c23d5b4adcea, user_id=d1d548ade8114e2393b34c14f36717ce, role_id=1a1c43cc97a0407eb7a7c7a1333a9d4a)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:57.432796 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208809ab-33be-48a3-bb17-a8cbe7ea9374 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:57.444876 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-3fce7e9f-5401-48c5-99f8-a456498a58b4 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:39:57.446095 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-3fce7e9f-5401-48c5-99f8-a456498a58b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:57.452682 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 944/1903] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 22:39:57 2022] PUT /identity/v3/projects/1b7e68c277d740d2b3e6c23d5b4adcea/users/d1d548ade8114e2393b34c14f36717ce/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 22:39:57.457349 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208809ab-33be-48a3-bb17-a8cbe7ea9374 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:57.538785 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208809ab-33be-48a3-bb17-a8cbe7ea9374 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:57.543692 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574cf819-83c0-4e46-853b-1be00a6b68aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:57.544493 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574cf819-83c0-4e46-853b-1be00a6b68aa admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:57.544843 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574cf819-83c0-4e46-853b-1be00a6b68aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:57.545357 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574cf819-83c0-4e46-853b-1be00a6b68aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:57.546216 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574cf819-83c0-4e46-853b-1be00a6b68aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:57.548110 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574cf819-83c0-4e46-853b-1be00a6b68aa admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:57.563199 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 945/1904] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:39:57 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 22:39:57.566242 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574cf819-83c0-4e46-853b-1be00a6b68aa admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:57.579294 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574cf819-83c0-4e46-853b-1be00a6b68aa admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:57.585812 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3ace67-fb6a-4de5-805c-093096119bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:57.587635 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3ace67-fb6a-4de5-805c-093096119bc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:57.588831 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3ace67-fb6a-4de5-805c-093096119bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:57.589618 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3ace67-fb6a-4de5-805c-093096119bc6 admin admin] PATH_INFO: `/v3/projects/1b7e68c277d740d2b3e6c23d5b4adcea/users/d1d548ade8114e2393b34c14f36717ce/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:57.594102 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3ace67-fb6a-4de5-805c-093096119bc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b7e68c277d740d2b3e6c23d5b4adcea, user_id=d1d548ade8114e2393b34c14f36717ce, role_id=1a1c43cc97a0407eb7a7c7a1333a9d4a)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:57.597382 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3ace67-fb6a-4de5-805c-093096119bc6 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:57.611927 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 946/1905] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 22:39:57 2022] PUT /identity/v3/projects/1b7e68c277d740d2b3e6c23d5b4adcea/users/d1d548ade8114e2393b34c14f36717ce/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:39:57.623674 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cffaa7-6f0f-4a80-a989-3fde032d8447 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:57.623962 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cffaa7-6f0f-4a80-a989-3fde032d8447 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:57.624241 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cffaa7-6f0f-4a80-a989-3fde032d8447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:57.632674 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:39:57.656291 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 960/1906] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:39:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:39:57.656496 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-c2cffaa7-6f0f-4a80-a989-3fde032d8447 None None] MFA Rules not processed for user `d1d548ade8114e2393b34c14f36717ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:39:57.657816 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-c2cffaa7-6f0f-4a80-a989-3fde032d8447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:57.665980 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fce7e9f-5401-48c5-99f8-a456498a58b4 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:57.667406 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-3fce7e9f-5401-48c5-99f8-a456498a58b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:57.686753 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:39:57.740786 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fce7e9f-5401-48c5-99f8-a456498a58b4 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:57.742821 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 947/1907] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:39:57 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:39:57.756151 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cffaa7-6f0f-4a80-a989-3fde032d8447 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:57.757842 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-c2cffaa7-6f0f-4a80-a989-3fde032d8447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:57.810773 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c860e3-bb76-4156-93e7-7f99ad53e9cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:57.811476 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c860e3-bb76-4156-93e7-7f99ad53e9cb service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:57.811761 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c860e3-bb76-4156-93e7-7f99ad53e9cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:57.812036 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c860e3-bb76-4156-93e7-7f99ad53e9cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:57.855521 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cffaa7-6f0f-4a80-a989-3fde032d8447 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:57.860761 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff4d8a6-ee1d-4ac6-9dff-2c6341a8b384 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a747e2a5684843a6ee9e3480badac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:57.861432 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff4d8a6-ee1d-4ac6-9dff-2c6341a8b384 service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:57.861851 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff4d8a6-ee1d-4ac6-9dff-2c6341a8b384 service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:57.862274 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff4d8a6-ee1d-4ac6-9dff-2c6341a8b384 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:57.875293 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c860e3-bb76-4156-93e7-7f99ad53e9cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:57.877100 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c860e3-bb76-4156-93e7-7f99ad53e9cb service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:57.881446 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff4d8a6-ee1d-4ac6-9dff-2c6341a8b384 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:57.883049 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff4d8a6-ee1d-4ac6-9dff-2c6341a8b384 service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:57.888162 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 961/1908] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:39:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 22:39:57.913896 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 948/1909] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:39:57 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 22:39:58.234277 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c860e3-bb76-4156-93e7-7f99ad53e9cb service neutron] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:58.236605 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-a0c860e3-bb76-4156-93e7-7f99ad53e9cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:58.258773 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c860e3-bb76-4156-93e7-7f99ad53e9cb service neutron] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:58.266969 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f1272a-c317-4d9c-aa7b-95a3de9f1241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:58.268188 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f1272a-c317-4d9c-aa7b-95a3de9f1241 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:58.268604 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f1272a-c317-4d9c-aa7b-95a3de9f1241 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:58.268999 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f1272a-c317-4d9c-aa7b-95a3de9f1241 admin admin] PATH_INFO: `/v3/projects/a668174e78924a4399dcd46f3da0ab84` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:58.270306 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f1272a-c317-4d9c-aa7b-95a3de9f1241 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a668174e78924a4399dcd46f3da0ab84)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:58.272851 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f1272a-c317-4d9c-aa7b-95a3de9f1241 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:58.328898 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-67f1272a-c317-4d9c-aa7b-95a3de9f1241 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a668174e78924a4399dcd46f3da0ab84', 'request_id': 'req-67f1272a-c317-4d9c-aa7b-95a3de9f1241'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:58.341710 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-67f1272a-c317-4d9c-aa7b-95a3de9f1241 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a668174e78924a4399dcd46f3da0ab84', 'request_id': 'req-67f1272a-c317-4d9c-aa7b-95a3de9f1241'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:58.355294 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-67f1272a-c317-4d9c-aa7b-95a3de9f1241 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a668174e78924a4399dcd46f3da0ab84', 'request_id': 'req-67f1272a-c317-4d9c-aa7b-95a3de9f1241'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:58.369395 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-67f1272a-c317-4d9c-aa7b-95a3de9f1241 admin admin] The token cache is being invalidate because project a668174e78924a4399dcd46f3da0ab84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 22:39:58.369755 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-67f1272a-c317-4d9c-aa7b-95a3de9f1241 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:58.371104 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-67f1272a-c317-4d9c-aa7b-95a3de9f1241 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:58.372716 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 962/1910] 10.222.0.36 () {58 vars in 1232 bytes} [Fri Jun 24 22:39:58 2022] DELETE /identity/v3/projects/a668174e78924a4399dcd46f3da0ab84 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:39:58.378403 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce58ec1-dcbd-43ad-8b72-35ccf3a9b2ac None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:58.378917 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce58ec1-dcbd-43ad-8b72-35ccf3a9b2ac None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:58.378917 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce58ec1-dcbd-43ad-8b72-35ccf3a9b2ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:58.397797 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-5ce58ec1-dcbd-43ad-8b72-35ccf3a9b2ac None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:39:58.399072 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-5ce58ec1-dcbd-43ad-8b72-35ccf3a9b2ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:58.482925 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 949/1911] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:39:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:39:58.491554 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23b922b-6073-4636-b639-893a8f8a0a4a None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:58.494971 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23b922b-6073-4636-b639-893a8f8a0a4a None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:58.495278 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23b922b-6073-4636-b639-893a8f8a0a4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:58.503939 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:39:58.521765 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-c23b922b-6073-4636-b639-893a8f8a0a4a None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:39:58.522983 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-c23b922b-6073-4636-b639-893a8f8a0a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:58.532608 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 963/1912] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:39:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:39:58.537147 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce58ec1-dcbd-43ad-8b72-35ccf3a9b2ac None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:58.559163 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23b922b-6073-4636-b639-893a8f8a0a4a None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:58.560737 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-c23b922b-6073-4636-b639-893a8f8a0a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:58.562922 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce58ec1-dcbd-43ad-8b72-35ccf3a9b2ac None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:58.568049 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8469b110-7a97-45fe-b723-a2a73df6c26f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:58.568815 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8469b110-7a97-45fe-b723-a2a73df6c26f admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:58.569114 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8469b110-7a97-45fe-b723-a2a73df6c26f admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:58.569366 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8469b110-7a97-45fe-b723-a2a73df6c26f admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:58.570148 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8469b110-7a97-45fe-b723-a2a73df6c26f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:39:58.570490 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8469b110-7a97-45fe-b723-a2a73df6c26f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:58.572165 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8469b110-7a97-45fe-b723-a2a73df6c26f admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:58.575568 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23b922b-6073-4636-b639-893a8f8a0a4a None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:58.580514 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a13715-a3af-477d-89f9-05ae8da7e893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:58.581927 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a13715-a3af-477d-89f9-05ae8da7e893 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:58.582040 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a13715-a3af-477d-89f9-05ae8da7e893 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:58.582232 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a13715-a3af-477d-89f9-05ae8da7e893 admin admin] PATH_INFO: `/v3/users/bec04c8b9cc54a45b115156380a79b33` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:58.583537 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a13715-a3af-477d-89f9-05ae8da7e893 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bec04c8b9cc54a45b115156380a79b33)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:58.585395 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a13715-a3af-477d-89f9-05ae8da7e893 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:58.587310 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 950/1913] 10.222.0.36 () {58 vars in 1152 bytes} [Fri Jun 24 22:39:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:39:58.590775 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8469b110-7a97-45fe-b723-a2a73df6c26f admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:58.603356 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8469b110-7a97-45fe-b723-a2a73df6c26f admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:58.608792 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d05524-767f-4926-9f43-d6c354a805c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:58.609628 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d05524-767f-4926-9f43-d6c354a805c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:58.610052 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d05524-767f-4926-9f43-d6c354a805c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:58.610835 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d05524-767f-4926-9f43-d6c354a805c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:58.611860 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d05524-767f-4926-9f43-d6c354a805c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:58.614273 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d05524-767f-4926-9f43-d6c354a805c2 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:58.639609 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:39:58.648661 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-93a13715-a3af-477d-89f9-05ae8da7e893 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bec04c8b9cc54a45b115156380a79b33'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:58.655391 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 951/1914] 10.222.0.36 () {60 vars in 1152 bytes} [Fri Jun 24 22:39:58 2022] POST /identity/v3/projects => generated 397 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 22:39:58.659783 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d05524-767f-4926-9f43-d6c354a805c2 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:58.662166 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-93a13715-a3af-477d-89f9-05ae8da7e893 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bec04c8b9cc54a45b115156380a79b33'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:58.663074 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-93a13715-a3af-477d-89f9-05ae8da7e893 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bec04c8b9cc54a45b115156380a79b33'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:58.663936 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-93a13715-a3af-477d-89f9-05ae8da7e893 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bec04c8b9cc54a45b115156380a79b33'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:58.680553 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-93a13715-a3af-477d-89f9-05ae8da7e893 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bec04c8b9cc54a45b115156380a79b33'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:58.698235 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 964/1915] 10.222.0.36 () {58 vars in 1223 bytes} [Fri Jun 24 22:39:58 2022] DELETE /identity/v3/users/bec04c8b9cc54a45b115156380a79b33 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:39:58.702683 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f84ddbd-d928-4957-ab28-2f29db648948 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:58.703048 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f84ddbd-d928-4957-ab28-2f29db648948 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:58.703361 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f84ddbd-d928-4957-ab28-2f29db648948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:58.721225 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-5f84ddbd-d928-4957-ab28-2f29db648948 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:39:58.722600 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-5f84ddbd-d928-4957-ab28-2f29db648948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:58.726689 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d05524-767f-4926-9f43-d6c354a805c2 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:58.789380 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 965/1916] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:39:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 22:39:58.792505 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0f1b01-d275-428d-8458-66eb2f07375e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:58.793764 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0f1b01-d275-428d-8458-66eb2f07375e admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:58.793764 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0f1b01-d275-428d-8458-66eb2f07375e admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:58.800803 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0f1b01-d275-428d-8458-66eb2f07375e admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:58.800946 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f84ddbd-d928-4957-ab28-2f29db648948 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:58.801655 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0f1b01-d275-428d-8458-66eb2f07375e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:58.802273 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-5f84ddbd-d928-4957-ab28-2f29db648948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:58.803600 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0f1b01-d275-428d-8458-66eb2f07375e admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:58.838030 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 952/1917] 10.222.0.36 () {60 vars in 1143 bytes} [Fri Jun 24 22:39:58 2022] POST /identity/v3/users => generated 299 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 22:39:58.839485 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0f1b01-d275-428d-8458-66eb2f07375e admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:58.841350 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-be0f1b01-d275-428d-8458-66eb2f07375e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:58.854273 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0f1b01-d275-428d-8458-66eb2f07375e admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:58.860035 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1735d6-2912-4dd0-a3ee-c66e91a4513c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:58.860728 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1735d6-2912-4dd0-a3ee-c66e91a4513c admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:58.861134 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1735d6-2912-4dd0-a3ee-c66e91a4513c admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:58.861412 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1735d6-2912-4dd0-a3ee-c66e91a4513c admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:58.862081 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f84ddbd-d928-4957-ab28-2f29db648948 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:58.862405 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1735d6-2912-4dd0-a3ee-c66e91a4513c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:58.864308 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1735d6-2912-4dd0-a3ee-c66e91a4513c admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:58.867506 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620332ff-4e22-4b40-b0c2-d8b1a359786d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:58.867506 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620332ff-4e22-4b40-b0c2-d8b1a359786d service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:58.867506 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620332ff-4e22-4b40-b0c2-d8b1a359786d service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:58.867506 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620332ff-4e22-4b40-b0c2-d8b1a359786d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:58.878209 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 953/1918] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:39:58 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:39:58.878410 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620332ff-4e22-4b40-b0c2-d8b1a359786d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:58.879886 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620332ff-4e22-4b40-b0c2-d8b1a359786d service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:58.882107 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1735d6-2912-4dd0-a3ee-c66e91a4513c admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:58.891636 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 966/1919] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:39:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 22:39:58.892253 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1735d6-2912-4dd0-a3ee-c66e91a4513c admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:58.896913 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5cfc21-b9c1-45c3-a649-3b9c4605ea72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:58.897600 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5cfc21-b9c1-45c3-a649-3b9c4605ea72 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:58.897881 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5cfc21-b9c1-45c3-a649-3b9c4605ea72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:58.898153 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5cfc21-b9c1-45c3-a649-3b9c4605ea72 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:58.898885 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5cfc21-b9c1-45c3-a649-3b9c4605ea72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:58.900548 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5cfc21-b9c1-45c3-a649-3b9c4605ea72 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:58.912563 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 954/1920] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:39:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 22:39:58.916646 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620332ff-4e22-4b40-b0c2-d8b1a359786d service neutron] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:58.928191 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620332ff-4e22-4b40-b0c2-d8b1a359786d service neutron] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:58.933601 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7cecc0-b0f4-4ea8-b7c2-56b7d721371a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:58.934810 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7cecc0-b0f4-4ea8-b7c2-56b7d721371a admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:58.935272 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7cecc0-b0f4-4ea8-b7c2-56b7d721371a admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:58.935712 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7cecc0-b0f4-4ea8-b7c2-56b7d721371a admin admin] PATH_INFO: `/v3/projects/8709d9269a83498283816268ded6a352/users/e2cdc695f9f3414981749051faa62c33/roles/1928787bfcc745419829cd315900ac44` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:58.950398 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:39:58.954763 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7cecc0-b0f4-4ea8-b7c2-56b7d721371a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8709d9269a83498283816268ded6a352, user_id=e2cdc695f9f3414981749051faa62c33, role_id=1928787bfcc745419829cd315900ac44)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:58.958758 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7cecc0-b0f4-4ea8-b7c2-56b7d721371a admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:58.976691 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 967/1921] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 22:39:58 2022] PUT /identity/v3/projects/8709d9269a83498283816268ded6a352/users/e2cdc695f9f3414981749051faa62c33/roles/1928787bfcc745419829cd315900ac44 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 22:39:58.988989 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09acced-e3c6-4200-8e47-da98c14e19a5 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:58.989282 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09acced-e3c6-4200-8e47-da98c14e19a5 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:58.989563 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09acced-e3c6-4200-8e47-da98c14e19a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:59.021755 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-b09acced-e3c6-4200-8e47-da98c14e19a5 None None] MFA Rules not processed for user `e2cdc695f9f3414981749051faa62c33`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:39:59.023154 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-b09acced-e3c6-4200-8e47-da98c14e19a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:59.091907 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:39:59.100647 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 955/1922] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:39:58 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:39:59.108228 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7cecc0-b0f4-4ea8-b7c2-56b7d721371a admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:59.110150 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-3f7cecc0-b0f4-4ea8-b7c2-56b7d721371a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:59.178154 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7cecc0-b0f4-4ea8-b7c2-56b7d721371a admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:59.182313 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d97b257-18d3-4b6d-8932-b25d4679a72c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a747e2a5684843a6ee9e3480badac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:59.183100 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d97b257-18d3-4b6d-8932-b25d4679a72c service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:59.183435 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d97b257-18d3-4b6d-8932-b25d4679a72c service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:59.183699 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d97b257-18d3-4b6d-8932-b25d4679a72c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:59.193656 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d97b257-18d3-4b6d-8932-b25d4679a72c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:59.197921 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d97b257-18d3-4b6d-8932-b25d4679a72c service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:59.199397 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09acced-e3c6-4200-8e47-da98c14e19a5 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:59.202774 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-b09acced-e3c6-4200-8e47-da98c14e19a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:39:59.208338 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 968/1923] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:39:59 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:39:59.295161 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09acced-e3c6-4200-8e47-da98c14e19a5 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:59.300903 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc014b20-d837-4cba-999c-56b219cfa262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:59.301920 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc014b20-d837-4cba-999c-56b219cfa262 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:59.302223 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc014b20-d837-4cba-999c-56b219cfa262 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:59.302488 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc014b20-d837-4cba-999c-56b219cfa262 admin admin] PATH_INFO: `/v3/projects/396ddd20fa724fbb92d868b87f7b916b` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:59.303892 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc014b20-d837-4cba-999c-56b219cfa262 admin admin] RBAC: Authorizing `identity:delete_project(project_id=396ddd20fa724fbb92d868b87f7b916b)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:59.305888 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc014b20-d837-4cba-999c-56b219cfa262 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:59.378483 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-dc014b20-d837-4cba-999c-56b219cfa262 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '396ddd20fa724fbb92d868b87f7b916b', 'request_id': 'req-dc014b20-d837-4cba-999c-56b219cfa262'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:59.385542 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-dc014b20-d837-4cba-999c-56b219cfa262 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '396ddd20fa724fbb92d868b87f7b916b', 'request_id': 'req-dc014b20-d837-4cba-999c-56b219cfa262'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:59.395737 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-dc014b20-d837-4cba-999c-56b219cfa262 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '396ddd20fa724fbb92d868b87f7b916b', 'request_id': 'req-dc014b20-d837-4cba-999c-56b219cfa262'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:59.406891 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-dc014b20-d837-4cba-999c-56b219cfa262 admin admin] The token cache is being invalidate because project 396ddd20fa724fbb92d868b87f7b916b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 22:39:59.407183 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-dc014b20-d837-4cba-999c-56b219cfa262 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:59.407869 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-dc014b20-d837-4cba-999c-56b219cfa262 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:59.410432 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 956/1924] 10.222.0.36 () {58 vars in 1232 bytes} [Fri Jun 24 22:39:59 2022] DELETE /identity/v3/projects/396ddd20fa724fbb92d868b87f7b916b => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 22:39:59.414621 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d97b257-18d3-4b6d-8932-b25d4679a72c service cinder] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:59.426869 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d97b257-18d3-4b6d-8932-b25d4679a72c service cinder] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:39:59.487909 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89999da8-f4b1-47a4-a397-57f1d8c3d54e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:39:59.488942 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89999da8-f4b1-47a4-a397-57f1d8c3d54e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:39:59.489236 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89999da8-f4b1-47a4-a397-57f1d8c3d54e admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:39:59.489588 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89999da8-f4b1-47a4-a397-57f1d8c3d54e admin admin] PATH_INFO: `/v3/users/d1d548ade8114e2393b34c14f36717ce` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:39:59.490794 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89999da8-f4b1-47a4-a397-57f1d8c3d54e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1d548ade8114e2393b34c14f36717ce)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:39:59.492786 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89999da8-f4b1-47a4-a397-57f1d8c3d54e admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:39:59.541913 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-89999da8-f4b1-47a4-a397-57f1d8c3d54e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1d548ade8114e2393b34c14f36717ce'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:59.549418 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-89999da8-f4b1-47a4-a397-57f1d8c3d54e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1d548ade8114e2393b34c14f36717ce'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:59.550254 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-89999da8-f4b1-47a4-a397-57f1d8c3d54e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1d548ade8114e2393b34c14f36717ce'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:59.550916 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-89999da8-f4b1-47a4-a397-57f1d8c3d54e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1d548ade8114e2393b34c14f36717ce'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:59.564996 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-89999da8-f4b1-47a4-a397-57f1d8c3d54e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1d548ade8114e2393b34c14f36717ce'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:39:59.588984 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 969/1925] 10.222.0.36 () {58 vars in 1223 bytes} [Fri Jun 24 22:39:59 2022] DELETE /identity/v3/users/d1d548ade8114e2393b34c14f36717ce => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:39:59.991949 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc014b20-d837-4cba-999c-56b219cfa262 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:39:59.993511 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-dc014b20-d837-4cba-999c-56b219cfa262 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:00.008719 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc014b20-d837-4cba-999c-56b219cfa262 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:00.075132 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f69104-6896-4329-ad93-0c3800985e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:00.076023 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f69104-6896-4329-ad93-0c3800985e71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:00.076306 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f69104-6896-4329-ad93-0c3800985e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:00.076579 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f69104-6896-4329-ad93-0c3800985e71 admin admin] PATH_INFO: `/v3/projects/1b7e68c277d740d2b3e6c23d5b4adcea` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:00.077952 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f69104-6896-4329-ad93-0c3800985e71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b7e68c277d740d2b3e6c23d5b4adcea)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:00.079990 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f69104-6896-4329-ad93-0c3800985e71 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:00.120134 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:40:00.135389 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-12f69104-6896-4329-ad93-0c3800985e71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b7e68c277d740d2b3e6c23d5b4adcea', 'request_id': 'req-12f69104-6896-4329-ad93-0c3800985e71'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:00.141912 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-12f69104-6896-4329-ad93-0c3800985e71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b7e68c277d740d2b3e6c23d5b4adcea', 'request_id': 'req-12f69104-6896-4329-ad93-0c3800985e71'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:00.151929 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-12f69104-6896-4329-ad93-0c3800985e71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b7e68c277d740d2b3e6c23d5b4adcea', 'request_id': 'req-12f69104-6896-4329-ad93-0c3800985e71'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:00.163442 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-12f69104-6896-4329-ad93-0c3800985e71 admin admin] The token cache is being invalidate because project 1b7e68c277d740d2b3e6c23d5b4adcea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 22:40:00.163736 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-12f69104-6896-4329-ad93-0c3800985e71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:00.164378 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-12f69104-6896-4329-ad93-0c3800985e71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:00.165967 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 957/1926] 10.222.0.36 () {58 vars in 1232 bytes} [Fri Jun 24 22:39:59 2022] DELETE /identity/v3/projects/1b7e68c277d740d2b3e6c23d5b4adcea => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:40:00.171763 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baa5aac-1dcb-49d0-877b-a0adf3701701 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:00.172346 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baa5aac-1dcb-49d0-877b-a0adf3701701 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:00.172346 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baa5aac-1dcb-49d0-877b-a0adf3701701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:00.192337 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-4baa5aac-1dcb-49d0-877b-a0adf3701701 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:40:00.193557 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-4baa5aac-1dcb-49d0-877b-a0adf3701701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:00.199275 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:40:00.296160 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 970/1927] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:40:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 22:40:00.298554 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c84ad-c982-4e28-8728-dbebd2671874 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:00.304885 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c84ad-c982-4e28-8728-dbebd2671874 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:00.305367 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c84ad-c982-4e28-8728-dbebd2671874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:00.336013 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-a40c84ad-c982-4e28-8728-dbebd2671874 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:40:00.337374 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-a40c84ad-c982-4e28-8728-dbebd2671874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:00.347652 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 958/1928] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:40:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:40:00.352326 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baa5aac-1dcb-49d0-877b-a0adf3701701 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:00.365385 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baa5aac-1dcb-49d0-877b-a0adf3701701 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:00.371482 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976c7cf2-edc5-4b04-8458-8a57af54e734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:00.372157 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c7cf2-edc5-4b04-8458-8a57af54e734 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:00.372442 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c7cf2-edc5-4b04-8458-8a57af54e734 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:00.372717 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c7cf2-edc5-4b04-8458-8a57af54e734 admin admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:00.373461 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976c7cf2-edc5-4b04-8458-8a57af54e734 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:40:00.373771 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976c7cf2-edc5-4b04-8458-8a57af54e734 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:00.375437 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976c7cf2-edc5-4b04-8458-8a57af54e734 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:00.390251 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 971/1929] 10.222.0.36 () {58 vars in 1152 bytes} [Fri Jun 24 22:40:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:40:00.396330 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40c84ad-c982-4e28-8728-dbebd2671874 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:00.408185 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40c84ad-c982-4e28-8728-dbebd2671874 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:00.413487 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99904f52-158d-4169-ac0a-a438febd6321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:00.414152 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99904f52-158d-4169-ac0a-a438febd6321 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:00.414432 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99904f52-158d-4169-ac0a-a438febd6321 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:00.415067 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99904f52-158d-4169-ac0a-a438febd6321 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:00.416182 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99904f52-158d-4169-ac0a-a438febd6321 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:00.418082 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99904f52-158d-4169-ac0a-a438febd6321 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:00.458984 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 959/1930] 10.222.0.36 () {60 vars in 1152 bytes} [Fri Jun 24 22:40:00 2022] POST /identity/v3/projects => generated 363 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:40:00.463658 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976c7cf2-edc5-4b04-8458-8a57af54e734 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:00.475038 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976c7cf2-edc5-4b04-8458-8a57af54e734 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:00.543393 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05357913-1db4-4b3c-b9e4-42118e02bcb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:00.544085 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05357913-1db4-4b3c-b9e4-42118e02bcb0 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:00.544372 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05357913-1db4-4b3c-b9e4-42118e02bcb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:00.544636 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05357913-1db4-4b3c-b9e4-42118e02bcb0 admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:00.545330 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05357913-1db4-4b3c-b9e4-42118e02bcb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:00.547380 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05357913-1db4-4b3c-b9e4-42118e02bcb0 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:00.579684 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 972/1931] 10.222.0.36 () {60 vars in 1143 bytes} [Fri Jun 24 22:40:00 2022] POST /identity/v3/users => generated 282 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:40:00.584243 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99904f52-158d-4169-ac0a-a438febd6321 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:00.596929 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99904f52-158d-4169-ac0a-a438febd6321 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:00.605891 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51769324-d0f8-477b-83b9-e26c04849e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:00.606590 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51769324-d0f8-477b-83b9-e26c04849e4f admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:00.606949 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51769324-d0f8-477b-83b9-e26c04849e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:00.607271 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51769324-d0f8-477b-83b9-e26c04849e4f admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:00.608032 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51769324-d0f8-477b-83b9-e26c04849e4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:00.609771 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51769324-d0f8-477b-83b9-e26c04849e4f admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:00.627037 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 960/1932] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:40:00 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:40:00.634151 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05357913-1db4-4b3c-b9e4-42118e02bcb0 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:00.653782 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05357913-1db4-4b3c-b9e4-42118e02bcb0 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:00.663718 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0c1de8-0d9d-4e9a-b9dc-300adac17eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:00.664558 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c1de8-0d9d-4e9a-b9dc-300adac17eaf admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:00.664935 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c1de8-0d9d-4e9a-b9dc-300adac17eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:00.665370 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c1de8-0d9d-4e9a-b9dc-300adac17eaf admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:00.666472 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0c1de8-0d9d-4e9a-b9dc-300adac17eaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:00.669167 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0c1de8-0d9d-4e9a-b9dc-300adac17eaf admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:00.686838 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 973/1933] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:40:00 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:40:00.691797 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51769324-d0f8-477b-83b9-e26c04849e4f admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:00.702818 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51769324-d0f8-477b-83b9-e26c04849e4f admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:00.711998 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dbe8b8-82e7-4d8b-8657-17c2fe2b1196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:00.712924 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dbe8b8-82e7-4d8b-8657-17c2fe2b1196 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:00.713209 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dbe8b8-82e7-4d8b-8657-17c2fe2b1196 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:00.713480 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dbe8b8-82e7-4d8b-8657-17c2fe2b1196 admin admin] PATH_INFO: `/v3/projects/d1c764149a934c9eb65c1c9d23196e97/users/bcaf7610f3fc468ba41a01a3cbe83d2e/roles/1928787bfcc745419829cd315900ac44` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:00.736407 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dbe8b8-82e7-4d8b-8657-17c2fe2b1196 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1c764149a934c9eb65c1c9d23196e97, user_id=bcaf7610f3fc468ba41a01a3cbe83d2e, role_id=1928787bfcc745419829cd315900ac44)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:00.741683 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dbe8b8-82e7-4d8b-8657-17c2fe2b1196 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:00.762288 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 961/1934] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 22:40:00 2022] PUT /identity/v3/projects/d1c764149a934c9eb65c1c9d23196e97/users/bcaf7610f3fc468ba41a01a3cbe83d2e/roles/1928787bfcc745419829cd315900ac44 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:40:00.775424 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f430cc05-636b-4982-863d-d3103919c582 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:00.775714 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f430cc05-636b-4982-863d-d3103919c582 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:00.775993 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f430cc05-636b-4982-863d-d3103919c582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:00.809735 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-f430cc05-636b-4982-863d-d3103919c582 None None] MFA Rules not processed for user `bcaf7610f3fc468ba41a01a3cbe83d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:40:00.810969 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-f430cc05-636b-4982-863d-d3103919c582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:00.883816 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 974/1935] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:40:00 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:40:00.888530 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dbe8b8-82e7-4d8b-8657-17c2fe2b1196 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:00.965158 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dbe8b8-82e7-4d8b-8657-17c2fe2b1196 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:00.974517 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac176d1-ef5e-46bb-8a75-d68411a27851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:00.975232 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac176d1-ef5e-46bb-8a75-d68411a27851 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:00.975540 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac176d1-ef5e-46bb-8a75-d68411a27851 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:00.975823 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac176d1-ef5e-46bb-8a75-d68411a27851 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:00.976549 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac176d1-ef5e-46bb-8a75-d68411a27851 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:00.978526 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac176d1-ef5e-46bb-8a75-d68411a27851 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:01.018885 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 962/1936] 10.222.0.36 () {60 vars in 1152 bytes} [Fri Jun 24 22:40:00 2022] POST /identity/v3/projects => generated 361 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:40:01.020707 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f430cc05-636b-4982-863d-d3103919c582 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:01.039902 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f430cc05-636b-4982-863d-d3103919c582 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:01.046064 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:40:01.112167 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69412d4a-603c-48a7-87d6-83495fa84c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:01.113130 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69412d4a-603c-48a7-87d6-83495fa84c9b admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:01.113420 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69412d4a-603c-48a7-87d6-83495fa84c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:01.113699 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69412d4a-603c-48a7-87d6-83495fa84c9b admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:01.114413 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69412d4a-603c-48a7-87d6-83495fa84c9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:01.116481 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69412d4a-603c-48a7-87d6-83495fa84c9b admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:01.151094 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 975/1937] 10.222.0.36 () {60 vars in 1143 bytes} [Fri Jun 24 22:40:01 2022] POST /identity/v3/users => generated 287 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:40:01.152413 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac176d1-ef5e-46bb-8a75-d68411a27851 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:01.164812 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac176d1-ef5e-46bb-8a75-d68411a27851 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:01.171701 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c148ef-d897-49be-b9b2-7b63832accf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:01.172816 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c148ef-d897-49be-b9b2-7b63832accf1 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:01.173129 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c148ef-d897-49be-b9b2-7b63832accf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:01.173406 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c148ef-d897-49be-b9b2-7b63832accf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:01.174250 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c148ef-d897-49be-b9b2-7b63832accf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:01.177451 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c148ef-d897-49be-b9b2-7b63832accf1 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:01.193887 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 963/1938] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:40:01 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 22:40:01.200291 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69412d4a-603c-48a7-87d6-83495fa84c9b admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:01.215289 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69412d4a-603c-48a7-87d6-83495fa84c9b admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:01.220256 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e18e462-de24-4298-8941-dbdf0c3c4f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:01.221250 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e18e462-de24-4298-8941-dbdf0c3c4f4e admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:01.221885 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e18e462-de24-4298-8941-dbdf0c3c4f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:01.222153 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e18e462-de24-4298-8941-dbdf0c3c4f4e admin admin] PATH_INFO: `/v3/projects/9d069cfce28843108a6c96753f336b15/users/a887e1eafdc3413bbdada8c809792620/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:01.242556 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e18e462-de24-4298-8941-dbdf0c3c4f4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d069cfce28843108a6c96753f336b15, user_id=a887e1eafdc3413bbdada8c809792620, role_id=1a1c43cc97a0407eb7a7c7a1333a9d4a)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:01.245738 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e18e462-de24-4298-8941-dbdf0c3c4f4e admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:01.270200 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 976/1939] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 22:40:01 2022] PUT /identity/v3/projects/9d069cfce28843108a6c96753f336b15/users/a887e1eafdc3413bbdada8c809792620/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:40:01.274523 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c148ef-d897-49be-b9b2-7b63832accf1 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:01.290769 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c148ef-d897-49be-b9b2-7b63832accf1 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:01.325611 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:40:01.356337 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc562bf6-0208-44f8-8600-5d75fe001045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:01.357016 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc562bf6-0208-44f8-8600-5d75fe001045 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:01.357359 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc562bf6-0208-44f8-8600-5d75fe001045 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:01.357565 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc562bf6-0208-44f8-8600-5d75fe001045 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:01.358306 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc562bf6-0208-44f8-8600-5d75fe001045 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:01.360036 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc562bf6-0208-44f8-8600-5d75fe001045 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:01.370604 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 964/1940] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:40:01 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:40:01.374657 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e18e462-de24-4298-8941-dbdf0c3c4f4e admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:01.386142 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e18e462-de24-4298-8941-dbdf0c3c4f4e admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:01.390672 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492b063d-7b83-4c40-81a0-92eba7bec5c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:01.391598 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492b063d-7b83-4c40-81a0-92eba7bec5c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:01.391880 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492b063d-7b83-4c40-81a0-92eba7bec5c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:01.392151 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492b063d-7b83-4c40-81a0-92eba7bec5c1 admin admin] PATH_INFO: `/v3/projects/9d069cfce28843108a6c96753f336b15/users/a887e1eafdc3413bbdada8c809792620/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:01.394271 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492b063d-7b83-4c40-81a0-92eba7bec5c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d069cfce28843108a6c96753f336b15, user_id=a887e1eafdc3413bbdada8c809792620, role_id=1a1c43cc97a0407eb7a7c7a1333a9d4a)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:01.396974 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492b063d-7b83-4c40-81a0-92eba7bec5c1 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:01.407205 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 977/1941] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 22:40:01 2022] PUT /identity/v3/projects/9d069cfce28843108a6c96753f336b15/users/a887e1eafdc3413bbdada8c809792620/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:40:01.417638 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faebf040-d1b9-4aef-a2b9-01e94f490fae None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:01.418172 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faebf040-d1b9-4aef-a2b9-01e94f490fae None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:01.418172 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faebf040-d1b9-4aef-a2b9-01e94f490fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:01.446044 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-faebf040-d1b9-4aef-a2b9-01e94f490fae None None] MFA Rules not processed for user `a887e1eafdc3413bbdada8c809792620`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:40:01.447317 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-faebf040-d1b9-4aef-a2b9-01e94f490fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:01.522809 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 965/1942] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:40:01 2022] POST /identity/v3/auth/tokens => generated 3295 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:40:01.537244 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492b063d-7b83-4c40-81a0-92eba7bec5c1 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:01.539228 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-492b063d-7b83-4c40-81a0-92eba7bec5c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:01.600462 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492b063d-7b83-4c40-81a0-92eba7bec5c1 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:01.604191 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5365deb6-b032-4f30-b00f-3f5cffe32ee1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a747e2a5684843a6ee9e3480badac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:01.604849 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5365deb6-b032-4f30-b00f-3f5cffe32ee1 service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:01.605132 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5365deb6-b032-4f30-b00f-3f5cffe32ee1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:01.605396 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5365deb6-b032-4f30-b00f-3f5cffe32ee1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:01.615528 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5365deb6-b032-4f30-b00f-3f5cffe32ee1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:01.617009 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5365deb6-b032-4f30-b00f-3f5cffe32ee1 service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:01.627484 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 978/1943] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:40:01 2022] GET /identity/v3/auth/tokens => generated 3295 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:40:01.703217 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faebf040-d1b9-4aef-a2b9-01e94f490fae None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:01.713415 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faebf040-d1b9-4aef-a2b9-01e94f490fae None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:01.717446 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dde7c2a-c5cc-4d09-b22e-e24febcb68d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a747e2a5684843a6ee9e3480badac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:01.718188 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dde7c2a-c5cc-4d09-b22e-e24febcb68d6 service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:01.718546 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dde7c2a-c5cc-4d09-b22e-e24febcb68d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:01.718892 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dde7c2a-c5cc-4d09-b22e-e24febcb68d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:01.787589 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dde7c2a-c5cc-4d09-b22e-e24febcb68d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:01.789045 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dde7c2a-c5cc-4d09-b22e-e24febcb68d6 service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:01.798721 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 966/1944] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:40:01 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:40:04.593633 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5365deb6-b032-4f30-b00f-3f5cffe32ee1 service cinder] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:04.665415 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5365deb6-b032-4f30-b00f-3f5cffe32ee1 service cinder] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:04.670003 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40931c7-2d37-49c4-8aae-c3552a95f4d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:04.671004 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40931c7-2d37-49c4-8aae-c3552a95f4d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:04.671311 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40931c7-2d37-49c4-8aae-c3552a95f4d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:04.671654 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40931c7-2d37-49c4-8aae-c3552a95f4d4 admin admin] PATH_INFO: `/v3/users/bcaf7610f3fc468ba41a01a3cbe83d2e` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:04.673427 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40931c7-2d37-49c4-8aae-c3552a95f4d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcaf7610f3fc468ba41a01a3cbe83d2e)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:04.675476 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40931c7-2d37-49c4-8aae-c3552a95f4d4 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:04.678437 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:40:04.730128 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-e40931c7-2d37-49c4-8aae-c3552a95f4d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcaf7610f3fc468ba41a01a3cbe83d2e'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:04.737224 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-e40931c7-2d37-49c4-8aae-c3552a95f4d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcaf7610f3fc468ba41a01a3cbe83d2e'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:04.737963 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-e40931c7-2d37-49c4-8aae-c3552a95f4d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcaf7610f3fc468ba41a01a3cbe83d2e'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:04.738684 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-e40931c7-2d37-49c4-8aae-c3552a95f4d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcaf7610f3fc468ba41a01a3cbe83d2e'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:04.752795 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-e40931c7-2d37-49c4-8aae-c3552a95f4d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcaf7610f3fc468ba41a01a3cbe83d2e'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:04.772123 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 979/1945] 10.222.0.36 () {58 vars in 1223 bytes} [Fri Jun 24 22:40:04 2022] DELETE /identity/v3/users/bcaf7610f3fc468ba41a01a3cbe83d2e => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:40:04.776961 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0161635-6460-4692-9f73-3fddbba3f82a None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:04.777486 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0161635-6460-4692-9f73-3fddbba3f82a None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:04.777673 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0161635-6460-4692-9f73-3fddbba3f82a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:04.795878 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-f0161635-6460-4692-9f73-3fddbba3f82a None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:40:04.798519 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-f0161635-6460-4692-9f73-3fddbba3f82a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:04.847317 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:40:04.862156 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 967/1946] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:40:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 22:40:04.872381 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40931c7-2d37-49c4-8aae-c3552a95f4d4 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:04.873922 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-e40931c7-2d37-49c4-8aae-c3552a95f4d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:04.943857 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40931c7-2d37-49c4-8aae-c3552a95f4d4 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:04.947607 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e4e0e0-af01-440e-877f-dbb0f5b19f3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:04.948265 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e4e0e0-af01-440e-877f-dbb0f5b19f3f service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:04.948543 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e4e0e0-af01-440e-877f-dbb0f5b19f3f service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:04.948813 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e4e0e0-af01-440e-877f-dbb0f5b19f3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:04.958155 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e4e0e0-af01-440e-877f-dbb0f5b19f3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:04.959644 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e4e0e0-af01-440e-877f-dbb0f5b19f3f service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:04.969289 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 980/1947] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:40:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:40:05.295959 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0161635-6460-4692-9f73-3fddbba3f82a None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:05.297487 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-f0161635-6460-4692-9f73-3fddbba3f82a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:05.324255 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0161635-6460-4692-9f73-3fddbba3f82a None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:05.336682 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20227b5-87df-4f60-8a13-1c782de3820e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:05.337567 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20227b5-87df-4f60-8a13-1c782de3820e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:05.337843 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20227b5-87df-4f60-8a13-1c782de3820e admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:05.338113 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20227b5-87df-4f60-8a13-1c782de3820e admin admin] PATH_INFO: `/v3/projects/d1c764149a934c9eb65c1c9d23196e97` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:05.339337 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20227b5-87df-4f60-8a13-1c782de3820e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1c764149a934c9eb65c1c9d23196e97)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:05.341241 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20227b5-87df-4f60-8a13-1c782de3820e admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:05.401448 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-a20227b5-87df-4f60-8a13-1c782de3820e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1c764149a934c9eb65c1c9d23196e97', 'request_id': 'req-a20227b5-87df-4f60-8a13-1c782de3820e'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:05.407908 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-a20227b5-87df-4f60-8a13-1c782de3820e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1c764149a934c9eb65c1c9d23196e97', 'request_id': 'req-a20227b5-87df-4f60-8a13-1c782de3820e'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:05.417858 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-a20227b5-87df-4f60-8a13-1c782de3820e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1c764149a934c9eb65c1c9d23196e97', 'request_id': 'req-a20227b5-87df-4f60-8a13-1c782de3820e'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:05.431578 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-a20227b5-87df-4f60-8a13-1c782de3820e admin admin] The token cache is being invalidate because project d1c764149a934c9eb65c1c9d23196e97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 22:40:05.431867 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-a20227b5-87df-4f60-8a13-1c782de3820e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:05.432528 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-a20227b5-87df-4f60-8a13-1c782de3820e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:05.434352 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 968/1948] 10.222.0.36 () {58 vars in 1232 bytes} [Fri Jun 24 22:40:05 2022] DELETE /identity/v3/projects/d1c764149a934c9eb65c1c9d23196e97 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:40:05.439928 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e4e0e0-af01-440e-877f-dbb0f5b19f3f service neutron] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:05.450268 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e4e0e0-af01-440e-877f-dbb0f5b19f3f service neutron] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:05.531150 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355c8d2e-19fb-4e76-a741-c7bba1517cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:05.532227 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355c8d2e-19fb-4e76-a741-c7bba1517cfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:05.532590 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355c8d2e-19fb-4e76-a741-c7bba1517cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:05.532946 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355c8d2e-19fb-4e76-a741-c7bba1517cfb admin admin] PATH_INFO: `/v3/users/a887e1eafdc3413bbdada8c809792620` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:05.534249 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355c8d2e-19fb-4e76-a741-c7bba1517cfb admin admin] RBAC: Authorizing `identity:delete_user(user_id=a887e1eafdc3413bbdada8c809792620)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:05.536637 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355c8d2e-19fb-4e76-a741-c7bba1517cfb admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:05.567905 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:40:05.600357 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-355c8d2e-19fb-4e76-a741-c7bba1517cfb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a887e1eafdc3413bbdada8c809792620'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:05.608794 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-355c8d2e-19fb-4e76-a741-c7bba1517cfb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a887e1eafdc3413bbdada8c809792620'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:05.609648 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-355c8d2e-19fb-4e76-a741-c7bba1517cfb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a887e1eafdc3413bbdada8c809792620'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:05.610274 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-355c8d2e-19fb-4e76-a741-c7bba1517cfb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a887e1eafdc3413bbdada8c809792620'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:05.627702 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-355c8d2e-19fb-4e76-a741-c7bba1517cfb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a887e1eafdc3413bbdada8c809792620'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:05.643270 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 981/1949] 10.222.0.36 () {58 vars in 1223 bytes} [Fri Jun 24 22:40:05 2022] DELETE /identity/v3/users/a887e1eafdc3413bbdada8c809792620 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:40:05.972302 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20227b5-87df-4f60-8a13-1c782de3820e admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:05.982897 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-a20227b5-87df-4f60-8a13-1c782de3820e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:05.997400 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20227b5-87df-4f60-8a13-1c782de3820e admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:06.063838 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bea48c-f9ca-4a6d-b3a5-070447684117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:06.065030 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bea48c-f9ca-4a6d-b3a5-070447684117 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:06.065412 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bea48c-f9ca-4a6d-b3a5-070447684117 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:06.065923 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bea48c-f9ca-4a6d-b3a5-070447684117 admin admin] PATH_INFO: `/v3/projects/9d069cfce28843108a6c96753f336b15` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:06.067520 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bea48c-f9ca-4a6d-b3a5-070447684117 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d069cfce28843108a6c96753f336b15)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:06.069741 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bea48c-f9ca-4a6d-b3a5-070447684117 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:06.129529 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-14bea48c-f9ca-4a6d-b3a5-070447684117 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d069cfce28843108a6c96753f336b15', 'request_id': 'req-14bea48c-f9ca-4a6d-b3a5-070447684117'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:06.136440 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-14bea48c-f9ca-4a6d-b3a5-070447684117 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d069cfce28843108a6c96753f336b15', 'request_id': 'req-14bea48c-f9ca-4a6d-b3a5-070447684117'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:06.147563 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-14bea48c-f9ca-4a6d-b3a5-070447684117 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d069cfce28843108a6c96753f336b15', 'request_id': 'req-14bea48c-f9ca-4a6d-b3a5-070447684117'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:06.159409 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-14bea48c-f9ca-4a6d-b3a5-070447684117 admin admin] The token cache is being invalidate because project 9d069cfce28843108a6c96753f336b15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 22:40:06.159703 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-14bea48c-f9ca-4a6d-b3a5-070447684117 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:06.160430 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-14bea48c-f9ca-4a6d-b3a5-070447684117 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:06.162028 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 969/1950] 10.222.0.36 () {58 vars in 1232 bytes} [Fri Jun 24 22:40:05 2022] DELETE /identity/v3/projects/9d069cfce28843108a6c96753f336b15 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:40:06.169051 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec7e16-8040-4b5d-9a1e-c2b55c7640de None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:06.169502 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec7e16-8040-4b5d-9a1e-c2b55c7640de None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:06.169784 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec7e16-8040-4b5d-9a1e-c2b55c7640de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:06.187448 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-f1ec7e16-8040-4b5d-9a1e-c2b55c7640de None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:40:06.188637 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-f1ec7e16-8040-4b5d-9a1e-c2b55c7640de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:06.247544 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 982/1951] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:40:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:40:06.256493 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d8c3a0-18fe-4c77-bf3c-d6c714e7a3d1 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:06.256860 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d8c3a0-18fe-4c77-bf3c-d6c714e7a3d1 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:06.257200 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d8c3a0-18fe-4c77-bf3c-d6c714e7a3d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:06.265270 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:40:06.277650 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-b6d8c3a0-18fe-4c77-bf3c-d6c714e7a3d1 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:40:06.278875 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-b6d8c3a0-18fe-4c77-bf3c-d6c714e7a3d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:06.286760 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 970/1952] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:40:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:40:06.291270 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ec7e16-8040-4b5d-9a1e-c2b55c7640de None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:06.302160 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ec7e16-8040-4b5d-9a1e-c2b55c7640de None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:06.308652 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fbf525-9ac5-4647-b320-fe3240a039a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:06.309313 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fbf525-9ac5-4647-b320-fe3240a039a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:06.309593 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fbf525-9ac5-4647-b320-fe3240a039a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:06.309859 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fbf525-9ac5-4647-b320-fe3240a039a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:06.310583 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fbf525-9ac5-4647-b320-fe3240a039a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:40:06.310888 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fbf525-9ac5-4647-b320-fe3240a039a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:06.312553 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fbf525-9ac5-4647-b320-fe3240a039a6 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:06.324830 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 983/1953] 10.222.0.36 () {58 vars in 1152 bytes} [Fri Jun 24 22:40:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:40:06.329148 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d8c3a0-18fe-4c77-bf3c-d6c714e7a3d1 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:06.338363 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d8c3a0-18fe-4c77-bf3c-d6c714e7a3d1 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:06.343644 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2feee8-8295-4b1c-8449-dc26881f76ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:06.344298 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2feee8-8295-4b1c-8449-dc26881f76ae admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:06.344575 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2feee8-8295-4b1c-8449-dc26881f76ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:06.344846 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2feee8-8295-4b1c-8449-dc26881f76ae admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:06.345572 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2feee8-8295-4b1c-8449-dc26881f76ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:06.347714 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2feee8-8295-4b1c-8449-dc26881f76ae admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:06.378996 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 971/1954] 10.222.0.36 () {60 vars in 1152 bytes} [Fri Jun 24 22:40:06 2022] POST /identity/v3/projects => generated 369 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:40:06.380238 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fbf525-9ac5-4647-b320-fe3240a039a6 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:06.391104 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fbf525-9ac5-4647-b320-fe3240a039a6 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:06.454306 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9593c08-83a8-4dc9-a907-942251f3bbb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:06.455019 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9593c08-83a8-4dc9-a907-942251f3bbb1 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:06.455331 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9593c08-83a8-4dc9-a907-942251f3bbb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:06.455630 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9593c08-83a8-4dc9-a907-942251f3bbb1 admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:06.456321 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9593c08-83a8-4dc9-a907-942251f3bbb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:06.458677 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9593c08-83a8-4dc9-a907-942251f3bbb1 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:06.484006 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 984/1955] 10.222.0.36 () {60 vars in 1143 bytes} [Fri Jun 24 22:40:06 2022] POST /identity/v3/users => generated 285 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:40:06.485220 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2feee8-8295-4b1c-8449-dc26881f76ae admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:06.495822 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2feee8-8295-4b1c-8449-dc26881f76ae admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:06.500712 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12b2236-db4e-495b-9875-ade330ccaf67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:06.501711 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b2236-db4e-495b-9875-ade330ccaf67 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:06.502390 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b2236-db4e-495b-9875-ade330ccaf67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:06.502390 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b2236-db4e-495b-9875-ade330ccaf67 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:06.503002 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12b2236-db4e-495b-9875-ade330ccaf67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:06.504706 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12b2236-db4e-495b-9875-ade330ccaf67 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:06.516378 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 972/1956] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:40:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:40:06.520812 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9593c08-83a8-4dc9-a907-942251f3bbb1 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:06.531094 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9593c08-83a8-4dc9-a907-942251f3bbb1 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:06.536276 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413d64e3-703c-4aab-9c03-d1a6aed10363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:06.536907 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d64e3-703c-4aab-9c03-d1a6aed10363 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:06.537210 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d64e3-703c-4aab-9c03-d1a6aed10363 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:06.537484 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d64e3-703c-4aab-9c03-d1a6aed10363 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:06.538215 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413d64e3-703c-4aab-9c03-d1a6aed10363 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:06.539872 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413d64e3-703c-4aab-9c03-d1a6aed10363 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:06.549952 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 985/1957] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:40:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:40:06.554324 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12b2236-db4e-495b-9875-ade330ccaf67 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:06.564576 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12b2236-db4e-495b-9875-ade330ccaf67 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:06.569624 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac95898b-e7e7-47a3-8c9b-834579f93a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:06.570530 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac95898b-e7e7-47a3-8c9b-834579f93a42 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:06.570812 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac95898b-e7e7-47a3-8c9b-834579f93a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:06.571085 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac95898b-e7e7-47a3-8c9b-834579f93a42 admin admin] PATH_INFO: `/v3/projects/5435c7ba23f6410c9893369b30bedf53/users/0a56851bc21043789cfffe0cec17d55a/roles/1928787bfcc745419829cd315900ac44` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:06.586094 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac95898b-e7e7-47a3-8c9b-834579f93a42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5435c7ba23f6410c9893369b30bedf53, user_id=0a56851bc21043789cfffe0cec17d55a, role_id=1928787bfcc745419829cd315900ac44)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:06.588727 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac95898b-e7e7-47a3-8c9b-834579f93a42 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:06.603780 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 973/1958] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 22:40:06 2022] PUT /identity/v3/projects/5435c7ba23f6410c9893369b30bedf53/users/0a56851bc21043789cfffe0cec17d55a/roles/1928787bfcc745419829cd315900ac44 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:40:06.615659 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4195cf57-5cb2-452a-a538-6bda8631ef20 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:06.616272 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4195cf57-5cb2-452a-a538-6bda8631ef20 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:06.616272 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4195cf57-5cb2-452a-a538-6bda8631ef20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:06.636739 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:40:06.648994 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-4195cf57-5cb2-452a-a538-6bda8631ef20 None None] MFA Rules not processed for user `0a56851bc21043789cfffe0cec17d55a`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:40:06.650640 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-4195cf57-5cb2-452a-a538-6bda8631ef20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:06.718589 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 986/1959] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:40:06 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:40:06.723404 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac95898b-e7e7-47a3-8c9b-834579f93a42 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:06.785178 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac95898b-e7e7-47a3-8c9b-834579f93a42 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:06.790036 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60fd16b-2dd8-4146-8908-f572694cc04b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:06.790700 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60fd16b-2dd8-4146-8908-f572694cc04b admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:06.790989 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60fd16b-2dd8-4146-8908-f572694cc04b admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:06.791290 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60fd16b-2dd8-4146-8908-f572694cc04b admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:06.791987 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60fd16b-2dd8-4146-8908-f572694cc04b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:06.793945 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60fd16b-2dd8-4146-8908-f572694cc04b admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:06.821377 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 974/1960] 10.222.0.36 () {60 vars in 1152 bytes} [Fri Jun 24 22:40:06 2022] POST /identity/v3/projects => generated 369 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 22:40:06.825677 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4195cf57-5cb2-452a-a538-6bda8631ef20 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:06.837160 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4195cf57-5cb2-452a-a538-6bda8631ef20 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:06.897272 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd149703-d19d-4424-b9e1-ff470d733298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:06.897944 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd149703-d19d-4424-b9e1-ff470d733298 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:06.898220 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd149703-d19d-4424-b9e1-ff470d733298 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:06.898493 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd149703-d19d-4424-b9e1-ff470d733298 admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:06.899182 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd149703-d19d-4424-b9e1-ff470d733298 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:06.901157 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd149703-d19d-4424-b9e1-ff470d733298 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:06.922330 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 987/1961] 10.222.0.36 () {60 vars in 1143 bytes} [Fri Jun 24 22:40:06 2022] POST /identity/v3/users => generated 291 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:40:06.926477 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60fd16b-2dd8-4146-8908-f572694cc04b admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:06.937297 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60fd16b-2dd8-4146-8908-f572694cc04b admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:06.943169 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5faec5-3a0b-4b9a-b88f-d21659d5fe87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:06.943869 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5faec5-3a0b-4b9a-b88f-d21659d5fe87 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:06.944163 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5faec5-3a0b-4b9a-b88f-d21659d5fe87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:06.944438 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5faec5-3a0b-4b9a-b88f-d21659d5fe87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:06.945170 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5faec5-3a0b-4b9a-b88f-d21659d5fe87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:06.946834 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5faec5-3a0b-4b9a-b88f-d21659d5fe87 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:06.958345 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 975/1962] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:40:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:40:06.962702 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd149703-d19d-4424-b9e1-ff470d733298 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:06.973436 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd149703-d19d-4424-b9e1-ff470d733298 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:06.979218 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63cf2b3-9de0-4234-b48e-c284409724f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:06.980139 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63cf2b3-9de0-4234-b48e-c284409724f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:06.980414 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63cf2b3-9de0-4234-b48e-c284409724f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:06.980687 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63cf2b3-9de0-4234-b48e-c284409724f0 admin admin] PATH_INFO: `/v3/projects/76702353f0214e4aadf0e4fa73ab4679/users/3350cef262ca4906b905a2afa64b6230/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:06.998197 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63cf2b3-9de0-4234-b48e-c284409724f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76702353f0214e4aadf0e4fa73ab4679, user_id=3350cef262ca4906b905a2afa64b6230, role_id=1a1c43cc97a0407eb7a7c7a1333a9d4a)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:07.000814 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63cf2b3-9de0-4234-b48e-c284409724f0 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:07.016548 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 988/1963] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 22:40:06 2022] PUT /identity/v3/projects/76702353f0214e4aadf0e4fa73ab4679/users/3350cef262ca4906b905a2afa64b6230/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:40:07.021002 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5faec5-3a0b-4b9a-b88f-d21659d5fe87 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:07.031704 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5faec5-3a0b-4b9a-b88f-d21659d5fe87 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:07.093710 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4c12e6-a0e6-4126-91c4-7e4d0fc90420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:07.094652 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c12e6-a0e6-4126-91c4-7e4d0fc90420 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:07.094652 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c12e6-a0e6-4126-91c4-7e4d0fc90420 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:07.094823 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c12e6-a0e6-4126-91c4-7e4d0fc90420 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:07.095671 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4c12e6-a0e6-4126-91c4-7e4d0fc90420 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:07.097216 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4c12e6-a0e6-4126-91c4-7e4d0fc90420 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:07.108415 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 976/1964] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:40:07 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:40:07.112766 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63cf2b3-9de0-4234-b48e-c284409724f0 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:07.123260 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63cf2b3-9de0-4234-b48e-c284409724f0 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:07.136046 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd693762-f20b-4728-9443-ada72f0eaf29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:07.136976 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd693762-f20b-4728-9443-ada72f0eaf29 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:07.137260 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd693762-f20b-4728-9443-ada72f0eaf29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:07.137589 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd693762-f20b-4728-9443-ada72f0eaf29 admin admin] PATH_INFO: `/v3/projects/76702353f0214e4aadf0e4fa73ab4679/users/3350cef262ca4906b905a2afa64b6230/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:07.140698 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd693762-f20b-4728-9443-ada72f0eaf29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76702353f0214e4aadf0e4fa73ab4679, user_id=3350cef262ca4906b905a2afa64b6230, role_id=1a1c43cc97a0407eb7a7c7a1333a9d4a)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:07.143450 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd693762-f20b-4728-9443-ada72f0eaf29 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:07.163354 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 989/1965] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 22:40:07 2022] PUT /identity/v3/projects/76702353f0214e4aadf0e4fa73ab4679/users/3350cef262ca4906b905a2afa64b6230/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:40:07.172562 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d7796d-7dac-47b7-9dcf-39086485e7bc None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:07.172858 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d7796d-7dac-47b7-9dcf-39086485e7bc None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:07.173147 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d7796d-7dac-47b7-9dcf-39086485e7bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:07.196543 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:40:07.221441 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-f4d7796d-7dac-47b7-9dcf-39086485e7bc None None] MFA Rules not processed for user `3350cef262ca4906b905a2afa64b6230`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:40:07.223848 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-f4d7796d-7dac-47b7-9dcf-39086485e7bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:07.304059 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 977/1966] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:40:07 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:40:07.315800 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd693762-f20b-4728-9443-ada72f0eaf29 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:07.317800 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-fd693762-f20b-4728-9443-ada72f0eaf29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:07.378067 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd693762-f20b-4728-9443-ada72f0eaf29 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:07.381638 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23a81a4-4f3f-44bc-b61d-fdd683a3352d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a747e2a5684843a6ee9e3480badac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:07.382286 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23a81a4-4f3f-44bc-b61d-fdd683a3352d service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:07.382565 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23a81a4-4f3f-44bc-b61d-fdd683a3352d service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:07.382835 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23a81a4-4f3f-44bc-b61d-fdd683a3352d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:07.388726 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:40:07.392348 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23a81a4-4f3f-44bc-b61d-fdd683a3352d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:07.394311 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23a81a4-4f3f-44bc-b61d-fdd683a3352d service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:07.413201 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 990/1967] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:40:07 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:40:08.857726 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d7796d-7dac-47b7-9dcf-39086485e7bc None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:08.921174 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d7796d-7dac-47b7-9dcf-39086485e7bc None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:08.926419 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b966d4a2-f6a7-4088-85f0-ab2c05fb2e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:08.927415 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b966d4a2-f6a7-4088-85f0-ab2c05fb2e56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:08.927567 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b966d4a2-f6a7-4088-85f0-ab2c05fb2e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:08.927859 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b966d4a2-f6a7-4088-85f0-ab2c05fb2e56 admin admin] PATH_INFO: `/v3/users/0a56851bc21043789cfffe0cec17d55a` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:08.929108 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b966d4a2-f6a7-4088-85f0-ab2c05fb2e56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a56851bc21043789cfffe0cec17d55a)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:08.931033 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b966d4a2-f6a7-4088-85f0-ab2c05fb2e56 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:08.989504 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-b966d4a2-f6a7-4088-85f0-ab2c05fb2e56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a56851bc21043789cfffe0cec17d55a'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:08.996294 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-b966d4a2-f6a7-4088-85f0-ab2c05fb2e56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a56851bc21043789cfffe0cec17d55a'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:08.997010 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-b966d4a2-f6a7-4088-85f0-ab2c05fb2e56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a56851bc21043789cfffe0cec17d55a'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:08.997649 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-b966d4a2-f6a7-4088-85f0-ab2c05fb2e56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a56851bc21043789cfffe0cec17d55a'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:09.009616 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-b966d4a2-f6a7-4088-85f0-ab2c05fb2e56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a56851bc21043789cfffe0cec17d55a'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:09.024505 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 978/1968] 10.222.0.36 () {58 vars in 1223 bytes} [Fri Jun 24 22:40:08 2022] DELETE /identity/v3/users/0a56851bc21043789cfffe0cec17d55a => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 22:40:09.031793 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9015a7f-799c-4f20-8e22-21fb772f8436 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:09.032302 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9015a7f-799c-4f20-8e22-21fb772f8436 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:09.032398 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9015a7f-799c-4f20-8e22-21fb772f8436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:09.050949 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-e9015a7f-799c-4f20-8e22-21fb772f8436 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:40:09.052205 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-e9015a7f-799c-4f20-8e22-21fb772f8436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:09.111851 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 991/1969] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:40:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:40:09.122135 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b966d4a2-f6a7-4088-85f0-ab2c05fb2e56 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:09.123687 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-b966d4a2-f6a7-4088-85f0-ab2c05fb2e56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:09.142998 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:40:09.184772 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b966d4a2-f6a7-4088-85f0-ab2c05fb2e56 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:09.188924 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35923037-6b35-48bd-9a4f-fb56e2846ffc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:09.189608 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35923037-6b35-48bd-9a4f-fb56e2846ffc service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:09.189891 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35923037-6b35-48bd-9a4f-fb56e2846ffc service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:09.190167 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35923037-6b35-48bd-9a4f-fb56e2846ffc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:09.199901 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35923037-6b35-48bd-9a4f-fb56e2846ffc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:09.201348 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35923037-6b35-48bd-9a4f-fb56e2846ffc service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:09.211120 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 979/1970] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:40:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:40:09.537347 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9015a7f-799c-4f20-8e22-21fb772f8436 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:09.538805 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-e9015a7f-799c-4f20-8e22-21fb772f8436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:09.551227 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9015a7f-799c-4f20-8e22-21fb772f8436 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:09.556277 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114326e0-5d14-451d-8b09-2f81ccec982a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:09.557254 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114326e0-5d14-451d-8b09-2f81ccec982a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:09.557612 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114326e0-5d14-451d-8b09-2f81ccec982a admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:09.558311 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114326e0-5d14-451d-8b09-2f81ccec982a admin admin] PATH_INFO: `/v3/projects/5435c7ba23f6410c9893369b30bedf53` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:09.559532 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114326e0-5d14-451d-8b09-2f81ccec982a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5435c7ba23f6410c9893369b30bedf53)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:09.561565 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114326e0-5d14-451d-8b09-2f81ccec982a admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:09.621380 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-114326e0-5d14-451d-8b09-2f81ccec982a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5435c7ba23f6410c9893369b30bedf53', 'request_id': 'req-114326e0-5d14-451d-8b09-2f81ccec982a'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:09.628234 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-114326e0-5d14-451d-8b09-2f81ccec982a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5435c7ba23f6410c9893369b30bedf53', 'request_id': 'req-114326e0-5d14-451d-8b09-2f81ccec982a'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:09.637198 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-114326e0-5d14-451d-8b09-2f81ccec982a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5435c7ba23f6410c9893369b30bedf53', 'request_id': 'req-114326e0-5d14-451d-8b09-2f81ccec982a'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:09.648417 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-114326e0-5d14-451d-8b09-2f81ccec982a admin admin] The token cache is being invalidate because project 5435c7ba23f6410c9893369b30bedf53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 22:40:09.648706 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-114326e0-5d14-451d-8b09-2f81ccec982a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:09.649372 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-114326e0-5d14-451d-8b09-2f81ccec982a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:09.650960 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 992/1971] 10.222.0.36 () {58 vars in 1232 bytes} [Fri Jun 24 22:40:09 2022] DELETE /identity/v3/projects/5435c7ba23f6410c9893369b30bedf53 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:40:09.655011 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35923037-6b35-48bd-9a4f-fb56e2846ffc service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:09.664888 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35923037-6b35-48bd-9a4f-fb56e2846ffc service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:09.722073 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ab677f-a236-438e-b4f8-d48d2f4ca74a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:09.723019 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ab677f-a236-438e-b4f8-d48d2f4ca74a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:09.723330 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ab677f-a236-438e-b4f8-d48d2f4ca74a admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:09.723618 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ab677f-a236-438e-b4f8-d48d2f4ca74a admin admin] PATH_INFO: `/v3/users/3350cef262ca4906b905a2afa64b6230` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:09.724800 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ab677f-a236-438e-b4f8-d48d2f4ca74a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3350cef262ca4906b905a2afa64b6230)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:09.726735 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ab677f-a236-438e-b4f8-d48d2f4ca74a admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:09.779358 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-a2ab677f-a236-438e-b4f8-d48d2f4ca74a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3350cef262ca4906b905a2afa64b6230'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:09.788998 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-a2ab677f-a236-438e-b4f8-d48d2f4ca74a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3350cef262ca4906b905a2afa64b6230'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:09.789797 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-a2ab677f-a236-438e-b4f8-d48d2f4ca74a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3350cef262ca4906b905a2afa64b6230'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:09.790391 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-a2ab677f-a236-438e-b4f8-d48d2f4ca74a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3350cef262ca4906b905a2afa64b6230'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:09.804847 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-a2ab677f-a236-438e-b4f8-d48d2f4ca74a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3350cef262ca4906b905a2afa64b6230'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:09.819021 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 980/1972] 10.222.0.36 () {58 vars in 1223 bytes} [Fri Jun 24 22:40:09 2022] DELETE /identity/v3/users/3350cef262ca4906b905a2afa64b6230 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:40:10.141930 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114326e0-5d14-451d-8b09-2f81ccec982a admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:10.143529 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-114326e0-5d14-451d-8b09-2f81ccec982a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:10.157231 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114326e0-5d14-451d-8b09-2f81ccec982a admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:10.215988 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc55bea-f6f9-4d38-a063-89411f9bc953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:10.216869 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc55bea-f6f9-4d38-a063-89411f9bc953 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:10.217151 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc55bea-f6f9-4d38-a063-89411f9bc953 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:10.217422 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc55bea-f6f9-4d38-a063-89411f9bc953 admin admin] PATH_INFO: `/v3/projects/76702353f0214e4aadf0e4fa73ab4679` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:10.218621 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc55bea-f6f9-4d38-a063-89411f9bc953 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76702353f0214e4aadf0e4fa73ab4679)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:10.220578 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc55bea-f6f9-4d38-a063-89411f9bc953 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:10.247381 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:40:10.278516 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-7bc55bea-f6f9-4d38-a063-89411f9bc953 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76702353f0214e4aadf0e4fa73ab4679', 'request_id': 'req-7bc55bea-f6f9-4d38-a063-89411f9bc953'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:10.284776 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-7bc55bea-f6f9-4d38-a063-89411f9bc953 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76702353f0214e4aadf0e4fa73ab4679', 'request_id': 'req-7bc55bea-f6f9-4d38-a063-89411f9bc953'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:10.292774 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-7bc55bea-f6f9-4d38-a063-89411f9bc953 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76702353f0214e4aadf0e4fa73ab4679', 'request_id': 'req-7bc55bea-f6f9-4d38-a063-89411f9bc953'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:10.302847 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-7bc55bea-f6f9-4d38-a063-89411f9bc953 admin admin] The token cache is being invalidate because project 76702353f0214e4aadf0e4fa73ab4679 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 22:40:10.303183 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-7bc55bea-f6f9-4d38-a063-89411f9bc953 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:10.303825 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-7bc55bea-f6f9-4d38-a063-89411f9bc953 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:10.305398 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 993/1973] 10.222.0.36 () {58 vars in 1232 bytes} [Fri Jun 24 22:40:10 2022] DELETE /identity/v3/projects/76702353f0214e4aadf0e4fa73ab4679 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:40:10.310328 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03107c54-8336-4362-93c7-e53a96ade46b None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:10.310833 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03107c54-8336-4362-93c7-e53a96ade46b None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:10.310927 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03107c54-8336-4362-93c7-e53a96ade46b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:10.329435 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-03107c54-8336-4362-93c7-e53a96ade46b None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:40:10.330650 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-03107c54-8336-4362-93c7-e53a96ade46b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:10.368099 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:40:10.397847 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 981/1974] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:40:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:40:10.405823 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d27a07-4070-4c52-bdc0-a44a666a8196 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:10.406141 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d27a07-4070-4c52-bdc0-a44a666a8196 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:10.406416 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d27a07-4070-4c52-bdc0-a44a666a8196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:10.424879 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-81d27a07-4070-4c52-bdc0-a44a666a8196 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:40:10.426131 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-81d27a07-4070-4c52-bdc0-a44a666a8196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:10.434604 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 994/1975] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:40:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:40:10.439532 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03107c54-8336-4362-93c7-e53a96ade46b None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:10.449880 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03107c54-8336-4362-93c7-e53a96ade46b None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:10.454948 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fad18f5-28dd-45b8-b2ca-af1a87d2fb36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:10.455655 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fad18f5-28dd-45b8-b2ca-af1a87d2fb36 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:10.455939 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fad18f5-28dd-45b8-b2ca-af1a87d2fb36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:10.456212 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fad18f5-28dd-45b8-b2ca-af1a87d2fb36 admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:10.456961 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fad18f5-28dd-45b8-b2ca-af1a87d2fb36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:40:10.457255 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fad18f5-28dd-45b8-b2ca-af1a87d2fb36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:10.458880 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fad18f5-28dd-45b8-b2ca-af1a87d2fb36 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:10.471409 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 982/1976] 10.222.0.36 () {58 vars in 1152 bytes} [Fri Jun 24 22:40:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:40:10.476305 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d27a07-4070-4c52-bdc0-a44a666a8196 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:10.485593 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d27a07-4070-4c52-bdc0-a44a666a8196 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:10.490366 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3288183-7570-4746-9b5a-23192f2549f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:10.491011 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3288183-7570-4746-9b5a-23192f2549f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:10.491321 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3288183-7570-4746-9b5a-23192f2549f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:10.491596 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3288183-7570-4746-9b5a-23192f2549f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:10.492310 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3288183-7570-4746-9b5a-23192f2549f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:10.494200 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3288183-7570-4746-9b5a-23192f2549f2 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:10.526745 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 995/1977] 10.222.0.36 () {60 vars in 1152 bytes} [Fri Jun 24 22:40:10 2022] POST /identity/v3/projects => generated 367 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 22:40:10.527930 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fad18f5-28dd-45b8-b2ca-af1a87d2fb36 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:10.539903 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fad18f5-28dd-45b8-b2ca-af1a87d2fb36 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:10.602623 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b9ce6c-1cee-4162-8f84-272e7c4ed339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:10.603361 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b9ce6c-1cee-4162-8f84-272e7c4ed339 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:10.603656 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b9ce6c-1cee-4162-8f84-272e7c4ed339 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:10.603935 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b9ce6c-1cee-4162-8f84-272e7c4ed339 admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:10.604638 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b9ce6c-1cee-4162-8f84-272e7c4ed339 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:10.606646 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b9ce6c-1cee-4162-8f84-272e7c4ed339 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:10.629524 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 983/1978] 10.222.0.36 () {60 vars in 1143 bytes} [Fri Jun 24 22:40:10 2022] POST /identity/v3/users => generated 284 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:40:10.633635 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3288183-7570-4746-9b5a-23192f2549f2 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:10.644226 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3288183-7570-4746-9b5a-23192f2549f2 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:10.649603 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5628a0-732a-4549-9a02-5add723f6692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:10.650336 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5628a0-732a-4549-9a02-5add723f6692 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:10.650694 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5628a0-732a-4549-9a02-5add723f6692 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:10.651028 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5628a0-732a-4549-9a02-5add723f6692 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:10.651811 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5628a0-732a-4549-9a02-5add723f6692 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:10.653431 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5628a0-732a-4549-9a02-5add723f6692 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:10.666207 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 996/1979] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:40:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:40:10.668179 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b9ce6c-1cee-4162-8f84-272e7c4ed339 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:10.678741 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b9ce6c-1cee-4162-8f84-272e7c4ed339 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:10.684366 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594f154a-8943-460d-86a0-33ad41200301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:10.685043 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f154a-8943-460d-86a0-33ad41200301 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:10.685345 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f154a-8943-460d-86a0-33ad41200301 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:10.685618 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f154a-8943-460d-86a0-33ad41200301 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:10.686380 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594f154a-8943-460d-86a0-33ad41200301 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:10.688237 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594f154a-8943-460d-86a0-33ad41200301 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:10.699304 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 984/1980] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:40:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:40:10.703669 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5628a0-732a-4549-9a02-5add723f6692 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:10.714525 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5628a0-732a-4549-9a02-5add723f6692 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:10.719714 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3543bc-c28e-4f34-9a88-b3aaf76161a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:10.720611 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3543bc-c28e-4f34-9a88-b3aaf76161a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:10.720896 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3543bc-c28e-4f34-9a88-b3aaf76161a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:10.721169 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3543bc-c28e-4f34-9a88-b3aaf76161a2 admin admin] PATH_INFO: `/v3/projects/1cb802d165c14102905c43fc4d29122a/users/64abbc74691d48f7ba6e71c2dad91d84/roles/1928787bfcc745419829cd315900ac44` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:10.736488 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3543bc-c28e-4f34-9a88-b3aaf76161a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cb802d165c14102905c43fc4d29122a, user_id=64abbc74691d48f7ba6e71c2dad91d84, role_id=1928787bfcc745419829cd315900ac44)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:10.739421 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3543bc-c28e-4f34-9a88-b3aaf76161a2 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:10.755618 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 997/1981] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 22:40:10 2022] PUT /identity/v3/projects/1cb802d165c14102905c43fc4d29122a/users/64abbc74691d48f7ba6e71c2dad91d84/roles/1928787bfcc745419829cd315900ac44 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 22:40:10.766982 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ac16d2-d1a7-42d3-bd56-8bda609c7cd4 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:10.767211 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ac16d2-d1a7-42d3-bd56-8bda609c7cd4 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:10.767524 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ac16d2-d1a7-42d3-bd56-8bda609c7cd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:10.795783 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-e2ac16d2-d1a7-42d3-bd56-8bda609c7cd4 None None] MFA Rules not processed for user `64abbc74691d48f7ba6e71c2dad91d84`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:40:10.797007 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-e2ac16d2-d1a7-42d3-bd56-8bda609c7cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:10.882602 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 985/1982] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:40:10 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:40:10.884791 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3543bc-c28e-4f34-9a88-b3aaf76161a2 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:10.950173 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3543bc-c28e-4f34-9a88-b3aaf76161a2 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:10.954525 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b377232-65b4-4d28-8b8c-97ad52d40158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:10.955197 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b377232-65b4-4d28-8b8c-97ad52d40158 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:10.955548 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b377232-65b4-4d28-8b8c-97ad52d40158 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:10.955821 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b377232-65b4-4d28-8b8c-97ad52d40158 admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:10.956733 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b377232-65b4-4d28-8b8c-97ad52d40158 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:10.958565 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b377232-65b4-4d28-8b8c-97ad52d40158 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:10.990099 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 998/1983] 10.222.0.36 () {60 vars in 1152 bytes} [Fri Jun 24 22:40:10 2022] POST /identity/v3/projects => generated 367 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:40:10.991359 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ac16d2-d1a7-42d3-bd56-8bda609c7cd4 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:11.002663 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ac16d2-d1a7-42d3-bd56-8bda609c7cd4 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:11.037951 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:40:11.071478 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca6acc8-3cd6-4d72-81b8-ca8f72969b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:11.072180 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca6acc8-3cd6-4d72-81b8-ca8f72969b53 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:11.072467 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca6acc8-3cd6-4d72-81b8-ca8f72969b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:11.072747 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca6acc8-3cd6-4d72-81b8-ca8f72969b53 admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:11.073447 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca6acc8-3cd6-4d72-81b8-ca8f72969b53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:11.075469 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca6acc8-3cd6-4d72-81b8-ca8f72969b53 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:11.098710 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 986/1984] 10.222.0.36 () {60 vars in 1143 bytes} [Fri Jun 24 22:40:10 2022] POST /identity/v3/users => generated 290 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 22:40:11.102757 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b377232-65b4-4d28-8b8c-97ad52d40158 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:11.114689 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b377232-65b4-4d28-8b8c-97ad52d40158 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:11.120261 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba873044-78ad-42d8-bab6-dc92ffac5044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:11.121153 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba873044-78ad-42d8-bab6-dc92ffac5044 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:11.121287 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba873044-78ad-42d8-bab6-dc92ffac5044 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:11.121512 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba873044-78ad-42d8-bab6-dc92ffac5044 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:11.122409 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba873044-78ad-42d8-bab6-dc92ffac5044 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:11.124089 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba873044-78ad-42d8-bab6-dc92ffac5044 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:11.136384 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 999/1985] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:40:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:40:11.144513 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca6acc8-3cd6-4d72-81b8-ca8f72969b53 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:11.155150 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca6acc8-3cd6-4d72-81b8-ca8f72969b53 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:11.160483 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96332549-cfcb-47df-b693-b7cb4b3679df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:11.161510 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96332549-cfcb-47df-b693-b7cb4b3679df admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:11.161793 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96332549-cfcb-47df-b693-b7cb4b3679df admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:11.162069 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96332549-cfcb-47df-b693-b7cb4b3679df admin admin] PATH_INFO: `/v3/projects/fe9fd1ad38ab4e81b003e60c89b50bb8/users/fa3f7898fadb41d8813af11d716a6614/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:11.178503 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96332549-cfcb-47df-b693-b7cb4b3679df admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe9fd1ad38ab4e81b003e60c89b50bb8, user_id=fa3f7898fadb41d8813af11d716a6614, role_id=1a1c43cc97a0407eb7a7c7a1333a9d4a)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:11.181259 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96332549-cfcb-47df-b693-b7cb4b3679df admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:11.197065 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 987/1986] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 22:40:11 2022] PUT /identity/v3/projects/fe9fd1ad38ab4e81b003e60c89b50bb8/users/fa3f7898fadb41d8813af11d716a6614/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:40:11.201129 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba873044-78ad-42d8-bab6-dc92ffac5044 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:11.211901 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba873044-78ad-42d8-bab6-dc92ffac5044 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:11.225346 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:40:11.276664 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbc08bf-8e40-4aa9-bdf3-b6e67c5afcf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:11.277282 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc08bf-8e40-4aa9-bdf3-b6e67c5afcf5 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:11.277563 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc08bf-8e40-4aa9-bdf3-b6e67c5afcf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:11.277837 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc08bf-8e40-4aa9-bdf3-b6e67c5afcf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:11.278561 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbc08bf-8e40-4aa9-bdf3-b6e67c5afcf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:11.280229 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbc08bf-8e40-4aa9-bdf3-b6e67c5afcf5 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:11.290212 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1000/1987] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:40:11 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 22:40:11.294645 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96332549-cfcb-47df-b693-b7cb4b3679df admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:11.305565 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96332549-cfcb-47df-b693-b7cb4b3679df admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:11.310210 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8827fa75-7e99-4a28-a690-5a7119049dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:11.311107 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8827fa75-7e99-4a28-a690-5a7119049dce admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:11.311703 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8827fa75-7e99-4a28-a690-5a7119049dce admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:11.311703 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8827fa75-7e99-4a28-a690-5a7119049dce admin admin] PATH_INFO: `/v3/projects/fe9fd1ad38ab4e81b003e60c89b50bb8/users/fa3f7898fadb41d8813af11d716a6614/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:11.313831 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8827fa75-7e99-4a28-a690-5a7119049dce admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe9fd1ad38ab4e81b003e60c89b50bb8, user_id=fa3f7898fadb41d8813af11d716a6614, role_id=1a1c43cc97a0407eb7a7c7a1333a9d4a)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:11.317182 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8827fa75-7e99-4a28-a690-5a7119049dce admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:11.327796 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 988/1988] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 22:40:11 2022] PUT /identity/v3/projects/fe9fd1ad38ab4e81b003e60c89b50bb8/users/fa3f7898fadb41d8813af11d716a6614/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:40:11.339850 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8f6bf8-a679-473b-b5c5-e40e465d0198 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:11.340229 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8f6bf8-a679-473b-b5c5-e40e465d0198 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:11.340610 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8f6bf8-a679-473b-b5c5-e40e465d0198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:11.371204 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-ff8f6bf8-a679-473b-b5c5-e40e465d0198 None None] MFA Rules not processed for user `fa3f7898fadb41d8813af11d716a6614`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:40:11.372441 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-ff8f6bf8-a679-473b-b5c5-e40e465d0198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:11.450486 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1001/1989] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:40:11 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:40:11.462322 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8827fa75-7e99-4a28-a690-5a7119049dce admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:11.464226 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-8827fa75-7e99-4a28-a690-5a7119049dce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:11.534088 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8827fa75-7e99-4a28-a690-5a7119049dce admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:11.539279 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535c40c2-5a56-4ca0-a97f-e96f0e14b7a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a747e2a5684843a6ee9e3480badac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:11.539957 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535c40c2-5a56-4ca0-a97f-e96f0e14b7a3 service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:11.540226 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535c40c2-5a56-4ca0-a97f-e96f0e14b7a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:11.540498 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535c40c2-5a56-4ca0-a97f-e96f0e14b7a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:11.551688 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535c40c2-5a56-4ca0-a97f-e96f0e14b7a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:11.553158 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535c40c2-5a56-4ca0-a97f-e96f0e14b7a3 service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:11.565205 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 989/1990] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:40:11 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:40:11.654652 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8f6bf8-a679-473b-b5c5-e40e465d0198 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:11.665076 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8f6bf8-a679-473b-b5c5-e40e465d0198 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:11.669200 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b15d608-d142-4aa5-8371-2b86894565d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a747e2a5684843a6ee9e3480badac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:11.669879 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b15d608-d142-4aa5-8371-2b86894565d4 service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:11.670157 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b15d608-d142-4aa5-8371-2b86894565d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:11.670427 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b15d608-d142-4aa5-8371-2b86894565d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:11.734035 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b15d608-d142-4aa5-8371-2b86894565d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:11.735588 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b15d608-d142-4aa5-8371-2b86894565d4 service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:11.745682 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1002/1991] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:40:11 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:40:14.747621 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535c40c2-5a56-4ca0-a97f-e96f0e14b7a3 service cinder] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:14.748991 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-535c40c2-5a56-4ca0-a97f-e96f0e14b7a3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:14.815878 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535c40c2-5a56-4ca0-a97f-e96f0e14b7a3 service cinder] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:14.820459 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055dbffa-7adb-4599-84a8-fc68b6c5e773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:14.821340 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055dbffa-7adb-4599-84a8-fc68b6c5e773 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:14.821618 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055dbffa-7adb-4599-84a8-fc68b6c5e773 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:14.821890 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055dbffa-7adb-4599-84a8-fc68b6c5e773 admin admin] PATH_INFO: `/v3/users/a50e10318c664b41ade9626e84c01256` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:14.823077 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055dbffa-7adb-4599-84a8-fc68b6c5e773 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a50e10318c664b41ade9626e84c01256)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:14.825081 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055dbffa-7adb-4599-84a8-fc68b6c5e773 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:14.869423 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:40:14.886009 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-055dbffa-7adb-4599-84a8-fc68b6c5e773 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a50e10318c664b41ade9626e84c01256'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:14.893399 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-055dbffa-7adb-4599-84a8-fc68b6c5e773 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a50e10318c664b41ade9626e84c01256'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:14.894102 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-055dbffa-7adb-4599-84a8-fc68b6c5e773 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a50e10318c664b41ade9626e84c01256'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:14.894726 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-055dbffa-7adb-4599-84a8-fc68b6c5e773 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a50e10318c664b41ade9626e84c01256'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:14.906671 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-055dbffa-7adb-4599-84a8-fc68b6c5e773 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a50e10318c664b41ade9626e84c01256'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:14.921320 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 990/1992] 10.222.0.36 () {58 vars in 1223 bytes} [Fri Jun 24 22:40:14 2022] DELETE /identity/v3/users/a50e10318c664b41ade9626e84c01256 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:40:14.925890 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1319f7-a51f-444b-9c28-57a1b5717251 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:14.926459 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1319f7-a51f-444b-9c28-57a1b5717251 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:14.926719 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1319f7-a51f-444b-9c28-57a1b5717251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:14.944110 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-da1319f7-a51f-444b-9c28-57a1b5717251 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:40:14.945436 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-da1319f7-a51f-444b-9c28-57a1b5717251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:14.993514 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:40:15.037001 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1003/1993] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:40:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:40:15.046989 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055dbffa-7adb-4599-84a8-fc68b6c5e773 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:15.048504 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-055dbffa-7adb-4599-84a8-fc68b6c5e773 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:15.118357 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055dbffa-7adb-4599-84a8-fc68b6c5e773 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:15.123478 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b097e2-ac99-4b89-ad20-b36d8d424e53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:15.124139 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b097e2-ac99-4b89-ad20-b36d8d424e53 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:15.124420 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b097e2-ac99-4b89-ad20-b36d8d424e53 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:15.124693 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b097e2-ac99-4b89-ad20-b36d8d424e53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:15.135595 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b097e2-ac99-4b89-ad20-b36d8d424e53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:15.136992 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b097e2-ac99-4b89-ad20-b36d8d424e53 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:15.147009 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 991/1994] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:40:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:40:15.475381 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1319f7-a51f-444b-9c28-57a1b5717251 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:15.476889 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-da1319f7-a51f-444b-9c28-57a1b5717251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:15.489189 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1319f7-a51f-444b-9c28-57a1b5717251 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:15.494390 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aad87f-4b80-4103-8f8a-9d7f21eee335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:15.495385 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aad87f-4b80-4103-8f8a-9d7f21eee335 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:15.495670 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aad87f-4b80-4103-8f8a-9d7f21eee335 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:15.495981 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aad87f-4b80-4103-8f8a-9d7f21eee335 admin admin] PATH_INFO: `/v3/projects/af176dc803504f388b06f5914bf000cb` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:15.497179 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aad87f-4b80-4103-8f8a-9d7f21eee335 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af176dc803504f388b06f5914bf000cb)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:15.499108 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aad87f-4b80-4103-8f8a-9d7f21eee335 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:15.547718 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-e6aad87f-4b80-4103-8f8a-9d7f21eee335 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af176dc803504f388b06f5914bf000cb', 'request_id': 'req-e6aad87f-4b80-4103-8f8a-9d7f21eee335'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:15.553863 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-e6aad87f-4b80-4103-8f8a-9d7f21eee335 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af176dc803504f388b06f5914bf000cb', 'request_id': 'req-e6aad87f-4b80-4103-8f8a-9d7f21eee335'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:15.563211 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-e6aad87f-4b80-4103-8f8a-9d7f21eee335 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af176dc803504f388b06f5914bf000cb', 'request_id': 'req-e6aad87f-4b80-4103-8f8a-9d7f21eee335'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:15.574527 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-e6aad87f-4b80-4103-8f8a-9d7f21eee335 admin admin] The token cache is being invalidate because project af176dc803504f388b06f5914bf000cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 22:40:15.574818 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-e6aad87f-4b80-4103-8f8a-9d7f21eee335 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:15.575528 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-e6aad87f-4b80-4103-8f8a-9d7f21eee335 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:15.577122 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1004/1995] 10.222.0.36 () {58 vars in 1232 bytes} [Fri Jun 24 22:40:15 2022] DELETE /identity/v3/projects/af176dc803504f388b06f5914bf000cb => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:40:15.581155 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b097e2-ac99-4b89-ad20-b36d8d424e53 service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:15.591163 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b097e2-ac99-4b89-ad20-b36d8d424e53 service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:15.653504 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28210bd1-bc63-4cc4-8764-8a22d4e6697c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:15.654482 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28210bd1-bc63-4cc4-8764-8a22d4e6697c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:15.654786 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28210bd1-bc63-4cc4-8764-8a22d4e6697c admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:15.655057 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28210bd1-bc63-4cc4-8764-8a22d4e6697c admin admin] PATH_INFO: `/v3/users/fcf97c6921064ffc909616fc4a1dde26` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:15.656303 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28210bd1-bc63-4cc4-8764-8a22d4e6697c admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcf97c6921064ffc909616fc4a1dde26)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:15.658234 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28210bd1-bc63-4cc4-8764-8a22d4e6697c admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:15.707027 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-28210bd1-bc63-4cc4-8764-8a22d4e6697c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcf97c6921064ffc909616fc4a1dde26'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:15.711436 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:40:15.714822 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-28210bd1-bc63-4cc4-8764-8a22d4e6697c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcf97c6921064ffc909616fc4a1dde26'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:15.715630 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-28210bd1-bc63-4cc4-8764-8a22d4e6697c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcf97c6921064ffc909616fc4a1dde26'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:15.716320 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-28210bd1-bc63-4cc4-8764-8a22d4e6697c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcf97c6921064ffc909616fc4a1dde26'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:15.728938 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-28210bd1-bc63-4cc4-8764-8a22d4e6697c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcf97c6921064ffc909616fc4a1dde26'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:15.743164 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 992/1996] 10.222.0.36 () {58 vars in 1223 bytes} [Fri Jun 24 22:40:15 2022] DELETE /identity/v3/users/fcf97c6921064ffc909616fc4a1dde26 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:40:16.140230 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aad87f-4b80-4103-8f8a-9d7f21eee335 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:16.141773 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-e6aad87f-4b80-4103-8f8a-9d7f21eee335 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:16.154546 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aad87f-4b80-4103-8f8a-9d7f21eee335 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:16.222656 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0ead1f-41f0-4f7b-af7a-bd1d5e74cbbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:16.223562 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0ead1f-41f0-4f7b-af7a-bd1d5e74cbbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:16.223831 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0ead1f-41f0-4f7b-af7a-bd1d5e74cbbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:16.224130 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0ead1f-41f0-4f7b-af7a-bd1d5e74cbbe admin admin] PATH_INFO: `/v3/projects/c94197ceacc344b2b7e1351002041dd1` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:16.225299 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0ead1f-41f0-4f7b-af7a-bd1d5e74cbbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=c94197ceacc344b2b7e1351002041dd1)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:16.227274 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0ead1f-41f0-4f7b-af7a-bd1d5e74cbbe admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:16.275580 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-0f0ead1f-41f0-4f7b-af7a-bd1d5e74cbbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c94197ceacc344b2b7e1351002041dd1', 'request_id': 'req-0f0ead1f-41f0-4f7b-af7a-bd1d5e74cbbe'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:16.281709 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-0f0ead1f-41f0-4f7b-af7a-bd1d5e74cbbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c94197ceacc344b2b7e1351002041dd1', 'request_id': 'req-0f0ead1f-41f0-4f7b-af7a-bd1d5e74cbbe'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:16.295849 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-0f0ead1f-41f0-4f7b-af7a-bd1d5e74cbbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c94197ceacc344b2b7e1351002041dd1', 'request_id': 'req-0f0ead1f-41f0-4f7b-af7a-bd1d5e74cbbe'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:16.295849 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:40:16.303452 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-0f0ead1f-41f0-4f7b-af7a-bd1d5e74cbbe admin admin] The token cache is being invalidate because project c94197ceacc344b2b7e1351002041dd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 22:40:16.303986 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-0f0ead1f-41f0-4f7b-af7a-bd1d5e74cbbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:16.304610 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-0f0ead1f-41f0-4f7b-af7a-bd1d5e74cbbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:16.306232 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1005/1997] 10.222.0.36 () {58 vars in 1232 bytes} [Fri Jun 24 22:40:16 2022] DELETE /identity/v3/projects/c94197ceacc344b2b7e1351002041dd1 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:40:16.312652 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f1593f-c3e0-4364-9b8c-542c369b1f9d None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:16.313135 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f1593f-c3e0-4364-9b8c-542c369b1f9d None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:16.313225 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f1593f-c3e0-4364-9b8c-542c369b1f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:16.332518 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-a9f1593f-c3e0-4364-9b8c-542c369b1f9d None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:40:16.333987 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-a9f1593f-c3e0-4364-9b8c-542c369b1f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:16.397288 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 993/1998] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:40:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:40:16.407528 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2d79f9-5aa0-45f0-b910-aabe51fab1fd None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:16.407924 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2d79f9-5aa0-45f0-b910-aabe51fab1fd None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:16.408324 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2d79f9-5aa0-45f0-b910-aabe51fab1fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:16.427926 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-3a2d79f9-5aa0-45f0-b910-aabe51fab1fd None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:40:16.429127 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-3a2d79f9-5aa0-45f0-b910-aabe51fab1fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:16.438155 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1006/1999] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:40:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:40:16.443004 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f1593f-c3e0-4364-9b8c-542c369b1f9d None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:16.453171 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f1593f-c3e0-4364-9b8c-542c369b1f9d None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:16.457805 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87932237-e2b2-42e4-aaab-e89e02d93284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:16.458511 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87932237-e2b2-42e4-aaab-e89e02d93284 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:16.458791 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87932237-e2b2-42e4-aaab-e89e02d93284 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:16.459136 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87932237-e2b2-42e4-aaab-e89e02d93284 admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:16.460009 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87932237-e2b2-42e4-aaab-e89e02d93284 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:40:16.460317 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87932237-e2b2-42e4-aaab-e89e02d93284 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:16.461933 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87932237-e2b2-42e4-aaab-e89e02d93284 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:16.474374 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 994/2000] 10.222.0.36 () {58 vars in 1152 bytes} [Fri Jun 24 22:40:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:40:16.479026 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2d79f9-5aa0-45f0-b910-aabe51fab1fd None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:16.488325 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2d79f9-5aa0-45f0-b910-aabe51fab1fd None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:16.493292 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a26cd4-27f1-47bf-8502-5641002056ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:16.493963 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a26cd4-27f1-47bf-8502-5641002056ca admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:16.494245 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a26cd4-27f1-47bf-8502-5641002056ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:16.494516 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a26cd4-27f1-47bf-8502-5641002056ca admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:16.495265 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a26cd4-27f1-47bf-8502-5641002056ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:16.497195 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a26cd4-27f1-47bf-8502-5641002056ca admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:16.525955 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1007/2001] 10.222.0.36 () {60 vars in 1152 bytes} [Fri Jun 24 22:40:16 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:40:16.530226 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87932237-e2b2-42e4-aaab-e89e02d93284 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:16.540757 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87932237-e2b2-42e4-aaab-e89e02d93284 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:16.598190 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c18e70-3961-472e-aac3-19104b610c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:16.598908 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c18e70-3961-472e-aac3-19104b610c6a admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:16.599403 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c18e70-3961-472e-aac3-19104b610c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:16.599688 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c18e70-3961-472e-aac3-19104b610c6a admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:16.600417 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c18e70-3961-472e-aac3-19104b610c6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:16.602373 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c18e70-3961-472e-aac3-19104b610c6a admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:16.623594 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 995/2002] 10.222.0.36 () {60 vars in 1143 bytes} [Fri Jun 24 22:40:16 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:40:16.628212 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a26cd4-27f1-47bf-8502-5641002056ca admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:16.639232 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a26cd4-27f1-47bf-8502-5641002056ca admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:16.644554 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b88016-fc79-4259-a263-6732773a0ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:16.645260 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b88016-fc79-4259-a263-6732773a0ce0 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:16.645547 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b88016-fc79-4259-a263-6732773a0ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:16.645823 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b88016-fc79-4259-a263-6732773a0ce0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:16.646728 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b88016-fc79-4259-a263-6732773a0ce0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:16.648477 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b88016-fc79-4259-a263-6732773a0ce0 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:16.659326 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1008/2003] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:40:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:40:16.663594 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c18e70-3961-472e-aac3-19104b610c6a admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:16.673863 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c18e70-3961-472e-aac3-19104b610c6a admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:16.679040 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b44e877-619a-4daf-adcb-7327980f391c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:16.679744 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b44e877-619a-4daf-adcb-7327980f391c admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:16.680027 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b44e877-619a-4daf-adcb-7327980f391c admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:16.680303 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b44e877-619a-4daf-adcb-7327980f391c admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:16.681034 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b44e877-619a-4daf-adcb-7327980f391c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:16.682665 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b44e877-619a-4daf-adcb-7327980f391c admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:16.693292 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 996/2004] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:40:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:40:16.698225 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b88016-fc79-4259-a263-6732773a0ce0 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:16.714421 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b88016-fc79-4259-a263-6732773a0ce0 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:16.719820 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726eb397-ccbc-4b37-a05c-c4cb1d8bec47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:16.720712 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726eb397-ccbc-4b37-a05c-c4cb1d8bec47 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:16.720994 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726eb397-ccbc-4b37-a05c-c4cb1d8bec47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:16.721264 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726eb397-ccbc-4b37-a05c-c4cb1d8bec47 admin admin] PATH_INFO: `/v3/projects/adfa6dbe3a7a49fc9202223cf4666759/users/6a5ffb2867534dc2a0d99fb25a3189df/roles/1928787bfcc745419829cd315900ac44` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:16.736067 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726eb397-ccbc-4b37-a05c-c4cb1d8bec47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=adfa6dbe3a7a49fc9202223cf4666759, user_id=6a5ffb2867534dc2a0d99fb25a3189df, role_id=1928787bfcc745419829cd315900ac44)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:16.738725 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726eb397-ccbc-4b37-a05c-c4cb1d8bec47 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:16.754544 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1009/2005] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 22:40:16 2022] PUT /identity/v3/projects/adfa6dbe3a7a49fc9202223cf4666759/users/6a5ffb2867534dc2a0d99fb25a3189df/roles/1928787bfcc745419829cd315900ac44 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:40:16.765353 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7cc92d-c26f-4bbc-9428-e52a90204c7a None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:16.765675 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7cc92d-c26f-4bbc-9428-e52a90204c7a None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:16.765917 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7cc92d-c26f-4bbc-9428-e52a90204c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:16.792620 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-1c7cc92d-c26f-4bbc-9428-e52a90204c7a None None] MFA Rules not processed for user `6a5ffb2867534dc2a0d99fb25a3189df`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:40:16.793878 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-1c7cc92d-c26f-4bbc-9428-e52a90204c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:16.821724 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:40:16.864353 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 997/2006] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:40:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:40:16.868849 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726eb397-ccbc-4b37-a05c-c4cb1d8bec47 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:16.929650 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726eb397-ccbc-4b37-a05c-c4cb1d8bec47 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:16.934561 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec40496b-4217-481d-a94e-75f128b5eeea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:16.935218 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec40496b-4217-481d-a94e-75f128b5eeea admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:16.935523 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec40496b-4217-481d-a94e-75f128b5eeea admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:16.935794 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec40496b-4217-481d-a94e-75f128b5eeea admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:16.936483 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec40496b-4217-481d-a94e-75f128b5eeea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:16.938447 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec40496b-4217-481d-a94e-75f128b5eeea admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:16.966300 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1010/2007] 10.222.0.36 () {60 vars in 1152 bytes} [Fri Jun 24 22:40:16 2022] POST /identity/v3/projects => generated 377 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:40:16.971090 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7cc92d-c26f-4bbc-9428-e52a90204c7a None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:16.987200 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7cc92d-c26f-4bbc-9428-e52a90204c7a None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:17.048878 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8614255-9c90-4263-bc5b-11ab88434fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:17.049677 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8614255-9c90-4263-bc5b-11ab88434fab admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:17.050046 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8614255-9c90-4263-bc5b-11ab88434fab admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:17.050412 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8614255-9c90-4263-bc5b-11ab88434fab admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:17.051374 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8614255-9c90-4263-bc5b-11ab88434fab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:17.053979 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8614255-9c90-4263-bc5b-11ab88434fab admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:17.076290 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 998/2008] 10.222.0.36 () {60 vars in 1143 bytes} [Fri Jun 24 22:40:16 2022] POST /identity/v3/users => generated 289 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:40:17.080312 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec40496b-4217-481d-a94e-75f128b5eeea admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:17.090507 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec40496b-4217-481d-a94e-75f128b5eeea admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:17.095784 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b71ba8-9447-448d-853f-f9f6e60ebe54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:17.096466 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b71ba8-9447-448d-853f-f9f6e60ebe54 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:17.096747 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b71ba8-9447-448d-853f-f9f6e60ebe54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:17.097019 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b71ba8-9447-448d-853f-f9f6e60ebe54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:17.097735 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b71ba8-9447-448d-853f-f9f6e60ebe54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:17.099390 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b71ba8-9447-448d-853f-f9f6e60ebe54 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:17.110518 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1011/2009] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:40:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:40:17.114671 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8614255-9c90-4263-bc5b-11ab88434fab admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:17.124962 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8614255-9c90-4263-bc5b-11ab88434fab admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:17.130241 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9d9dd2-f541-4f0b-b75c-505b9dcb5bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:17.131171 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9d9dd2-f541-4f0b-b75c-505b9dcb5bc2 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:17.131636 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9d9dd2-f541-4f0b-b75c-505b9dcb5bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:17.131883 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9d9dd2-f541-4f0b-b75c-505b9dcb5bc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:17.132682 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9d9dd2-f541-4f0b-b75c-505b9dcb5bc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:17.134463 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9d9dd2-f541-4f0b-b75c-505b9dcb5bc2 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:17.147277 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 999/2010] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:40:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:40:17.151852 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b71ba8-9447-448d-853f-f9f6e60ebe54 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:17.162730 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b71ba8-9447-448d-853f-f9f6e60ebe54 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:17.171078 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad2455c-b91f-4b9f-9096-dc42b8d27ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:17.172142 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad2455c-b91f-4b9f-9096-dc42b8d27ad1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:17.172381 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad2455c-b91f-4b9f-9096-dc42b8d27ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:17.172661 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad2455c-b91f-4b9f-9096-dc42b8d27ad1 admin admin] PATH_INFO: `/v3/projects/1cce79d2aadf486c8d06ceb28c971b67/users/8fffb39821e2477c9680725c12399e22/roles/1928787bfcc745419829cd315900ac44` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:17.189993 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad2455c-b91f-4b9f-9096-dc42b8d27ad1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cce79d2aadf486c8d06ceb28c971b67, user_id=8fffb39821e2477c9680725c12399e22, role_id=1928787bfcc745419829cd315900ac44)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:17.193073 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad2455c-b91f-4b9f-9096-dc42b8d27ad1 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:17.208902 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1012/2011] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 22:40:17 2022] PUT /identity/v3/projects/1cce79d2aadf486c8d06ceb28c971b67/users/8fffb39821e2477c9680725c12399e22/roles/1928787bfcc745419829cd315900ac44 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:40:17.219237 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb9e3f0-2deb-4a75-a828-8438a0c16d49 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:17.219590 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb9e3f0-2deb-4a75-a828-8438a0c16d49 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:17.219843 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb9e3f0-2deb-4a75-a828-8438a0c16d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:17.251979 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-ebb9e3f0-2deb-4a75-a828-8438a0c16d49 None None] MFA Rules not processed for user `8fffb39821e2477c9680725c12399e22`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:40:17.253227 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-ebb9e3f0-2deb-4a75-a828-8438a0c16d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:17.327176 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1000/2012] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:40:17 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:40:17.332118 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad2455c-b91f-4b9f-9096-dc42b8d27ad1 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:17.380915 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=95,keystone:DELETE=1,keystone:INSERT=4 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:40:17.403506 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad2455c-b91f-4b9f-9096-dc42b8d27ad1 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:17.408942 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcaddf4-82f3-403a-a7ac-6d6b8ad9a927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:17.409632 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcaddf4-82f3-403a-a7ac-6d6b8ad9a927 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:17.409915 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcaddf4-82f3-403a-a7ac-6d6b8ad9a927 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:17.410193 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcaddf4-82f3-403a-a7ac-6d6b8ad9a927 admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:17.410897 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcaddf4-82f3-403a-a7ac-6d6b8ad9a927 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:17.413277 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcaddf4-82f3-403a-a7ac-6d6b8ad9a927 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:17.443662 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1013/2013] 10.222.0.36 () {60 vars in 1152 bytes} [Fri Jun 24 22:40:17 2022] POST /identity/v3/projects => generated 377 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:40:17.447942 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb9e3f0-2deb-4a75-a828-8438a0c16d49 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:17.459138 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb9e3f0-2deb-4a75-a828-8438a0c16d49 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:17.496389 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:40:17.527317 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa9e5f1-1062-4ccb-8de2-113e4bb95fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:17.528011 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa9e5f1-1062-4ccb-8de2-113e4bb95fe8 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:17.528296 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa9e5f1-1062-4ccb-8de2-113e4bb95fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:17.528540 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa9e5f1-1062-4ccb-8de2-113e4bb95fe8 admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:17.529257 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa9e5f1-1062-4ccb-8de2-113e4bb95fe8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:17.531186 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa9e5f1-1062-4ccb-8de2-113e4bb95fe8 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:17.552887 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1001/2014] 10.222.0.36 () {60 vars in 1143 bytes} [Fri Jun 24 22:40:17 2022] POST /identity/v3/users => generated 295 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:40:17.556999 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcaddf4-82f3-403a-a7ac-6d6b8ad9a927 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:17.569994 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcaddf4-82f3-403a-a7ac-6d6b8ad9a927 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:17.573825 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f672473-14b0-45f5-9808-a67a606fc695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:17.574487 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f672473-14b0-45f5-9808-a67a606fc695 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:17.574766 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f672473-14b0-45f5-9808-a67a606fc695 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:17.575037 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f672473-14b0-45f5-9808-a67a606fc695 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:17.575797 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f672473-14b0-45f5-9808-a67a606fc695 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:17.577410 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f672473-14b0-45f5-9808-a67a606fc695 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:17.588156 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1014/2015] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:40:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:40:17.592452 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa9e5f1-1062-4ccb-8de2-113e4bb95fe8 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:17.603468 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa9e5f1-1062-4ccb-8de2-113e4bb95fe8 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:17.608319 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0220bac-c6fc-4041-8dad-2f6cca0e25fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:17.609211 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0220bac-c6fc-4041-8dad-2f6cca0e25fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:17.609488 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0220bac-c6fc-4041-8dad-2f6cca0e25fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:17.609755 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0220bac-c6fc-4041-8dad-2f6cca0e25fd admin admin] PATH_INFO: `/v3/projects/fc08d3a8e17e4f89b94f010dedb0092b/users/97f31d1ea0154eb29839b832004c16dc/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:17.624977 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0220bac-c6fc-4041-8dad-2f6cca0e25fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc08d3a8e17e4f89b94f010dedb0092b, user_id=97f31d1ea0154eb29839b832004c16dc, role_id=1a1c43cc97a0407eb7a7c7a1333a9d4a)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:17.628005 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0220bac-c6fc-4041-8dad-2f6cca0e25fd admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:17.642395 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1002/2016] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 22:40:17 2022] PUT /identity/v3/projects/fc08d3a8e17e4f89b94f010dedb0092b/users/97f31d1ea0154eb29839b832004c16dc/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:40:17.646571 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f672473-14b0-45f5-9808-a67a606fc695 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:17.657085 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f672473-14b0-45f5-9808-a67a606fc695 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:17.718660 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a00a664-c3d7-4cae-8920-3efe32ad40bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:17.719390 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a00a664-c3d7-4cae-8920-3efe32ad40bd admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:17.719672 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a00a664-c3d7-4cae-8920-3efe32ad40bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:17.719942 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a00a664-c3d7-4cae-8920-3efe32ad40bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:17.720671 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a00a664-c3d7-4cae-8920-3efe32ad40bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:17.722403 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a00a664-c3d7-4cae-8920-3efe32ad40bd admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:17.732894 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1015/2017] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:40:17 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:40:17.737403 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0220bac-c6fc-4041-8dad-2f6cca0e25fd admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:17.748874 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0220bac-c6fc-4041-8dad-2f6cca0e25fd admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:17.754348 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a432d4-ad86-4128-85ba-d1375d94f412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:17.755554 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a432d4-ad86-4128-85ba-d1375d94f412 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:17.755979 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a432d4-ad86-4128-85ba-d1375d94f412 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:17.756296 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a432d4-ad86-4128-85ba-d1375d94f412 admin admin] PATH_INFO: `/v3/projects/fc08d3a8e17e4f89b94f010dedb0092b/users/97f31d1ea0154eb29839b832004c16dc/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:17.758752 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a432d4-ad86-4128-85ba-d1375d94f412 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc08d3a8e17e4f89b94f010dedb0092b, user_id=97f31d1ea0154eb29839b832004c16dc, role_id=1a1c43cc97a0407eb7a7c7a1333a9d4a)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:17.762159 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a432d4-ad86-4128-85ba-d1375d94f412 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:17.773942 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1003/2018] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 22:40:17 2022] PUT /identity/v3/projects/fc08d3a8e17e4f89b94f010dedb0092b/users/97f31d1ea0154eb29839b832004c16dc/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:40:17.785240 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb854ea-9564-46f7-bdaf-ae1aced13469 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:17.785535 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb854ea-9564-46f7-bdaf-ae1aced13469 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:17.785809 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb854ea-9564-46f7-bdaf-ae1aced13469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:17.812780 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-5bb854ea-9564-46f7-bdaf-ae1aced13469 None None] MFA Rules not processed for user `97f31d1ea0154eb29839b832004c16dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:40:17.813981 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-5bb854ea-9564-46f7-bdaf-ae1aced13469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:17.884924 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1016/2019] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:40:17 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:40:17.896506 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a432d4-ad86-4128-85ba-d1375d94f412 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:17.898293 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-84a432d4-ad86-4128-85ba-d1375d94f412 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:17.960359 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a432d4-ad86-4128-85ba-d1375d94f412 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:17.965104 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d16f4f8-893f-4e9e-a026-eadd7a168013 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a747e2a5684843a6ee9e3480badac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:17.965757 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d16f4f8-893f-4e9e-a026-eadd7a168013 service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:17.966042 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d16f4f8-893f-4e9e-a026-eadd7a168013 service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:17.966316 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d16f4f8-893f-4e9e-a026-eadd7a168013 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:17.976509 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d16f4f8-893f-4e9e-a026-eadd7a168013 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:17.977986 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d16f4f8-893f-4e9e-a026-eadd7a168013 service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:17.987893 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1004/2020] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:40:17 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:40:18.039737 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb854ea-9564-46f7-bdaf-ae1aced13469 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:18.041327 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-5bb854ea-9564-46f7-bdaf-ae1aced13469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:18.054058 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb854ea-9564-46f7-bdaf-ae1aced13469 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:18.057878 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce93a25-a5fd-44bf-9361-2e8e94db9445 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a747e2a5684843a6ee9e3480badac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:18.058606 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce93a25-a5fd-44bf-9361-2e8e94db9445 service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:18.058884 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce93a25-a5fd-44bf-9361-2e8e94db9445 service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:18.059179 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce93a25-a5fd-44bf-9361-2e8e94db9445 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:18.093815 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:40:18.123164 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce93a25-a5fd-44bf-9361-2e8e94db9445 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:18.124652 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce93a25-a5fd-44bf-9361-2e8e94db9445 service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:18.134421 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1017/2021] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:40:18 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:40:22.105776 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d16f4f8-893f-4e9e-a026-eadd7a168013 service cinder] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:22.107310 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-0d16f4f8-893f-4e9e-a026-eadd7a168013 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:22.213788 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d16f4f8-893f-4e9e-a026-eadd7a168013 service cinder] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:22.220422 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e6edb9-ae56-41d9-b9b5-c5e21ef6cbf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:22.221450 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e6edb9-ae56-41d9-b9b5-c5e21ef6cbf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:22.221895 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e6edb9-ae56-41d9-b9b5-c5e21ef6cbf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:22.222075 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e6edb9-ae56-41d9-b9b5-c5e21ef6cbf3 admin admin] PATH_INFO: `/v3/users/e2cdc695f9f3414981749051faa62c33` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:22.223522 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e6edb9-ae56-41d9-b9b5-c5e21ef6cbf3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2cdc695f9f3414981749051faa62c33)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:22.227164 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e6edb9-ae56-41d9-b9b5-c5e21ef6cbf3 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:22.274247 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:40:22.296153 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-30e6edb9-ae56-41d9-b9b5-c5e21ef6cbf3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2cdc695f9f3414981749051faa62c33'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:22.305021 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-30e6edb9-ae56-41d9-b9b5-c5e21ef6cbf3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2cdc695f9f3414981749051faa62c33'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:22.305792 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-30e6edb9-ae56-41d9-b9b5-c5e21ef6cbf3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2cdc695f9f3414981749051faa62c33'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:22.306387 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-30e6edb9-ae56-41d9-b9b5-c5e21ef6cbf3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2cdc695f9f3414981749051faa62c33'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:22.320502 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-30e6edb9-ae56-41d9-b9b5-c5e21ef6cbf3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2cdc695f9f3414981749051faa62c33'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:22.336861 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1005/2022] 10.222.0.36 () {58 vars in 1223 bytes} [Fri Jun 24 22:40:22 2022] DELETE /identity/v3/users/e2cdc695f9f3414981749051faa62c33 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:40:22.341768 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbad7c69-cb3b-40e3-a783-0e9cf8811e9f None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:22.342239 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbad7c69-cb3b-40e3-a783-0e9cf8811e9f None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:22.342514 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbad7c69-cb3b-40e3-a783-0e9cf8811e9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:22.364850 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-fbad7c69-cb3b-40e3-a783-0e9cf8811e9f None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:40:22.366363 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-fbad7c69-cb3b-40e3-a783-0e9cf8811e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:22.450414 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1018/2023] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:40:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 22:40:22.460653 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e6edb9-ae56-41d9-b9b5-c5e21ef6cbf3 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:22.462330 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-30e6edb9-ae56-41d9-b9b5-c5e21ef6cbf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:22.536898 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e6edb9-ae56-41d9-b9b5-c5e21ef6cbf3 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:22.542893 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375817c9-c295-43aa-9b40-2f2b3843b41b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:22.545304 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375817c9-c295-43aa-9b40-2f2b3843b41b service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:22.545304 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375817c9-c295-43aa-9b40-2f2b3843b41b service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:22.545304 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375817c9-c295-43aa-9b40-2f2b3843b41b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:22.557036 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375817c9-c295-43aa-9b40-2f2b3843b41b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:22.558509 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375817c9-c295-43aa-9b40-2f2b3843b41b service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:22.576558 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1006/2024] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:40:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:40:23.188279 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbad7c69-cb3b-40e3-a783-0e9cf8811e9f None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:23.190462 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-fbad7c69-cb3b-40e3-a783-0e9cf8811e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:23.209854 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbad7c69-cb3b-40e3-a783-0e9cf8811e9f None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:23.222870 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eec44fe-33f4-464a-9a17-642cdac43624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:23.224062 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec44fe-33f4-464a-9a17-642cdac43624 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:23.224356 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec44fe-33f4-464a-9a17-642cdac43624 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:23.224810 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec44fe-33f4-464a-9a17-642cdac43624 admin admin] PATH_INFO: `/v3/projects/8709d9269a83498283816268ded6a352` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:23.226735 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eec44fe-33f4-464a-9a17-642cdac43624 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8709d9269a83498283816268ded6a352)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:23.229177 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eec44fe-33f4-464a-9a17-642cdac43624 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:23.335335 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-9eec44fe-33f4-464a-9a17-642cdac43624 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8709d9269a83498283816268ded6a352', 'request_id': 'req-9eec44fe-33f4-464a-9a17-642cdac43624'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:23.353086 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-9eec44fe-33f4-464a-9a17-642cdac43624 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8709d9269a83498283816268ded6a352', 'request_id': 'req-9eec44fe-33f4-464a-9a17-642cdac43624'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:23.375022 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-9eec44fe-33f4-464a-9a17-642cdac43624 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8709d9269a83498283816268ded6a352', 'request_id': 'req-9eec44fe-33f4-464a-9a17-642cdac43624'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:23.397842 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-9eec44fe-33f4-464a-9a17-642cdac43624 admin admin] The token cache is being invalidate because project 8709d9269a83498283816268ded6a352 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 22:40:23.398326 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-9eec44fe-33f4-464a-9a17-642cdac43624 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:23.399472 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-9eec44fe-33f4-464a-9a17-642cdac43624 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:23.401423 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1019/2025] 10.222.0.36 () {58 vars in 1232 bytes} [Fri Jun 24 22:40:23 2022] DELETE /identity/v3/projects/8709d9269a83498283816268ded6a352 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:40:23.423948 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375817c9-c295-43aa-9b40-2f2b3843b41b service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:23.426250 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-375817c9-c295-43aa-9b40-2f2b3843b41b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:23.466102 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375817c9-c295-43aa-9b40-2f2b3843b41b service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:23.598957 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a7ac4-5187-4540-b290-e91103441f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:23.600891 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a7ac4-5187-4540-b290-e91103441f47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:23.601486 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a7ac4-5187-4540-b290-e91103441f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:23.601904 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a7ac4-5187-4540-b290-e91103441f47 admin admin] PATH_INFO: `/v3/users/6a5ffb2867534dc2a0d99fb25a3189df` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:23.603614 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2a7ac4-5187-4540-b290-e91103441f47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a5ffb2867534dc2a0d99fb25a3189df)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:23.605938 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2a7ac4-5187-4540-b290-e91103441f47 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:23.660454 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-2a2a7ac4-5187-4540-b290-e91103441f47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a5ffb2867534dc2a0d99fb25a3189df'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:23.665262 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:40:23.668509 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-2a2a7ac4-5187-4540-b290-e91103441f47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a5ffb2867534dc2a0d99fb25a3189df'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:23.669357 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-2a2a7ac4-5187-4540-b290-e91103441f47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a5ffb2867534dc2a0d99fb25a3189df'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:23.670516 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-2a2a7ac4-5187-4540-b290-e91103441f47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a5ffb2867534dc2a0d99fb25a3189df'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:23.685202 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-2a2a7ac4-5187-4540-b290-e91103441f47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a5ffb2867534dc2a0d99fb25a3189df'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:23.699157 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1007/2026] 10.222.0.36 () {58 vars in 1223 bytes} [Fri Jun 24 22:40:23 2022] DELETE /identity/v3/users/6a5ffb2867534dc2a0d99fb25a3189df => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:40:23.704212 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f31f3-7f46-469b-aa4b-17f35133c127 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:23.704501 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f31f3-7f46-469b-aa4b-17f35133c127 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:23.704776 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f31f3-7f46-469b-aa4b-17f35133c127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:23.724214 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-652f31f3-7f46-469b-aa4b-17f35133c127 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:40:23.725431 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-652f31f3-7f46-469b-aa4b-17f35133c127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:23.778361 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:40:23.799329 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1020/2027] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:40:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:40:23.803336 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a7ac4-5187-4540-b290-e91103441f47 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:23.804959 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-2a2a7ac4-5187-4540-b290-e91103441f47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:23.882039 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a7ac4-5187-4540-b290-e91103441f47 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:23.886236 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cd74ee-28eb-4b61-b705-892327efc391 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:23.886901 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd74ee-28eb-4b61-b705-892327efc391 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:23.887187 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd74ee-28eb-4b61-b705-892327efc391 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:23.887599 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd74ee-28eb-4b61-b705-892327efc391 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:23.898247 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cd74ee-28eb-4b61-b705-892327efc391 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:23.899555 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cd74ee-28eb-4b61-b705-892327efc391 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:23.915484 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1008/2028] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:40:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:40:24.192140 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652f31f3-7f46-469b-aa4b-17f35133c127 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:24.193788 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-652f31f3-7f46-469b-aa4b-17f35133c127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:24.206481 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652f31f3-7f46-469b-aa4b-17f35133c127 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:24.211708 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6bb573-0fd1-4a9a-9c1c-eb72ef21f2e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:24.212597 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6bb573-0fd1-4a9a-9c1c-eb72ef21f2e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:24.212875 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6bb573-0fd1-4a9a-9c1c-eb72ef21f2e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:24.213179 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6bb573-0fd1-4a9a-9c1c-eb72ef21f2e7 admin admin] PATH_INFO: `/v3/projects/adfa6dbe3a7a49fc9202223cf4666759` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:24.214349 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6bb573-0fd1-4a9a-9c1c-eb72ef21f2e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=adfa6dbe3a7a49fc9202223cf4666759)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:24.216356 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6bb573-0fd1-4a9a-9c1c-eb72ef21f2e7 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:24.267446 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-3a6bb573-0fd1-4a9a-9c1c-eb72ef21f2e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adfa6dbe3a7a49fc9202223cf4666759', 'request_id': 'req-3a6bb573-0fd1-4a9a-9c1c-eb72ef21f2e7'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:24.273731 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-3a6bb573-0fd1-4a9a-9c1c-eb72ef21f2e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adfa6dbe3a7a49fc9202223cf4666759', 'request_id': 'req-3a6bb573-0fd1-4a9a-9c1c-eb72ef21f2e7'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:24.282642 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-3a6bb573-0fd1-4a9a-9c1c-eb72ef21f2e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adfa6dbe3a7a49fc9202223cf4666759', 'request_id': 'req-3a6bb573-0fd1-4a9a-9c1c-eb72ef21f2e7'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:24.294473 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-3a6bb573-0fd1-4a9a-9c1c-eb72ef21f2e7 admin admin] The token cache is being invalidate because project adfa6dbe3a7a49fc9202223cf4666759 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 22:40:24.294764 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-3a6bb573-0fd1-4a9a-9c1c-eb72ef21f2e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:24.295501 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-3a6bb573-0fd1-4a9a-9c1c-eb72ef21f2e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:24.297125 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1021/2029] 10.222.0.36 () {58 vars in 1232 bytes} [Fri Jun 24 22:40:24 2022] DELETE /identity/v3/projects/adfa6dbe3a7a49fc9202223cf4666759 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:40:24.301166 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cd74ee-28eb-4b61-b705-892327efc391 service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:24.314116 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cd74ee-28eb-4b61-b705-892327efc391 service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:24.374066 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574fc992-dc3d-4cc8-bcd4-54b18e60213c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:24.375069 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574fc992-dc3d-4cc8-bcd4-54b18e60213c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:24.375385 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574fc992-dc3d-4cc8-bcd4-54b18e60213c admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:24.375663 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574fc992-dc3d-4cc8-bcd4-54b18e60213c admin admin] PATH_INFO: `/v3/users/8fffb39821e2477c9680725c12399e22` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:24.377224 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574fc992-dc3d-4cc8-bcd4-54b18e60213c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fffb39821e2477c9680725c12399e22)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:24.379471 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574fc992-dc3d-4cc8-bcd4-54b18e60213c admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:24.484852 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-574fc992-dc3d-4cc8-bcd4-54b18e60213c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fffb39821e2477c9680725c12399e22'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:24.494617 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6bb573-0fd1-4a9a-9c1c-eb72ef21f2e7 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:24.496158 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-3a6bb573-0fd1-4a9a-9c1c-eb72ef21f2e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:24.499154 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-574fc992-dc3d-4cc8-bcd4-54b18e60213c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fffb39821e2477c9680725c12399e22'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:24.499988 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-574fc992-dc3d-4cc8-bcd4-54b18e60213c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fffb39821e2477c9680725c12399e22'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:24.501152 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-574fc992-dc3d-4cc8-bcd4-54b18e60213c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fffb39821e2477c9680725c12399e22'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:24.509947 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6bb573-0fd1-4a9a-9c1c-eb72ef21f2e7 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:24.514524 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-574fc992-dc3d-4cc8-bcd4-54b18e60213c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fffb39821e2477c9680725c12399e22'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:24.514689 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bce16f3-29ab-4faa-9b79-3ed9fdc8cc8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:24.515711 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bce16f3-29ab-4faa-9b79-3ed9fdc8cc8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:24.516049 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bce16f3-29ab-4faa-9b79-3ed9fdc8cc8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:24.516289 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:40:24.516400 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bce16f3-29ab-4faa-9b79-3ed9fdc8cc8e admin admin] PATH_INFO: `/v3/users/64abbc74691d48f7ba6e71c2dad91d84` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:24.517666 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bce16f3-29ab-4faa-9b79-3ed9fdc8cc8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=64abbc74691d48f7ba6e71c2dad91d84)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:24.519662 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bce16f3-29ab-4faa-9b79-3ed9fdc8cc8e admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:24.531918 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1009/2030] 10.222.0.36 () {58 vars in 1223 bytes} [Fri Jun 24 22:40:24 2022] DELETE /identity/v3/users/8fffb39821e2477c9680725c12399e22 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:40:24.569658 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-5bce16f3-29ab-4faa-9b79-3ed9fdc8cc8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64abbc74691d48f7ba6e71c2dad91d84'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:24.577965 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-5bce16f3-29ab-4faa-9b79-3ed9fdc8cc8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64abbc74691d48f7ba6e71c2dad91d84'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:24.578666 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-5bce16f3-29ab-4faa-9b79-3ed9fdc8cc8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64abbc74691d48f7ba6e71c2dad91d84'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:24.579650 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-5bce16f3-29ab-4faa-9b79-3ed9fdc8cc8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64abbc74691d48f7ba6e71c2dad91d84'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:24.597372 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-5bce16f3-29ab-4faa-9b79-3ed9fdc8cc8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64abbc74691d48f7ba6e71c2dad91d84'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:24.613647 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1022/2031] 10.222.0.36 () {58 vars in 1223 bytes} [Fri Jun 24 22:40:24 2022] DELETE /identity/v3/users/64abbc74691d48f7ba6e71c2dad91d84 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 22:40:24.618513 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4d6e65-020e-4272-a026-d4f4bbaca7a9 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:24.618880 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4d6e65-020e-4272-a026-d4f4bbaca7a9 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:24.619763 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4d6e65-020e-4272-a026-d4f4bbaca7a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:24.643210 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-0b4d6e65-020e-4272-a026-d4f4bbaca7a9 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:40:24.644619 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-0b4d6e65-020e-4272-a026-d4f4bbaca7a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:24.745421 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1010/2032] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:40:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 22:40:24.761516 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bce16f3-29ab-4faa-9b79-3ed9fdc8cc8e admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:24.764167 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-5bce16f3-29ab-4faa-9b79-3ed9fdc8cc8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:24.858265 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bce16f3-29ab-4faa-9b79-3ed9fdc8cc8e admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:24.867541 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71322cf4-f4d0-499b-a332-6727301c5743 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:24.868109 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4d6e65-020e-4272-a026-d4f4bbaca7a9 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:24.868397 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71322cf4-f4d0-499b-a332-6727301c5743 service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:24.868812 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71322cf4-f4d0-499b-a332-6727301c5743 service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:24.869617 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71322cf4-f4d0-499b-a332-6727301c5743 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:24.871845 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-0b4d6e65-020e-4272-a026-d4f4bbaca7a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:24.883714 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:40:24.885419 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4d6e65-020e-4272-a026-d4f4bbaca7a9 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:24.890778 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e368458d-bbaf-4341-84d1-18a464676cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:24.891766 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e368458d-bbaf-4341-84d1-18a464676cb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:24.892054 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e368458d-bbaf-4341-84d1-18a464676cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:24.892335 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e368458d-bbaf-4341-84d1-18a464676cb8 admin admin] PATH_INFO: `/v3/projects/1cce79d2aadf486c8d06ceb28c971b67` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:24.893533 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e368458d-bbaf-4341-84d1-18a464676cb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cce79d2aadf486c8d06ceb28c971b67)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:24.895860 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e368458d-bbaf-4341-84d1-18a464676cb8 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:24.897370 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71322cf4-f4d0-499b-a332-6727301c5743 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:24.900313 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71322cf4-f4d0-499b-a332-6727301c5743 service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:24.917719 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1023/2033] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:40:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:40:24.967786 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e368458d-bbaf-4341-84d1-18a464676cb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cce79d2aadf486c8d06ceb28c971b67', 'request_id': 'req-e368458d-bbaf-4341-84d1-18a464676cb8'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:24.974772 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e368458d-bbaf-4341-84d1-18a464676cb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cce79d2aadf486c8d06ceb28c971b67', 'request_id': 'req-e368458d-bbaf-4341-84d1-18a464676cb8'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:24.984195 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e368458d-bbaf-4341-84d1-18a464676cb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cce79d2aadf486c8d06ceb28c971b67', 'request_id': 'req-e368458d-bbaf-4341-84d1-18a464676cb8'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:24.996554 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e368458d-bbaf-4341-84d1-18a464676cb8 admin admin] The token cache is being invalidate because project 1cce79d2aadf486c8d06ceb28c971b67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 22:40:24.996843 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e368458d-bbaf-4341-84d1-18a464676cb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:24.997586 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e368458d-bbaf-4341-84d1-18a464676cb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:24.999281 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1011/2034] 10.222.0.36 () {58 vars in 1232 bytes} [Fri Jun 24 22:40:24 2022] DELETE /identity/v3/projects/1cce79d2aadf486c8d06ceb28c971b67 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 22:40:25.004020 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71322cf4-f4d0-499b-a332-6727301c5743 service neutron] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:25.013839 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71322cf4-f4d0-499b-a332-6727301c5743 service neutron] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:25.101589 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aaeb2a-8e16-4737-9e8a-39e0709a5e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:25.102707 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aaeb2a-8e16-4737-9e8a-39e0709a5e54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:25.104224 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aaeb2a-8e16-4737-9e8a-39e0709a5e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:25.104694 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aaeb2a-8e16-4737-9e8a-39e0709a5e54 admin admin] PATH_INFO: `/v3/users/97f31d1ea0154eb29839b832004c16dc` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:25.106751 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aaeb2a-8e16-4737-9e8a-39e0709a5e54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97f31d1ea0154eb29839b832004c16dc)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:25.110014 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aaeb2a-8e16-4737-9e8a-39e0709a5e54 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:25.206044 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-f2aaeb2a-8e16-4737-9e8a-39e0709a5e54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97f31d1ea0154eb29839b832004c16dc'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:25.218874 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-f2aaeb2a-8e16-4737-9e8a-39e0709a5e54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97f31d1ea0154eb29839b832004c16dc'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:25.219672 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-f2aaeb2a-8e16-4737-9e8a-39e0709a5e54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97f31d1ea0154eb29839b832004c16dc'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:25.220281 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-f2aaeb2a-8e16-4737-9e8a-39e0709a5e54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97f31d1ea0154eb29839b832004c16dc'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:25.235763 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e368458d-bbaf-4341-84d1-18a464676cb8 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:25.237211 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-e368458d-bbaf-4341-84d1-18a464676cb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:25.243873 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-f2aaeb2a-8e16-4737-9e8a-39e0709a5e54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97f31d1ea0154eb29839b832004c16dc'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:25.251782 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e368458d-bbaf-4341-84d1-18a464676cb8 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:25.256899 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015cbbc9-1c8f-47b6-b29e-ecc373ec8ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:25.257856 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015cbbc9-1c8f-47b6-b29e-ecc373ec8ce1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:25.258124 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015cbbc9-1c8f-47b6-b29e-ecc373ec8ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:25.259513 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015cbbc9-1c8f-47b6-b29e-ecc373ec8ce1 admin admin] PATH_INFO: `/v3/projects/1cb802d165c14102905c43fc4d29122a` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:25.260836 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015cbbc9-1c8f-47b6-b29e-ecc373ec8ce1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cb802d165c14102905c43fc4d29122a)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:25.263823 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015cbbc9-1c8f-47b6-b29e-ecc373ec8ce1 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:25.275379 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1024/2035] 10.222.0.36 () {58 vars in 1223 bytes} [Fri Jun 24 22:40:25 2022] DELETE /identity/v3/users/97f31d1ea0154eb29839b832004c16dc => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:40:25.350172 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-015cbbc9-1c8f-47b6-b29e-ecc373ec8ce1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cb802d165c14102905c43fc4d29122a', 'request_id': 'req-015cbbc9-1c8f-47b6-b29e-ecc373ec8ce1'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:25.358474 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-015cbbc9-1c8f-47b6-b29e-ecc373ec8ce1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cb802d165c14102905c43fc4d29122a', 'request_id': 'req-015cbbc9-1c8f-47b6-b29e-ecc373ec8ce1'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:25.368858 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-015cbbc9-1c8f-47b6-b29e-ecc373ec8ce1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cb802d165c14102905c43fc4d29122a', 'request_id': 'req-015cbbc9-1c8f-47b6-b29e-ecc373ec8ce1'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:25.378736 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:INSERT=3,keystone:DELETE=15,keystone:SELECT=82 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:40:25.384156 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-015cbbc9-1c8f-47b6-b29e-ecc373ec8ce1 admin admin] The token cache is being invalidate because project 1cb802d165c14102905c43fc4d29122a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 22:40:25.384459 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-015cbbc9-1c8f-47b6-b29e-ecc373ec8ce1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:25.385489 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-015cbbc9-1c8f-47b6-b29e-ecc373ec8ce1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:25.388080 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1012/2036] 10.222.0.36 () {58 vars in 1232 bytes} [Fri Jun 24 22:40:25 2022] DELETE /identity/v3/projects/1cb802d165c14102905c43fc4d29122a => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 22:40:25.394542 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aaeb2a-8e16-4737-9e8a-39e0709a5e54 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:25.397358 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-f2aaeb2a-8e16-4737-9e8a-39e0709a5e54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:25.489915 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aaeb2a-8e16-4737-9e8a-39e0709a5e54 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:25.508684 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:40:25.563105 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1841831-dd51-401d-b8eb-e14f9bf91555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:25.564090 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1841831-dd51-401d-b8eb-e14f9bf91555 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:25.564400 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1841831-dd51-401d-b8eb-e14f9bf91555 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:25.564709 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1841831-dd51-401d-b8eb-e14f9bf91555 admin admin] PATH_INFO: `/v3/users/fa3f7898fadb41d8813af11d716a6614` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:25.566049 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1841831-dd51-401d-b8eb-e14f9bf91555 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa3f7898fadb41d8813af11d716a6614)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:25.568144 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1841831-dd51-401d-b8eb-e14f9bf91555 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:25.579997 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015cbbc9-1c8f-47b6-b29e-ecc373ec8ce1 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:25.581557 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-015cbbc9-1c8f-47b6-b29e-ecc373ec8ce1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:25.602078 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015cbbc9-1c8f-47b6-b29e-ecc373ec8ce1 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:25.608295 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec12809-eee7-4bc9-8893-08b0f153fd6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:25.609313 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec12809-eee7-4bc9-8893-08b0f153fd6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:25.609600 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec12809-eee7-4bc9-8893-08b0f153fd6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:25.609865 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec12809-eee7-4bc9-8893-08b0f153fd6f admin admin] PATH_INFO: `/v3/projects/fc08d3a8e17e4f89b94f010dedb0092b` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:25.611045 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec12809-eee7-4bc9-8893-08b0f153fd6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc08d3a8e17e4f89b94f010dedb0092b)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:25.613256 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec12809-eee7-4bc9-8893-08b0f153fd6f admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:25.629309 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-d1841831-dd51-401d-b8eb-e14f9bf91555 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa3f7898fadb41d8813af11d716a6614'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:25.637453 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-d1841831-dd51-401d-b8eb-e14f9bf91555 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa3f7898fadb41d8813af11d716a6614'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:25.638137 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-d1841831-dd51-401d-b8eb-e14f9bf91555 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa3f7898fadb41d8813af11d716a6614'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:25.638808 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-d1841831-dd51-401d-b8eb-e14f9bf91555 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa3f7898fadb41d8813af11d716a6614'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:25.651729 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-d1841831-dd51-401d-b8eb-e14f9bf91555 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa3f7898fadb41d8813af11d716a6614'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:25.661828 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-bec12809-eee7-4bc9-8893-08b0f153fd6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc08d3a8e17e4f89b94f010dedb0092b', 'request_id': 'req-bec12809-eee7-4bc9-8893-08b0f153fd6f'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:25.666925 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1025/2037] 10.222.0.36 () {58 vars in 1223 bytes} [Fri Jun 24 22:40:25 2022] DELETE /identity/v3/users/fa3f7898fadb41d8813af11d716a6614 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:40:25.668361 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-bec12809-eee7-4bc9-8893-08b0f153fd6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc08d3a8e17e4f89b94f010dedb0092b', 'request_id': 'req-bec12809-eee7-4bc9-8893-08b0f153fd6f'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:25.678005 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-bec12809-eee7-4bc9-8893-08b0f153fd6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc08d3a8e17e4f89b94f010dedb0092b', 'request_id': 'req-bec12809-eee7-4bc9-8893-08b0f153fd6f'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:25.689049 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-bec12809-eee7-4bc9-8893-08b0f153fd6f admin admin] The token cache is being invalidate because project fc08d3a8e17e4f89b94f010dedb0092b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 22:40:25.689343 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-bec12809-eee7-4bc9-8893-08b0f153fd6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:25.690045 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-bec12809-eee7-4bc9-8893-08b0f153fd6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:25.691675 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1013/2038] 10.222.0.36 () {58 vars in 1232 bytes} [Fri Jun 24 22:40:25 2022] DELETE /identity/v3/projects/fc08d3a8e17e4f89b94f010dedb0092b => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 22:40:25.697588 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b11a05-cbcd-4e6a-b44d-dfd08f1c2bc4 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:25.697950 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b11a05-cbcd-4e6a-b44d-dfd08f1c2bc4 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:25.698330 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b11a05-cbcd-4e6a-b44d-dfd08f1c2bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:25.716776 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-14b11a05-cbcd-4e6a-b44d-dfd08f1c2bc4 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:40:25.718035 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-14b11a05-cbcd-4e6a-b44d-dfd08f1c2bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:25.782145 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1026/2039] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:40:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:40:25.791177 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e59f0-414a-45f1-9448-40c53cce0d11 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:25.791501 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e59f0-414a-45f1-9448-40c53cce0d11 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:25.791828 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e59f0-414a-45f1-9448-40c53cce0d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:25.811281 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-127e59f0-414a-45f1-9448-40c53cce0d11 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:40:25.812708 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-127e59f0-414a-45f1-9448-40c53cce0d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:25.821425 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1014/2040] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:40:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:40:25.825737 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b11a05-cbcd-4e6a-b44d-dfd08f1c2bc4 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:25.836660 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b11a05-cbcd-4e6a-b44d-dfd08f1c2bc4 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:25.842335 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87d2300-3163-4c6a-836f-15b716167885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:25.843082 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87d2300-3163-4c6a-836f-15b716167885 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:25.843406 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87d2300-3163-4c6a-836f-15b716167885 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:25.843992 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87d2300-3163-4c6a-836f-15b716167885 admin admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:25.844422 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87d2300-3163-4c6a-836f-15b716167885 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:40:25.844734 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87d2300-3163-4c6a-836f-15b716167885 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:25.846532 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87d2300-3163-4c6a-836f-15b716167885 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:25.858849 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1027/2041] 10.222.0.36 () {58 vars in 1152 bytes} [Fri Jun 24 22:40:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:40:25.863357 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127e59f0-414a-45f1-9448-40c53cce0d11 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:25.872797 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127e59f0-414a-45f1-9448-40c53cce0d11 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:25.877956 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e776e4-87db-435c-ac2e-df7ec7c5694f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:25.878740 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e776e4-87db-435c-ac2e-df7ec7c5694f admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:25.879150 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e776e4-87db-435c-ac2e-df7ec7c5694f admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:25.879759 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e776e4-87db-435c-ac2e-df7ec7c5694f admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:25.880713 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e776e4-87db-435c-ac2e-df7ec7c5694f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:25.882735 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e776e4-87db-435c-ac2e-df7ec7c5694f admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:25.913096 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1015/2042] 10.222.0.36 () {60 vars in 1152 bytes} [Fri Jun 24 22:40:25 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:40:25.917275 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87d2300-3163-4c6a-836f-15b716167885 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:25.928111 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87d2300-3163-4c6a-836f-15b716167885 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:25.958753 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:40:25.961161 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e776e4-87db-435c-ac2e-df7ec7c5694f admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:25.963539 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-e5e776e4-87db-435c-ac2e-df7ec7c5694f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:26.023580 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ade9d35-a64c-4db5-8f18-d859fee1661e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:26.023580 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ade9d35-a64c-4db5-8f18-d859fee1661e admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:26.023580 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ade9d35-a64c-4db5-8f18-d859fee1661e admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:26.023580 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ade9d35-a64c-4db5-8f18-d859fee1661e admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:26.023918 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ade9d35-a64c-4db5-8f18-d859fee1661e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:26.025437 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ade9d35-a64c-4db5-8f18-d859fee1661e admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:26.050952 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1028/2043] 10.222.0.36 () {60 vars in 1143 bytes} [Fri Jun 24 22:40:25 2022] POST /identity/v3/users => generated 293 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 22:40:26.055549 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ade9d35-a64c-4db5-8f18-d859fee1661e admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:26.063869 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e776e4-87db-435c-ac2e-df7ec7c5694f admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:26.067480 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ade9d35-a64c-4db5-8f18-d859fee1661e admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:26.070682 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b455d6-9afb-4150-9b41-86c8fe7f8983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:26.071733 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b455d6-9afb-4150-9b41-86c8fe7f8983 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:26.072191 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b455d6-9afb-4150-9b41-86c8fe7f8983 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:26.072472 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ddefc1-213b-4284-b8a7-24bc180582f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:26.072617 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b455d6-9afb-4150-9b41-86c8fe7f8983 admin admin] PATH_INFO: `/v3/projects/fe9fd1ad38ab4e81b003e60c89b50bb8` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:26.073200 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ddefc1-213b-4284-b8a7-24bc180582f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:26.073629 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ddefc1-213b-4284-b8a7-24bc180582f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:26.073903 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ddefc1-213b-4284-b8a7-24bc180582f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:26.074671 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b455d6-9afb-4150-9b41-86c8fe7f8983 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe9fd1ad38ab4e81b003e60c89b50bb8)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:26.074945 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ddefc1-213b-4284-b8a7-24bc180582f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:26.076612 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ddefc1-213b-4284-b8a7-24bc180582f2 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:26.077965 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b455d6-9afb-4150-9b41-86c8fe7f8983 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:26.102116 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1029/2044] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:40:26 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:40:26.107055 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ddefc1-213b-4284-b8a7-24bc180582f2 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:26.120983 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ddefc1-213b-4284-b8a7-24bc180582f2 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:26.133335 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa21ea0b-6382-4a5c-a606-7f078bb71681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:26.134098 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa21ea0b-6382-4a5c-a606-7f078bb71681 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:26.134533 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa21ea0b-6382-4a5c-a606-7f078bb71681 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:26.135053 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa21ea0b-6382-4a5c-a606-7f078bb71681 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:26.136021 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa21ea0b-6382-4a5c-a606-7f078bb71681 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:26.138348 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa21ea0b-6382-4a5c-a606-7f078bb71681 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:26.159692 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1030/2045] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:40:26 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:40:26.162064 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa21ea0b-6382-4a5c-a606-7f078bb71681 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:26.168413 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-19b455d6-9afb-4150-9b41-86c8fe7f8983 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe9fd1ad38ab4e81b003e60c89b50bb8', 'request_id': 'req-19b455d6-9afb-4150-9b41-86c8fe7f8983'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:26.175515 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-19b455d6-9afb-4150-9b41-86c8fe7f8983 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe9fd1ad38ab4e81b003e60c89b50bb8', 'request_id': 'req-19b455d6-9afb-4150-9b41-86c8fe7f8983'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:26.178294 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:40:26.189018 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-19b455d6-9afb-4150-9b41-86c8fe7f8983 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe9fd1ad38ab4e81b003e60c89b50bb8', 'request_id': 'req-19b455d6-9afb-4150-9b41-86c8fe7f8983'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:26.189232 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa21ea0b-6382-4a5c-a606-7f078bb71681 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:26.219096 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-19b455d6-9afb-4150-9b41-86c8fe7f8983 admin admin] The token cache is being invalidate because project fe9fd1ad38ab4e81b003e60c89b50bb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 22:40:26.219456 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-19b455d6-9afb-4150-9b41-86c8fe7f8983 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:26.221307 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-19b455d6-9afb-4150-9b41-86c8fe7f8983 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:26.225672 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1016/2046] 10.222.0.36 () {58 vars in 1232 bytes} [Fri Jun 24 22:40:25 2022] DELETE /identity/v3/projects/fe9fd1ad38ab4e81b003e60c89b50bb8 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:40:26.232129 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe7749f-68c4-4218-849b-70ec9fe3d6f5 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:26.232429 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe7749f-68c4-4218-849b-70ec9fe3d6f5 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:26.232712 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe7749f-68c4-4218-849b-70ec9fe3d6f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:26.257514 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-cbe7749f-68c4-4218-849b-70ec9fe3d6f5 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:40:26.258797 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-cbe7749f-68c4-4218-849b-70ec9fe3d6f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:26.272109 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f001f55-c531-4e23-9eac-afdb354267f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:26.273406 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f001f55-c531-4e23-9eac-afdb354267f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:26.273843 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f001f55-c531-4e23-9eac-afdb354267f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:26.274133 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f001f55-c531-4e23-9eac-afdb354267f9 admin admin] PATH_INFO: `/v3/projects/c11b12e723bc422ca25fd1cd7cda6568/users/463bdbbbfa5c4b2e9a461147001ba198/roles/1928787bfcc745419829cd315900ac44` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:26.291531 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f001f55-c531-4e23-9eac-afdb354267f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c11b12e723bc422ca25fd1cd7cda6568, user_id=463bdbbbfa5c4b2e9a461147001ba198, role_id=1928787bfcc745419829cd315900ac44)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:26.294342 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f001f55-c531-4e23-9eac-afdb354267f9 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:26.313324 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1031/2047] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 22:40:26 2022] PUT /identity/v3/projects/c11b12e723bc422ca25fd1cd7cda6568/users/463bdbbbfa5c4b2e9a461147001ba198/roles/1928787bfcc745419829cd315900ac44 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:40:26.325166 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b90d561-1fb8-4296-bb3d-6b1de72e19f6 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:26.325454 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b90d561-1fb8-4296-bb3d-6b1de72e19f6 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:26.325727 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b90d561-1fb8-4296-bb3d-6b1de72e19f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:26.347563 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1017/2048] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:40:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:40:26.357305 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bdc199-9206-41ab-b305-980adec33d23 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:26.357645 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bdc199-9206-41ab-b305-980adec33d23 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:26.358039 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bdc199-9206-41ab-b305-980adec33d23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:26.375510 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-6b90d561-1fb8-4296-bb3d-6b1de72e19f6 None None] MFA Rules not processed for user `463bdbbbfa5c4b2e9a461147001ba198`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:40:26.377121 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-6b90d561-1fb8-4296-bb3d-6b1de72e19f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:26.412015 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-47bdc199-9206-41ab-b305-980adec33d23 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:40:26.413331 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-47bdc199-9206-41ab-b305-980adec33d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:26.498907 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1018/2049] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:40:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:40:26.503164 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bdc199-9206-41ab-b305-980adec33d23 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:26.519299 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bdc199-9206-41ab-b305-980adec33d23 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:26.519498 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1032/2050] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:40:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:40:26.522642 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b90d561-1fb8-4296-bb3d-6b1de72e19f6 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:26.526444 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-6b90d561-1fb8-4296-bb3d-6b1de72e19f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:26.540002 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678f2d1e-ec3b-4bd3-9932-431d1185a872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:26.541674 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678f2d1e-ec3b-4bd3-9932-431d1185a872 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:26.541674 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678f2d1e-ec3b-4bd3-9932-431d1185a872 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:26.541674 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678f2d1e-ec3b-4bd3-9932-431d1185a872 admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:26.543674 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678f2d1e-ec3b-4bd3-9932-431d1185a872 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:40:26.543953 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b90d561-1fb8-4296-bb3d-6b1de72e19f6 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:26.544360 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678f2d1e-ec3b-4bd3-9932-431d1185a872 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:26.548980 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c57bb65-5c95-41a0-933c-15249893d28d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:26.549206 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678f2d1e-ec3b-4bd3-9932-431d1185a872 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:26.549654 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c57bb65-5c95-41a0-933c-15249893d28d admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:26.549938 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c57bb65-5c95-41a0-933c-15249893d28d admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:26.550206 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c57bb65-5c95-41a0-933c-15249893d28d admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:26.550917 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c57bb65-5c95-41a0-933c-15249893d28d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:26.553158 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c57bb65-5c95-41a0-933c-15249893d28d admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:26.557707 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:40:26.588708 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1019/2051] 10.222.0.36 () {58 vars in 1152 bytes} [Fri Jun 24 22:40:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:40:26.593988 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678f2d1e-ec3b-4bd3-9932-431d1185a872 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:26.600220 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1033/2052] 10.222.0.36 () {60 vars in 1152 bytes} [Fri Jun 24 22:40:26 2022] POST /identity/v3/projects => generated 385 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 22:40:26.605321 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c57bb65-5c95-41a0-933c-15249893d28d admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:26.606945 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678f2d1e-ec3b-4bd3-9932-431d1185a872 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:26.674324 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c57bb65-5c95-41a0-933c-15249893d28d admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:26.675092 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62428543-262b-4e33-bf5e-e34d80dd5370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:26.675878 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62428543-262b-4e33-bf5e-e34d80dd5370 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:26.676224 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62428543-262b-4e33-bf5e-e34d80dd5370 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:26.676565 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62428543-262b-4e33-bf5e-e34d80dd5370 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:26.677372 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62428543-262b-4e33-bf5e-e34d80dd5370 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:26.679176 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077af6dc-c669-4b18-a5ff-a4e3d29e943a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:26.679396 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62428543-262b-4e33-bf5e-e34d80dd5370 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:26.679879 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077af6dc-c669-4b18-a5ff-a4e3d29e943a admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:26.680193 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077af6dc-c669-4b18-a5ff-a4e3d29e943a admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:26.680470 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077af6dc-c669-4b18-a5ff-a4e3d29e943a admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:26.681160 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077af6dc-c669-4b18-a5ff-a4e3d29e943a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:26.683095 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077af6dc-c669-4b18-a5ff-a4e3d29e943a admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:26.693736 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:INSERT=2,keystone:DELETE=3,keystone:SELECT=95 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:40:26.706282 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1034/2053] 10.222.0.36 () {60 vars in 1143 bytes} [Fri Jun 24 22:40:26 2022] POST /identity/v3/users => generated 299 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:40:26.710378 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077af6dc-c669-4b18-a5ff-a4e3d29e943a admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:26.714497 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1020/2054] 10.222.0.36 () {60 vars in 1152 bytes} [Fri Jun 24 22:40:26 2022] POST /identity/v3/projects => generated 373 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:40:26.715492 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62428543-262b-4e33-bf5e-e34d80dd5370 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:26.720640 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077af6dc-c669-4b18-a5ff-a4e3d29e943a admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:26.782880 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74319c8f-bc7a-4bc5-88d8-41462f6e4ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:26.784589 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74319c8f-bc7a-4bc5-88d8-41462f6e4ae5 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:26.784969 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74319c8f-bc7a-4bc5-88d8-41462f6e4ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:26.785443 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74319c8f-bc7a-4bc5-88d8-41462f6e4ae5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:26.786674 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74319c8f-bc7a-4bc5-88d8-41462f6e4ae5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:26.788937 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74319c8f-bc7a-4bc5-88d8-41462f6e4ae5 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:26.792809 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62428543-262b-4e33-bf5e-e34d80dd5370 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:26.798778 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b6cb20-672a-4a57-bf4c-8e04bdb5a3cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:26.799979 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b6cb20-672a-4a57-bf4c-8e04bdb5a3cf admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:26.800446 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1035/2055] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:40:26 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 22:40:26.800557 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b6cb20-672a-4a57-bf4c-8e04bdb5a3cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:26.800688 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b6cb20-672a-4a57-bf4c-8e04bdb5a3cf admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:26.801457 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b6cb20-672a-4a57-bf4c-8e04bdb5a3cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:26.803556 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b6cb20-672a-4a57-bf4c-8e04bdb5a3cf admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:26.804457 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74319c8f-bc7a-4bc5-88d8-41462f6e4ae5 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:26.818638 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74319c8f-bc7a-4bc5-88d8-41462f6e4ae5 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:26.824182 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77752daa-723d-48ce-b4cf-bcccaf8a676c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:26.825379 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77752daa-723d-48ce-b4cf-bcccaf8a676c admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:26.825762 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77752daa-723d-48ce-b4cf-bcccaf8a676c admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:26.826112 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77752daa-723d-48ce-b4cf-bcccaf8a676c admin admin] PATH_INFO: `/v3/projects/e7d9473408fa41898b68b167a68dfebd/users/28e985bf5e624f1dbf5a88f158fe2f7f/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:26.826823 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1021/2056] 10.222.0.36 () {60 vars in 1143 bytes} [Fri Jun 24 22:40:26 2022] POST /identity/v3/users => generated 287 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:40:26.831056 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b6cb20-672a-4a57-bf4c-8e04bdb5a3cf admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:26.843069 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77752daa-723d-48ce-b4cf-bcccaf8a676c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7d9473408fa41898b68b167a68dfebd, user_id=28e985bf5e624f1dbf5a88f158fe2f7f, role_id=1a1c43cc97a0407eb7a7c7a1333a9d4a)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:26.843289 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b6cb20-672a-4a57-bf4c-8e04bdb5a3cf admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:26.846031 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77752daa-723d-48ce-b4cf-bcccaf8a676c admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:26.847853 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe484109-7592-44b4-8954-d313bdcc1547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:26.848576 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe484109-7592-44b4-8954-d313bdcc1547 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:26.848872 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe484109-7592-44b4-8954-d313bdcc1547 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:26.849802 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe484109-7592-44b4-8954-d313bdcc1547 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:26.850638 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe484109-7592-44b4-8954-d313bdcc1547 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:26.852649 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe484109-7592-44b4-8954-d313bdcc1547 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:26.861919 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1036/2057] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 22:40:26 2022] PUT /identity/v3/projects/e7d9473408fa41898b68b167a68dfebd/users/28e985bf5e624f1dbf5a88f158fe2f7f/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 22:40:26.865153 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1022/2058] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:40:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 22:40:26.866474 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77752daa-723d-48ce-b4cf-bcccaf8a676c admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:26.868857 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe484109-7592-44b4-8954-d313bdcc1547 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:26.881337 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe484109-7592-44b4-8954-d313bdcc1547 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:26.932678 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:40:26.951516 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e0f245-0a3e-4e42-934f-5ec335d57c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:26.951978 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77752daa-723d-48ce-b4cf-bcccaf8a676c admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:26.952396 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e0f245-0a3e-4e42-934f-5ec335d57c4c admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:26.952689 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e0f245-0a3e-4e42-934f-5ec335d57c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:26.952966 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e0f245-0a3e-4e42-934f-5ec335d57c4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:26.953994 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e0f245-0a3e-4e42-934f-5ec335d57c4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:26.955692 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e0f245-0a3e-4e42-934f-5ec335d57c4c admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:26.957147 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721198a4-614a-4a45-91a5-2c5cac42a4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:26.957839 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721198a4-614a-4a45-91a5-2c5cac42a4ba admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:26.958158 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721198a4-614a-4a45-91a5-2c5cac42a4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:26.958440 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721198a4-614a-4a45-91a5-2c5cac42a4ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:26.959225 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721198a4-614a-4a45-91a5-2c5cac42a4ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:26.960984 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721198a4-614a-4a45-91a5-2c5cac42a4ba admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:26.968407 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1023/2059] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:40:26 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:40:26.972853 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e0f245-0a3e-4e42-934f-5ec335d57c4c admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:26.975424 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1037/2060] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:40:26 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:40:26.977340 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721198a4-614a-4a45-91a5-2c5cac42a4ba admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:26.984434 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e0f245-0a3e-4e42-934f-5ec335d57c4c admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:26.989783 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc34464d-fcfd-494a-b017-2b886d957eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:26.990403 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721198a4-614a-4a45-91a5-2c5cac42a4ba admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:26.990707 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc34464d-fcfd-494a-b017-2b886d957eb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:26.990991 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc34464d-fcfd-494a-b017-2b886d957eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:26.991296 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc34464d-fcfd-494a-b017-2b886d957eb7 admin admin] PATH_INFO: `/v3/projects/9c4bf2c28dd54ef78743b8ab423c5355/users/f0ea78fc3049444980343a15d178048e/roles/1928787bfcc745419829cd315900ac44` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:26.995846 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2788c0-7cb2-41d8-9ab3-3242208d8b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:26.996859 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2788c0-7cb2-41d8-9ab3-3242208d8b84 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:26.997199 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2788c0-7cb2-41d8-9ab3-3242208d8b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:26.997530 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2788c0-7cb2-41d8-9ab3-3242208d8b84 admin admin] PATH_INFO: `/v3/projects/e7d9473408fa41898b68b167a68dfebd/users/28e985bf5e624f1dbf5a88f158fe2f7f/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:26.999791 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2788c0-7cb2-41d8-9ab3-3242208d8b84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7d9473408fa41898b68b167a68dfebd, user_id=28e985bf5e624f1dbf5a88f158fe2f7f, role_id=1a1c43cc97a0407eb7a7c7a1333a9d4a)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:27.003813 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2788c0-7cb2-41d8-9ab3-3242208d8b84 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:27.008859 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc34464d-fcfd-494a-b017-2b886d957eb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c4bf2c28dd54ef78743b8ab423c5355, user_id=f0ea78fc3049444980343a15d178048e, role_id=1928787bfcc745419829cd315900ac44)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:27.011629 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc34464d-fcfd-494a-b017-2b886d957eb7 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:27.017041 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1038/2061] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 22:40:26 2022] PUT /identity/v3/projects/e7d9473408fa41898b68b167a68dfebd/users/28e985bf5e624f1dbf5a88f158fe2f7f/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 22:40:27.028843 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c33f61-64ec-4da6-aac8-dfe4038605a5 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:27.029469 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c33f61-64ec-4da6-aac8-dfe4038605a5 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:27.029848 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c33f61-64ec-4da6-aac8-dfe4038605a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:27.035204 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1024/2062] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 22:40:26 2022] PUT /identity/v3/projects/9c4bf2c28dd54ef78743b8ab423c5355/users/f0ea78fc3049444980343a15d178048e/roles/1928787bfcc745419829cd315900ac44 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 22:40:27.045944 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8858334-32fd-41bd-81ab-d9421bd3d956 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:27.046284 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8858334-32fd-41bd-81ab-d9421bd3d956 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:27.046509 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8858334-32fd-41bd-81ab-d9421bd3d956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:27.060557 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-81c33f61-64ec-4da6-aac8-dfe4038605a5 None None] MFA Rules not processed for user `28e985bf5e624f1dbf5a88f158fe2f7f`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:40:27.061786 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-81c33f61-64ec-4da6-aac8-dfe4038605a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:27.076235 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-a8858334-32fd-41bd-81ab-d9421bd3d956 None None] MFA Rules not processed for user `f0ea78fc3049444980343a15d178048e`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:40:27.077562 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-a8858334-32fd-41bd-81ab-d9421bd3d956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:27.118992 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:40:27.159846 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1025/2063] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:40:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 22:40:27.165604 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1039/2064] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:40:27 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:40:27.173701 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8858334-32fd-41bd-81ab-d9421bd3d956 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:27.175138 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-a8858334-32fd-41bd-81ab-d9421bd3d956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:27.241435 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8858334-32fd-41bd-81ab-d9421bd3d956 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:27.245208 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e4a2f6-bcee-412a-b178-5d6555683b72 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a747e2a5684843a6ee9e3480badac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:27.245875 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e4a2f6-bcee-412a-b178-5d6555683b72 service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:27.246154 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e4a2f6-bcee-412a-b178-5d6555683b72 service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:27.246532 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e4a2f6-bcee-412a-b178-5d6555683b72 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:27.256707 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e4a2f6-bcee-412a-b178-5d6555683b72 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:27.258430 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e4a2f6-bcee-412a-b178-5d6555683b72 service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:27.270914 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1026/2065] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:40:27 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:40:27.296529 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c33f61-64ec-4da6-aac8-dfe4038605a5 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:27.300838 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e4a2f6-bcee-412a-b178-5d6555683b72 service cinder] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:27.310168 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e4a2f6-bcee-412a-b178-5d6555683b72 service cinder] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:27.315067 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34946be8-7fee-4843-a552-7af75afc5762 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a747e2a5684843a6ee9e3480badac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:27.315807 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34946be8-7fee-4843-a552-7af75afc5762 service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:27.316088 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34946be8-7fee-4843-a552-7af75afc5762 service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:27.316949 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34946be8-7fee-4843-a552-7af75afc5762 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:27.370223 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c33f61-64ec-4da6-aac8-dfe4038605a5 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:27.377033 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a840f4d-6018-4c81-877a-148a70853e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:27.378013 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a840f4d-6018-4c81-877a-148a70853e89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:27.378369 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a840f4d-6018-4c81-877a-148a70853e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:27.378716 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a840f4d-6018-4c81-877a-148a70853e89 admin admin] PATH_INFO: `/v3/users/f0ea78fc3049444980343a15d178048e` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:27.380094 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a840f4d-6018-4c81-877a-148a70853e89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0ea78fc3049444980343a15d178048e)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:27.382285 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a840f4d-6018-4c81-877a-148a70853e89 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:27.384113 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34946be8-7fee-4843-a552-7af75afc5762 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:27.385632 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34946be8-7fee-4843-a552-7af75afc5762 service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:27.395730 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1027/2066] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:40:27 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 22:40:27.446410 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-5a840f4d-6018-4c81-877a-148a70853e89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0ea78fc3049444980343a15d178048e'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:27.453356 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-5a840f4d-6018-4c81-877a-148a70853e89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0ea78fc3049444980343a15d178048e'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:27.454058 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-5a840f4d-6018-4c81-877a-148a70853e89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0ea78fc3049444980343a15d178048e'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:27.454693 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-5a840f4d-6018-4c81-877a-148a70853e89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0ea78fc3049444980343a15d178048e'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:27.455879 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:40:27.469293 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-5a840f4d-6018-4c81-877a-148a70853e89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0ea78fc3049444980343a15d178048e'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:27.486879 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1040/2067] 10.222.0.36 () {58 vars in 1223 bytes} [Fri Jun 24 22:40:27 2022] DELETE /identity/v3/users/f0ea78fc3049444980343a15d178048e => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:40:27.491547 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f05a22-a463-467e-90d4-35d05de9a9f2 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:27.491771 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f05a22-a463-467e-90d4-35d05de9a9f2 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:27.492051 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f05a22-a463-467e-90d4-35d05de9a9f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:27.512928 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-a0f05a22-a463-467e-90d4-35d05de9a9f2 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:40:27.515031 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-a0f05a22-a463-467e-90d4-35d05de9a9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:27.588328 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1028/2068] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:40:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:40:27.607907 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a840f4d-6018-4c81-877a-148a70853e89 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:27.609601 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-5a840f4d-6018-4c81-877a-148a70853e89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:27.696194 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a840f4d-6018-4c81-877a-148a70853e89 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:27.703746 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121d15d5-2ad5-41e8-be8d-672ced11e8bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:27.704956 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121d15d5-2ad5-41e8-be8d-672ced11e8bb service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:27.705292 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121d15d5-2ad5-41e8-be8d-672ced11e8bb service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:27.705658 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121d15d5-2ad5-41e8-be8d-672ced11e8bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:27.730665 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121d15d5-2ad5-41e8-be8d-672ced11e8bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:27.732585 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121d15d5-2ad5-41e8-be8d-672ced11e8bb service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:27.751284 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1041/2069] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:40:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:40:28.120866 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f05a22-a463-467e-90d4-35d05de9a9f2 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:28.122469 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-a0f05a22-a463-467e-90d4-35d05de9a9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:28.137615 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f05a22-a463-467e-90d4-35d05de9a9f2 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:28.142455 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8069b629-002c-474d-831e-b9aea88219ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:28.143416 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8069b629-002c-474d-831e-b9aea88219ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:28.143687 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8069b629-002c-474d-831e-b9aea88219ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:28.143964 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8069b629-002c-474d-831e-b9aea88219ae admin admin] PATH_INFO: `/v3/projects/9c4bf2c28dd54ef78743b8ab423c5355` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:28.145352 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8069b629-002c-474d-831e-b9aea88219ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c4bf2c28dd54ef78743b8ab423c5355)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:28.147686 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8069b629-002c-474d-831e-b9aea88219ae admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:28.160011 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:40:28.202386 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-8069b629-002c-474d-831e-b9aea88219ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c4bf2c28dd54ef78743b8ab423c5355', 'request_id': 'req-8069b629-002c-474d-831e-b9aea88219ae'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:28.209218 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-8069b629-002c-474d-831e-b9aea88219ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c4bf2c28dd54ef78743b8ab423c5355', 'request_id': 'req-8069b629-002c-474d-831e-b9aea88219ae'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:28.217791 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-8069b629-002c-474d-831e-b9aea88219ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c4bf2c28dd54ef78743b8ab423c5355', 'request_id': 'req-8069b629-002c-474d-831e-b9aea88219ae'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:28.228150 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-8069b629-002c-474d-831e-b9aea88219ae admin admin] The token cache is being invalidate because project 9c4bf2c28dd54ef78743b8ab423c5355 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 22:40:28.228436 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-8069b629-002c-474d-831e-b9aea88219ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:28.229083 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-8069b629-002c-474d-831e-b9aea88219ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:28.230633 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1029/2070] 10.222.0.36 () {58 vars in 1232 bytes} [Fri Jun 24 22:40:28 2022] DELETE /identity/v3/projects/9c4bf2c28dd54ef78743b8ab423c5355 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:40:28.235579 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120fbc31-0d7d-426d-baa7-1315489d09ba None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:28.235902 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120fbc31-0d7d-426d-baa7-1315489d09ba None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:28.236184 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120fbc31-0d7d-426d-baa7-1315489d09ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:28.256388 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-120fbc31-0d7d-426d-baa7-1315489d09ba None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:40:28.257894 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-120fbc31-0d7d-426d-baa7-1315489d09ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:28.323032 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1042/2071] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:40:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:40:28.331010 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a25297e-ea39-4cec-9f36-79fd7e889be6 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:28.331327 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a25297e-ea39-4cec-9f36-79fd7e889be6 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:28.331606 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a25297e-ea39-4cec-9f36-79fd7e889be6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:28.352373 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-1a25297e-ea39-4cec-9f36-79fd7e889be6 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:40:28.353580 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-1a25297e-ea39-4cec-9f36-79fd7e889be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:28.365289 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1030/2072] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:40:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:40:28.369593 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120fbc31-0d7d-426d-baa7-1315489d09ba None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:28.379896 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120fbc31-0d7d-426d-baa7-1315489d09ba None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:28.384653 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b22eb5-8418-4be8-9a74-338ecd794871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:28.385299 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b22eb5-8418-4be8-9a74-338ecd794871 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:28.385580 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b22eb5-8418-4be8-9a74-338ecd794871 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:28.385850 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b22eb5-8418-4be8-9a74-338ecd794871 admin admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:28.386569 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b22eb5-8418-4be8-9a74-338ecd794871 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:40:28.386873 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b22eb5-8418-4be8-9a74-338ecd794871 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:28.388592 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b22eb5-8418-4be8-9a74-338ecd794871 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:28.400363 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1043/2073] 10.222.0.36 () {58 vars in 1152 bytes} [Fri Jun 24 22:40:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:40:28.404649 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a25297e-ea39-4cec-9f36-79fd7e889be6 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:28.414027 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a25297e-ea39-4cec-9f36-79fd7e889be6 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:28.419780 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527790f3-9fcf-44f6-82eb-e01c6181a864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:28.420436 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527790f3-9fcf-44f6-82eb-e01c6181a864 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:28.420711 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527790f3-9fcf-44f6-82eb-e01c6181a864 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:28.420986 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527790f3-9fcf-44f6-82eb-e01c6181a864 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:28.421677 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527790f3-9fcf-44f6-82eb-e01c6181a864 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:28.423623 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527790f3-9fcf-44f6-82eb-e01c6181a864 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:28.455645 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1031/2074] 10.222.0.36 () {60 vars in 1152 bytes} [Fri Jun 24 22:40:28 2022] POST /identity/v3/projects => generated 389 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:40:28.462008 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b22eb5-8418-4be8-9a74-338ecd794871 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:28.475617 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b22eb5-8418-4be8-9a74-338ecd794871 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:28.534278 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a86a58a-cdd4-47c8-b049-24d0d6523363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:28.534874 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a86a58a-cdd4-47c8-b049-24d0d6523363 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:28.535161 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a86a58a-cdd4-47c8-b049-24d0d6523363 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:28.535476 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a86a58a-cdd4-47c8-b049-24d0d6523363 admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:28.536247 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a86a58a-cdd4-47c8-b049-24d0d6523363 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:28.538213 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a86a58a-cdd4-47c8-b049-24d0d6523363 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:28.546786 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:40:28.562485 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1044/2075] 10.222.0.36 () {60 vars in 1143 bytes} [Fri Jun 24 22:40:28 2022] POST /identity/v3/users => generated 295 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:40:28.566636 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527790f3-9fcf-44f6-82eb-e01c6181a864 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:28.577368 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527790f3-9fcf-44f6-82eb-e01c6181a864 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:28.582034 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847eaa25-e24c-4f01-909d-edfc77b4ee03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:28.582701 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847eaa25-e24c-4f01-909d-edfc77b4ee03 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:28.583033 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847eaa25-e24c-4f01-909d-edfc77b4ee03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:28.583335 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847eaa25-e24c-4f01-909d-edfc77b4ee03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:28.584077 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847eaa25-e24c-4f01-909d-edfc77b4ee03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:28.585686 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847eaa25-e24c-4f01-909d-edfc77b4ee03 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:28.597739 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1032/2076] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:40:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:40:28.605960 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a86a58a-cdd4-47c8-b049-24d0d6523363 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:28.612582 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a86a58a-cdd4-47c8-b049-24d0d6523363 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:28.618379 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56a7c80-3af3-4e8c-b9f6-22ff9db1eb87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:28.619039 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a7c80-3af3-4e8c-b9f6-22ff9db1eb87 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:28.619329 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a7c80-3af3-4e8c-b9f6-22ff9db1eb87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:28.619600 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a7c80-3af3-4e8c-b9f6-22ff9db1eb87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:28.620323 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56a7c80-3af3-4e8c-b9f6-22ff9db1eb87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:28.621968 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56a7c80-3af3-4e8c-b9f6-22ff9db1eb87 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:28.634237 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1045/2077] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:40:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:40:28.638580 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847eaa25-e24c-4f01-909d-edfc77b4ee03 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:28.652746 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847eaa25-e24c-4f01-909d-edfc77b4ee03 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:28.659840 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054e1d0b-e629-4b3f-9c33-87b0c1fea30b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:28.661192 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e1d0b-e629-4b3f-9c33-87b0c1fea30b admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:28.661472 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e1d0b-e629-4b3f-9c33-87b0c1fea30b admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:28.661744 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e1d0b-e629-4b3f-9c33-87b0c1fea30b admin admin] PATH_INFO: `/v3/projects/6a6326b916f641c39bc7e5d2399c02f4/users/97e7819579c34a7dbc0afe67de0dc3eb/roles/1928787bfcc745419829cd315900ac44` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:28.678108 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054e1d0b-e629-4b3f-9c33-87b0c1fea30b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a6326b916f641c39bc7e5d2399c02f4, user_id=97e7819579c34a7dbc0afe67de0dc3eb, role_id=1928787bfcc745419829cd315900ac44)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:28.680826 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054e1d0b-e629-4b3f-9c33-87b0c1fea30b admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:28.705033 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1033/2078] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 22:40:28 2022] PUT /identity/v3/projects/6a6326b916f641c39bc7e5d2399c02f4/users/97e7819579c34a7dbc0afe67de0dc3eb/roles/1928787bfcc745419829cd315900ac44 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:40:28.708566 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc4e1b5-0657-41e8-ad92-2144ae08569b None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:28.708859 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc4e1b5-0657-41e8-ad92-2144ae08569b None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:28.709134 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc4e1b5-0657-41e8-ad92-2144ae08569b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:28.738428 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-acc4e1b5-0657-41e8-ad92-2144ae08569b None None] MFA Rules not processed for user `97e7819579c34a7dbc0afe67de0dc3eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:40:28.739738 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-acc4e1b5-0657-41e8-ad92-2144ae08569b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:28.808463 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1046/2079] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:40:28 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:40:28.819525 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054e1d0b-e629-4b3f-9c33-87b0c1fea30b admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:28.821315 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-054e1d0b-e629-4b3f-9c33-87b0c1fea30b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:28.881901 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054e1d0b-e629-4b3f-9c33-87b0c1fea30b admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:28.885625 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03318b75-b82a-4707-a570-8f5465902e95 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a747e2a5684843a6ee9e3480badac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:28.886277 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03318b75-b82a-4707-a570-8f5465902e95 service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:28.886562 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03318b75-b82a-4707-a570-8f5465902e95 service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:28.886836 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03318b75-b82a-4707-a570-8f5465902e95 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:28.897432 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03318b75-b82a-4707-a570-8f5465902e95 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:28.899201 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03318b75-b82a-4707-a570-8f5465902e95 service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:28.908907 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1034/2080] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:40:28 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:40:38.805160 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:INSERT=1,keystone:SELECT=39 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:40:38.904558 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=72,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:40:40.482769 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc4e1b5-0657-41e8-ad92-2144ae08569b None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:40.493886 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc4e1b5-0657-41e8-ad92-2144ae08569b None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:40.498280 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1355da30-656a-4fcb-8f73-ad2a06eb1600 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a747e2a5684843a6ee9e3480badac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:40.499055 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1355da30-656a-4fcb-8f73-ad2a06eb1600 service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:40.499286 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1355da30-656a-4fcb-8f73-ad2a06eb1600 service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:40.500581 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1355da30-656a-4fcb-8f73-ad2a06eb1600 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:40.502919 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-1355da30-656a-4fcb-8f73-ad2a06eb1600 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:40.577074 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1355da30-656a-4fcb-8f73-ad2a06eb1600 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:40.578738 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1355da30-656a-4fcb-8f73-ad2a06eb1600 service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:40.589854 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1047/2081] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:40:40 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:40:41.851411 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03318b75-b82a-4707-a570-8f5465902e95 service cinder] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:41.853529 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-03318b75-b82a-4707-a570-8f5465902e95 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:41.927680 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03318b75-b82a-4707-a570-8f5465902e95 service cinder] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:41.932314 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24e278c-ab45-41d1-a372-08fd3e4d0f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:41.933192 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e278c-ab45-41d1-a372-08fd3e4d0f09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:41.933467 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e278c-ab45-41d1-a372-08fd3e4d0f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:41.933740 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e278c-ab45-41d1-a372-08fd3e4d0f09 admin admin] PATH_INFO: `/v3/users/30e106e5b6ec4c77ada9da1da9894a5f` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:41.934926 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24e278c-ab45-41d1-a372-08fd3e4d0f09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30e106e5b6ec4c77ada9da1da9894a5f)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:41.936884 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24e278c-ab45-41d1-a372-08fd3e4d0f09 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:41.995422 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e24e278c-ab45-41d1-a372-08fd3e4d0f09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30e106e5b6ec4c77ada9da1da9894a5f'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:42.007658 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e24e278c-ab45-41d1-a372-08fd3e4d0f09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30e106e5b6ec4c77ada9da1da9894a5f'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:42.008429 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e24e278c-ab45-41d1-a372-08fd3e4d0f09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30e106e5b6ec4c77ada9da1da9894a5f'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:42.009142 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e24e278c-ab45-41d1-a372-08fd3e4d0f09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30e106e5b6ec4c77ada9da1da9894a5f'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:42.021728 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e24e278c-ab45-41d1-a372-08fd3e4d0f09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30e106e5b6ec4c77ada9da1da9894a5f'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:42.036765 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1035/2082] 10.222.0.36 () {58 vars in 1223 bytes} [Fri Jun 24 22:40:41 2022] DELETE /identity/v3/users/30e106e5b6ec4c77ada9da1da9894a5f => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:40:42.041694 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0360e57f-2b87-453a-962c-b0505dfc1056 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:42.042188 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0360e57f-2b87-453a-962c-b0505dfc1056 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:42.042276 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0360e57f-2b87-453a-962c-b0505dfc1056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:42.059433 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-0360e57f-2b87-453a-962c-b0505dfc1056 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:40:42.060612 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-0360e57f-2b87-453a-962c-b0505dfc1056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:42.122912 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1048/2083] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:40:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:40:42.133233 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24e278c-ab45-41d1-a372-08fd3e4d0f09 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:42.134751 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-e24e278c-ab45-41d1-a372-08fd3e4d0f09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:42.193133 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24e278c-ab45-41d1-a372-08fd3e4d0f09 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:42.197500 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9f655c-a2d5-412a-ac55-aa6cb0481d1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:42.198158 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9f655c-a2d5-412a-ac55-aa6cb0481d1c service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:42.198438 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9f655c-a2d5-412a-ac55-aa6cb0481d1c service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:42.198713 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9f655c-a2d5-412a-ac55-aa6cb0481d1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:42.209976 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9f655c-a2d5-412a-ac55-aa6cb0481d1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:42.212806 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9f655c-a2d5-412a-ac55-aa6cb0481d1c service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:42.224350 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1036/2084] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:40:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 22:40:42.837348 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0360e57f-2b87-453a-962c-b0505dfc1056 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:42.838900 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-0360e57f-2b87-453a-962c-b0505dfc1056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:42.851493 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0360e57f-2b87-453a-962c-b0505dfc1056 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:42.857223 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e91693-de25-4f4f-86a4-ad47a9079f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:42.858111 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e91693-de25-4f4f-86a4-ad47a9079f5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:42.858386 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e91693-de25-4f4f-86a4-ad47a9079f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:42.858649 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e91693-de25-4f4f-86a4-ad47a9079f5b admin admin] PATH_INFO: `/v3/projects/9647a2c75f61480d8e1bc8aca876aded` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:42.859974 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e91693-de25-4f4f-86a4-ad47a9079f5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9647a2c75f61480d8e1bc8aca876aded)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:42.862835 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e91693-de25-4f4f-86a4-ad47a9079f5b admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:42.926187 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-26e91693-de25-4f4f-86a4-ad47a9079f5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9647a2c75f61480d8e1bc8aca876aded', 'request_id': 'req-26e91693-de25-4f4f-86a4-ad47a9079f5b'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:42.933163 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-26e91693-de25-4f4f-86a4-ad47a9079f5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9647a2c75f61480d8e1bc8aca876aded', 'request_id': 'req-26e91693-de25-4f4f-86a4-ad47a9079f5b'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:42.942593 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-26e91693-de25-4f4f-86a4-ad47a9079f5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9647a2c75f61480d8e1bc8aca876aded', 'request_id': 'req-26e91693-de25-4f4f-86a4-ad47a9079f5b'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:42.953206 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-26e91693-de25-4f4f-86a4-ad47a9079f5b admin admin] The token cache is being invalidate because project 9647a2c75f61480d8e1bc8aca876aded was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 22:40:42.953493 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-26e91693-de25-4f4f-86a4-ad47a9079f5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:42.954118 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-26e91693-de25-4f4f-86a4-ad47a9079f5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:42.955783 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1049/2085] 10.222.0.36 () {58 vars in 1232 bytes} [Fri Jun 24 22:40:42 2022] DELETE /identity/v3/projects/9647a2c75f61480d8e1bc8aca876aded => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:40:42.960236 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9f655c-a2d5-412a-ac55-aa6cb0481d1c service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:42.970315 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9f655c-a2d5-412a-ac55-aa6cb0481d1c service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:42.993568 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:40:43.036892 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80d9343-c67c-4837-af95-201ccda0ceb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:43.037860 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80d9343-c67c-4837-af95-201ccda0ceb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:43.038148 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80d9343-c67c-4837-af95-201ccda0ceb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:43.038431 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80d9343-c67c-4837-af95-201ccda0ceb6 admin admin] PATH_INFO: `/v3/users/89297268ba6842b9ac106b70cbc177e8` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:43.039728 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80d9343-c67c-4837-af95-201ccda0ceb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89297268ba6842b9ac106b70cbc177e8)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:43.041675 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80d9343-c67c-4837-af95-201ccda0ceb6 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:43.092259 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-b80d9343-c67c-4837-af95-201ccda0ceb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89297268ba6842b9ac106b70cbc177e8'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:43.099042 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-b80d9343-c67c-4837-af95-201ccda0ceb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89297268ba6842b9ac106b70cbc177e8'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:43.099755 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-b80d9343-c67c-4837-af95-201ccda0ceb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89297268ba6842b9ac106b70cbc177e8'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:43.100385 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-b80d9343-c67c-4837-af95-201ccda0ceb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89297268ba6842b9ac106b70cbc177e8'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:43.112346 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-b80d9343-c67c-4837-af95-201ccda0ceb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89297268ba6842b9ac106b70cbc177e8'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:43.127814 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1037/2086] 10.222.0.36 () {58 vars in 1223 bytes} [Fri Jun 24 22:40:42 2022] DELETE /identity/v3/users/89297268ba6842b9ac106b70cbc177e8 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:40:43.434942 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e91693-de25-4f4f-86a4-ad47a9079f5b admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:43.436926 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-26e91693-de25-4f4f-86a4-ad47a9079f5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:43.454594 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e91693-de25-4f4f-86a4-ad47a9079f5b admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:43.469223 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:40:43.519616 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e83155c-00d9-43e9-bd98-7ea24fbd02ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:43.520539 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e83155c-00d9-43e9-bd98-7ea24fbd02ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:43.520825 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e83155c-00d9-43e9-bd98-7ea24fbd02ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:43.521125 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e83155c-00d9-43e9-bd98-7ea24fbd02ca admin admin] PATH_INFO: `/v3/projects/a1c9dd6250b3459297dae887db068b22` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:43.523277 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e83155c-00d9-43e9-bd98-7ea24fbd02ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1c9dd6250b3459297dae887db068b22)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:43.526351 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e83155c-00d9-43e9-bd98-7ea24fbd02ca admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:43.576946 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-9e83155c-00d9-43e9-bd98-7ea24fbd02ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1c9dd6250b3459297dae887db068b22', 'request_id': 'req-9e83155c-00d9-43e9-bd98-7ea24fbd02ca'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:43.582966 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-9e83155c-00d9-43e9-bd98-7ea24fbd02ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1c9dd6250b3459297dae887db068b22', 'request_id': 'req-9e83155c-00d9-43e9-bd98-7ea24fbd02ca'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:43.591907 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-9e83155c-00d9-43e9-bd98-7ea24fbd02ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1c9dd6250b3459297dae887db068b22', 'request_id': 'req-9e83155c-00d9-43e9-bd98-7ea24fbd02ca'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:43.602345 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-9e83155c-00d9-43e9-bd98-7ea24fbd02ca admin admin] The token cache is being invalidate because project a1c9dd6250b3459297dae887db068b22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 22:40:43.602633 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-9e83155c-00d9-43e9-bd98-7ea24fbd02ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:43.603284 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-9e83155c-00d9-43e9-bd98-7ea24fbd02ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:43.604819 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1050/2087] 10.222.0.36 () {58 vars in 1232 bytes} [Fri Jun 24 22:40:43 2022] DELETE /identity/v3/projects/a1c9dd6250b3459297dae887db068b22 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:40:43.609823 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbdbdde-dbcf-4286-81b8-f73086a5697e None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:43.610116 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbdbdde-dbcf-4286-81b8-f73086a5697e None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:43.610378 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbdbdde-dbcf-4286-81b8-f73086a5697e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:43.630128 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-9fbdbdde-dbcf-4286-81b8-f73086a5697e None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:40:43.631401 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-9fbdbdde-dbcf-4286-81b8-f73086a5697e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:43.694561 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1038/2088] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:40:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:40:43.702803 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131a70e9-0fb9-4946-8818-c91765793de2 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:43.703096 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131a70e9-0fb9-4946-8818-c91765793de2 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:43.703408 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131a70e9-0fb9-4946-8818-c91765793de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:43.723858 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-131a70e9-0fb9-4946-8818-c91765793de2 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:40:43.725073 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-131a70e9-0fb9-4946-8818-c91765793de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:43.733462 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1051/2089] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:40:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:40:43.737828 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbdbdde-dbcf-4286-81b8-f73086a5697e None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:43.748381 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbdbdde-dbcf-4286-81b8-f73086a5697e None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:43.754941 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f635a125-cb71-48d7-a1d9-4d004cc88087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:43.756124 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f635a125-cb71-48d7-a1d9-4d004cc88087 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:43.756643 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f635a125-cb71-48d7-a1d9-4d004cc88087 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:43.757190 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f635a125-cb71-48d7-a1d9-4d004cc88087 admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:43.758577 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f635a125-cb71-48d7-a1d9-4d004cc88087 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:40:43.759130 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f635a125-cb71-48d7-a1d9-4d004cc88087 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:43.762279 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f635a125-cb71-48d7-a1d9-4d004cc88087 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:43.776439 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1039/2090] 10.222.0.36 () {58 vars in 1152 bytes} [Fri Jun 24 22:40:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:40:43.780470 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131a70e9-0fb9-4946-8818-c91765793de2 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:43.790125 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131a70e9-0fb9-4946-8818-c91765793de2 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:43.794889 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7973f27f-763b-4232-8a9f-c416adb69926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:43.795678 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7973f27f-763b-4232-8a9f-c416adb69926 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:43.796026 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7973f27f-763b-4232-8a9f-c416adb69926 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:43.796304 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7973f27f-763b-4232-8a9f-c416adb69926 admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:43.797012 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7973f27f-763b-4232-8a9f-c416adb69926 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:43.798966 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7973f27f-763b-4232-8a9f-c416adb69926 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:43.827587 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1052/2091] 10.222.0.36 () {60 vars in 1152 bytes} [Fri Jun 24 22:40:43 2022] POST /identity/v3/projects => generated 387 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:40:43.831810 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f635a125-cb71-48d7-a1d9-4d004cc88087 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:43.842190 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f635a125-cb71-48d7-a1d9-4d004cc88087 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:43.879057 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:40:43.906972 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6639f9b-b470-4368-b74e-ea54212444df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:43.907708 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6639f9b-b470-4368-b74e-ea54212444df admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:43.907993 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6639f9b-b470-4368-b74e-ea54212444df admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:43.908283 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6639f9b-b470-4368-b74e-ea54212444df admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:43.908976 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6639f9b-b470-4368-b74e-ea54212444df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:43.910931 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6639f9b-b470-4368-b74e-ea54212444df admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:43.933317 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1040/2092] 10.222.0.36 () {60 vars in 1143 bytes} [Fri Jun 24 22:40:43 2022] POST /identity/v3/users => generated 294 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:40:43.937278 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7973f27f-763b-4232-8a9f-c416adb69926 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:43.948147 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7973f27f-763b-4232-8a9f-c416adb69926 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:43.953396 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53eb77b-d21d-4cd2-a331-a9ebbff71fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:43.954143 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53eb77b-d21d-4cd2-a331-a9ebbff71fdf admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:43.954489 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53eb77b-d21d-4cd2-a331-a9ebbff71fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:43.954826 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53eb77b-d21d-4cd2-a331-a9ebbff71fdf admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:43.955672 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53eb77b-d21d-4cd2-a331-a9ebbff71fdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:43.957384 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53eb77b-d21d-4cd2-a331-a9ebbff71fdf admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:43.968760 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1053/2093] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:40:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:40:43.972963 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6639f9b-b470-4368-b74e-ea54212444df admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:43.995695 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6639f9b-b470-4368-b74e-ea54212444df admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:44.001983 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5ec13b-c951-4705-90d0-dc03b796dc87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:44.003553 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ec13b-c951-4705-90d0-dc03b796dc87 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:44.003906 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ec13b-c951-4705-90d0-dc03b796dc87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:44.004103 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ec13b-c951-4705-90d0-dc03b796dc87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:44.005016 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5ec13b-c951-4705-90d0-dc03b796dc87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:44.006770 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5ec13b-c951-4705-90d0-dc03b796dc87 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:44.021177 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1041/2094] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:40:43 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:40:44.022481 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53eb77b-d21d-4cd2-a331-a9ebbff71fdf admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:44.034889 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53eb77b-d21d-4cd2-a331-a9ebbff71fdf admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:44.040207 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5610fd-438b-4bc5-8fea-fc3f7ab8adbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:44.041149 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5610fd-438b-4bc5-8fea-fc3f7ab8adbb admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:44.041431 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5610fd-438b-4bc5-8fea-fc3f7ab8adbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:44.041729 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5610fd-438b-4bc5-8fea-fc3f7ab8adbb admin admin] PATH_INFO: `/v3/projects/5e245cb14cb240cfacce214adb72b524/users/46bbc75fa7b6491f8917c0d76e8df835/roles/1928787bfcc745419829cd315900ac44` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:44.062613 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5610fd-438b-4bc5-8fea-fc3f7ab8adbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e245cb14cb240cfacce214adb72b524, user_id=46bbc75fa7b6491f8917c0d76e8df835, role_id=1928787bfcc745419829cd315900ac44)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:44.065323 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5610fd-438b-4bc5-8fea-fc3f7ab8adbb admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:44.081165 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1054/2095] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 22:40:44 2022] PUT /identity/v3/projects/5e245cb14cb240cfacce214adb72b524/users/46bbc75fa7b6491f8917c0d76e8df835/roles/1928787bfcc745419829cd315900ac44 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:40:44.092517 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88438fd3-fae2-4626-95bc-6cfc37e010c4 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:44.092842 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88438fd3-fae2-4626-95bc-6cfc37e010c4 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:44.093122 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88438fd3-fae2-4626-95bc-6cfc37e010c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:44.120776 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-88438fd3-fae2-4626-95bc-6cfc37e010c4 None None] MFA Rules not processed for user `46bbc75fa7b6491f8917c0d76e8df835`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:40:44.122016 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-88438fd3-fae2-4626-95bc-6cfc37e010c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:44.189825 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1042/2096] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:40:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:40:44.194276 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5610fd-438b-4bc5-8fea-fc3f7ab8adbb admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:44.243716 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:40:44.262514 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5610fd-438b-4bc5-8fea-fc3f7ab8adbb admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:44.267997 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad5f832-7c5a-4cc4-a604-10f6d8dd43cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:44.268788 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad5f832-7c5a-4cc4-a604-10f6d8dd43cc admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:44.269072 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad5f832-7c5a-4cc4-a604-10f6d8dd43cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:44.269352 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad5f832-7c5a-4cc4-a604-10f6d8dd43cc admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:44.270082 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad5f832-7c5a-4cc4-a604-10f6d8dd43cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:44.272056 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad5f832-7c5a-4cc4-a604-10f6d8dd43cc admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:44.299281 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1055/2097] 10.222.0.36 () {60 vars in 1152 bytes} [Fri Jun 24 22:40:44 2022] POST /identity/v3/projects => generated 387 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:40:44.303652 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88438fd3-fae2-4626-95bc-6cfc37e010c4 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:44.319891 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88438fd3-fae2-4626-95bc-6cfc37e010c4 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:44.382456 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e14c139-d92d-4bcb-a99e-4c47fa0fee14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:44.383121 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e14c139-d92d-4bcb-a99e-4c47fa0fee14 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:44.383432 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e14c139-d92d-4bcb-a99e-4c47fa0fee14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:44.383709 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e14c139-d92d-4bcb-a99e-4c47fa0fee14 admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:44.384593 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e14c139-d92d-4bcb-a99e-4c47fa0fee14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:44.386541 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e14c139-d92d-4bcb-a99e-4c47fa0fee14 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:44.408141 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1043/2098] 10.222.0.36 () {60 vars in 1143 bytes} [Fri Jun 24 22:40:44 2022] POST /identity/v3/users => generated 300 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:40:44.412352 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad5f832-7c5a-4cc4-a604-10f6d8dd43cc admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:44.423195 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad5f832-7c5a-4cc4-a604-10f6d8dd43cc admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:44.429210 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8accc9f3-03c0-4f70-b0f7-efe990555d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:44.429902 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8accc9f3-03c0-4f70-b0f7-efe990555d50 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:44.430195 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8accc9f3-03c0-4f70-b0f7-efe990555d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:44.430472 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8accc9f3-03c0-4f70-b0f7-efe990555d50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:44.431212 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8accc9f3-03c0-4f70-b0f7-efe990555d50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:44.432885 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8accc9f3-03c0-4f70-b0f7-efe990555d50 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:44.446208 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1056/2099] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:40:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:40:44.450774 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e14c139-d92d-4bcb-a99e-4c47fa0fee14 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:44.461231 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e14c139-d92d-4bcb-a99e-4c47fa0fee14 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:44.466487 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ec7ae3-7561-417d-96be-eac3747fc97b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:44.467447 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ec7ae3-7561-417d-96be-eac3747fc97b admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:44.467737 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ec7ae3-7561-417d-96be-eac3747fc97b admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:44.468011 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ec7ae3-7561-417d-96be-eac3747fc97b admin admin] PATH_INFO: `/v3/projects/d43a7eb4c6a348bfb673c69d76c7a206/users/2ca21fc06bbf42fba22e9a2ee7ff57c5/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:44.483448 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ec7ae3-7561-417d-96be-eac3747fc97b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d43a7eb4c6a348bfb673c69d76c7a206, user_id=2ca21fc06bbf42fba22e9a2ee7ff57c5, role_id=1a1c43cc97a0407eb7a7c7a1333a9d4a)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:44.486154 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ec7ae3-7561-417d-96be-eac3747fc97b admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:44.502765 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1044/2100] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 22:40:44 2022] PUT /identity/v3/projects/d43a7eb4c6a348bfb673c69d76c7a206/users/2ca21fc06bbf42fba22e9a2ee7ff57c5/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 22:40:44.506795 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8accc9f3-03c0-4f70-b0f7-efe990555d50 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:44.517228 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8accc9f3-03c0-4f70-b0f7-efe990555d50 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:44.576298 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eee354-779a-4929-87e1-9a886f3538ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:44.576971 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eee354-779a-4929-87e1-9a886f3538ae admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:44.577287 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eee354-779a-4929-87e1-9a886f3538ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:44.577558 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eee354-779a-4929-87e1-9a886f3538ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:44.578278 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eee354-779a-4929-87e1-9a886f3538ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:44.579942 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eee354-779a-4929-87e1-9a886f3538ae admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:44.590537 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1057/2101] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:40:44 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 22:40:44.594858 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ec7ae3-7561-417d-96be-eac3747fc97b admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:44.600372 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:40:44.606321 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ec7ae3-7561-417d-96be-eac3747fc97b admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:44.611880 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94c612d-b869-414d-ac29-143f628c6b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:44.612765 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94c612d-b869-414d-ac29-143f628c6b2e admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:44.613044 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94c612d-b869-414d-ac29-143f628c6b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:44.613318 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94c612d-b869-414d-ac29-143f628c6b2e admin admin] PATH_INFO: `/v3/projects/d43a7eb4c6a348bfb673c69d76c7a206/users/2ca21fc06bbf42fba22e9a2ee7ff57c5/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:44.615467 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94c612d-b869-414d-ac29-143f628c6b2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d43a7eb4c6a348bfb673c69d76c7a206, user_id=2ca21fc06bbf42fba22e9a2ee7ff57c5, role_id=1a1c43cc97a0407eb7a7c7a1333a9d4a)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:44.618239 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94c612d-b869-414d-ac29-143f628c6b2e admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:44.629083 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1045/2102] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 22:40:44 2022] PUT /identity/v3/projects/d43a7eb4c6a348bfb673c69d76c7a206/users/2ca21fc06bbf42fba22e9a2ee7ff57c5/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:40:44.639354 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2499ae-9591-4d2e-99f4-b81855a35cd9 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:44.639759 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2499ae-9591-4d2e-99f4-b81855a35cd9 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:44.640048 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2499ae-9591-4d2e-99f4-b81855a35cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:44.676037 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-5d2499ae-9591-4d2e-99f4-b81855a35cd9 None None] MFA Rules not processed for user `2ca21fc06bbf42fba22e9a2ee7ff57c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:40:44.677834 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-5d2499ae-9591-4d2e-99f4-b81855a35cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:44.755877 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1058/2103] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:40:44 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:40:44.770421 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94c612d-b869-414d-ac29-143f628c6b2e admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:44.773052 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-a94c612d-b869-414d-ac29-143f628c6b2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:44.834049 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94c612d-b869-414d-ac29-143f628c6b2e admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:44.838196 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792322a1-1d8a-461b-b1a6-c7113a4a5d30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a747e2a5684843a6ee9e3480badac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:44.838851 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792322a1-1d8a-461b-b1a6-c7113a4a5d30 service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:44.839137 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792322a1-1d8a-461b-b1a6-c7113a4a5d30 service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:44.839448 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792322a1-1d8a-461b-b1a6-c7113a4a5d30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:44.848794 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792322a1-1d8a-461b-b1a6-c7113a4a5d30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:44.850256 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792322a1-1d8a-461b-b1a6-c7113a4a5d30 service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:44.859815 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1046/2104] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:40:44 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:40:44.928433 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2499ae-9591-4d2e-99f4-b81855a35cd9 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:44.974917 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:40:44.998056 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2499ae-9591-4d2e-99f4-b81855a35cd9 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:45.003083 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37e3b73-f428-48dd-ac60-72b9208e8975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:45.004016 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37e3b73-f428-48dd-ac60-72b9208e8975 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:45.004394 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37e3b73-f428-48dd-ac60-72b9208e8975 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:45.004676 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37e3b73-f428-48dd-ac60-72b9208e8975 admin admin] PATH_INFO: `/v3/users/46bbc75fa7b6491f8917c0d76e8df835` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:45.005952 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37e3b73-f428-48dd-ac60-72b9208e8975 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46bbc75fa7b6491f8917c0d76e8df835)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:45.008254 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37e3b73-f428-48dd-ac60-72b9208e8975 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:45.064326 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-c37e3b73-f428-48dd-ac60-72b9208e8975 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46bbc75fa7b6491f8917c0d76e8df835'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:45.073826 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-c37e3b73-f428-48dd-ac60-72b9208e8975 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46bbc75fa7b6491f8917c0d76e8df835'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:45.074538 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-c37e3b73-f428-48dd-ac60-72b9208e8975 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46bbc75fa7b6491f8917c0d76e8df835'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:45.075140 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-c37e3b73-f428-48dd-ac60-72b9208e8975 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46bbc75fa7b6491f8917c0d76e8df835'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:45.090647 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-c37e3b73-f428-48dd-ac60-72b9208e8975 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46bbc75fa7b6491f8917c0d76e8df835'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:45.106297 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1059/2105] 10.222.0.36 () {58 vars in 1223 bytes} [Fri Jun 24 22:40:44 2022] DELETE /identity/v3/users/46bbc75fa7b6491f8917c0d76e8df835 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:40:45.111026 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678be639-bb4e-4401-b366-c4ece4657137 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:45.111581 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678be639-bb4e-4401-b366-c4ece4657137 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:45.111689 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678be639-bb4e-4401-b366-c4ece4657137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:45.130550 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-678be639-bb4e-4401-b366-c4ece4657137 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:40:45.131911 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-678be639-bb4e-4401-b366-c4ece4657137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:45.197342 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1047/2106] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:40:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:40:45.204035 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37e3b73-f428-48dd-ac60-72b9208e8975 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:45.210298 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-c37e3b73-f428-48dd-ac60-72b9208e8975 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:45.273456 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37e3b73-f428-48dd-ac60-72b9208e8975 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:45.276975 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aa35ce-cbf8-461e-a845-22cf5d0f506d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:45.277625 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aa35ce-cbf8-461e-a845-22cf5d0f506d service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:45.277902 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aa35ce-cbf8-461e-a845-22cf5d0f506d service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:45.278169 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aa35ce-cbf8-461e-a845-22cf5d0f506d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:45.287119 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aa35ce-cbf8-461e-a845-22cf5d0f506d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:45.288790 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aa35ce-cbf8-461e-a845-22cf5d0f506d service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:45.297962 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1060/2107] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:40:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:40:45.585519 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678be639-bb4e-4401-b366-c4ece4657137 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:45.586968 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-678be639-bb4e-4401-b366-c4ece4657137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:45.601083 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678be639-bb4e-4401-b366-c4ece4657137 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:45.606788 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9f4ed5-25a0-4a4a-8c17-34868750f958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:45.607703 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f4ed5-25a0-4a4a-8c17-34868750f958 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:45.607989 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f4ed5-25a0-4a4a-8c17-34868750f958 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:45.608266 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f4ed5-25a0-4a4a-8c17-34868750f958 admin admin] PATH_INFO: `/v3/projects/5e245cb14cb240cfacce214adb72b524` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:45.609549 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9f4ed5-25a0-4a4a-8c17-34868750f958 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e245cb14cb240cfacce214adb72b524)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:45.611546 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9f4ed5-25a0-4a4a-8c17-34868750f958 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:45.660619 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-be9f4ed5-25a0-4a4a-8c17-34868750f958 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e245cb14cb240cfacce214adb72b524', 'request_id': 'req-be9f4ed5-25a0-4a4a-8c17-34868750f958'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:45.667239 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-be9f4ed5-25a0-4a4a-8c17-34868750f958 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e245cb14cb240cfacce214adb72b524', 'request_id': 'req-be9f4ed5-25a0-4a4a-8c17-34868750f958'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:45.677038 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-be9f4ed5-25a0-4a4a-8c17-34868750f958 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e245cb14cb240cfacce214adb72b524', 'request_id': 'req-be9f4ed5-25a0-4a4a-8c17-34868750f958'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:45.688005 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-be9f4ed5-25a0-4a4a-8c17-34868750f958 admin admin] The token cache is being invalidate because project 5e245cb14cb240cfacce214adb72b524 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 22:40:45.688299 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-be9f4ed5-25a0-4a4a-8c17-34868750f958 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:45.688944 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-be9f4ed5-25a0-4a4a-8c17-34868750f958 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:45.690534 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1048/2108] 10.222.0.36 () {58 vars in 1232 bytes} [Fri Jun 24 22:40:45 2022] DELETE /identity/v3/projects/5e245cb14cb240cfacce214adb72b524 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:40:45.694851 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aa35ce-cbf8-461e-a845-22cf5d0f506d service neutron] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:45.704916 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aa35ce-cbf8-461e-a845-22cf5d0f506d service neutron] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:45.770244 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b5dc15-cb2c-4870-a587-a4d1ea649ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:45.771126 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b5dc15-cb2c-4870-a587-a4d1ea649ee3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:45.771435 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b5dc15-cb2c-4870-a587-a4d1ea649ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:45.771708 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b5dc15-cb2c-4870-a587-a4d1ea649ee3 admin admin] PATH_INFO: `/v3/users/2ca21fc06bbf42fba22e9a2ee7ff57c5` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:45.773146 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b5dc15-cb2c-4870-a587-a4d1ea649ee3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ca21fc06bbf42fba22e9a2ee7ff57c5)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:45.775100 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b5dc15-cb2c-4870-a587-a4d1ea649ee3 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:45.777632 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:40:45.826863 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-46b5dc15-cb2c-4870-a587-a4d1ea649ee3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ca21fc06bbf42fba22e9a2ee7ff57c5'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:45.833991 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-46b5dc15-cb2c-4870-a587-a4d1ea649ee3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ca21fc06bbf42fba22e9a2ee7ff57c5'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:45.834664 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-46b5dc15-cb2c-4870-a587-a4d1ea649ee3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ca21fc06bbf42fba22e9a2ee7ff57c5'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:45.835343 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-46b5dc15-cb2c-4870-a587-a4d1ea649ee3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ca21fc06bbf42fba22e9a2ee7ff57c5'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:45.847601 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-46b5dc15-cb2c-4870-a587-a4d1ea649ee3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ca21fc06bbf42fba22e9a2ee7ff57c5'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:45.862358 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1061/2109] 10.222.0.36 () {58 vars in 1223 bytes} [Fri Jun 24 22:40:45 2022] DELETE /identity/v3/users/2ca21fc06bbf42fba22e9a2ee7ff57c5 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:40:46.165907 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9f4ed5-25a0-4a4a-8c17-34868750f958 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:46.167517 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-be9f4ed5-25a0-4a4a-8c17-34868750f958 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:46.184182 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9f4ed5-25a0-4a4a-8c17-34868750f958 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:46.198540 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:40:46.255645 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6268f9a-66ac-4ed2-8fd0-69bebe94da21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:46.256825 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6268f9a-66ac-4ed2-8fd0-69bebe94da21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:46.257250 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6268f9a-66ac-4ed2-8fd0-69bebe94da21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:46.257689 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6268f9a-66ac-4ed2-8fd0-69bebe94da21 admin admin] PATH_INFO: `/v3/projects/d43a7eb4c6a348bfb673c69d76c7a206` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:46.259086 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6268f9a-66ac-4ed2-8fd0-69bebe94da21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d43a7eb4c6a348bfb673c69d76c7a206)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:46.261433 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6268f9a-66ac-4ed2-8fd0-69bebe94da21 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:46.325108 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-c6268f9a-66ac-4ed2-8fd0-69bebe94da21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd43a7eb4c6a348bfb673c69d76c7a206', 'request_id': 'req-c6268f9a-66ac-4ed2-8fd0-69bebe94da21'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:46.333308 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-c6268f9a-66ac-4ed2-8fd0-69bebe94da21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd43a7eb4c6a348bfb673c69d76c7a206', 'request_id': 'req-c6268f9a-66ac-4ed2-8fd0-69bebe94da21'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:46.345641 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-c6268f9a-66ac-4ed2-8fd0-69bebe94da21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd43a7eb4c6a348bfb673c69d76c7a206', 'request_id': 'req-c6268f9a-66ac-4ed2-8fd0-69bebe94da21'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:46.357637 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-c6268f9a-66ac-4ed2-8fd0-69bebe94da21 admin admin] The token cache is being invalidate because project d43a7eb4c6a348bfb673c69d76c7a206 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 22:40:46.357979 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-c6268f9a-66ac-4ed2-8fd0-69bebe94da21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:46.364067 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-c6268f9a-66ac-4ed2-8fd0-69bebe94da21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:46.369138 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1049/2110] 10.222.0.36 () {58 vars in 1232 bytes} [Fri Jun 24 22:40:46 2022] DELETE /identity/v3/projects/d43a7eb4c6a348bfb673c69d76c7a206 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:40:46.371229 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642c46c6-6754-4a43-be18-3a3fe68bfad7 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:46.371377 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642c46c6-6754-4a43-be18-3a3fe68bfad7 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:46.371787 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642c46c6-6754-4a43-be18-3a3fe68bfad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:46.405332 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-642c46c6-6754-4a43-be18-3a3fe68bfad7 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:40:46.406729 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-642c46c6-6754-4a43-be18-3a3fe68bfad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:46.485406 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1062/2111] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:40:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:40:46.492756 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccd1a29-2ed2-4f59-87eb-1ff8623164d4 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:46.493050 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccd1a29-2ed2-4f59-87eb-1ff8623164d4 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:46.493326 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccd1a29-2ed2-4f59-87eb-1ff8623164d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:46.512133 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-dccd1a29-2ed2-4f59-87eb-1ff8623164d4 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:40:46.513323 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-dccd1a29-2ed2-4f59-87eb-1ff8623164d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:46.521484 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1050/2112] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:40:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:40:46.525938 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642c46c6-6754-4a43-be18-3a3fe68bfad7 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:46.536276 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642c46c6-6754-4a43-be18-3a3fe68bfad7 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:46.541677 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67925e6d-36aa-498e-b5ef-e3779b09a4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:46.542318 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67925e6d-36aa-498e-b5ef-e3779b09a4e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:46.542601 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67925e6d-36aa-498e-b5ef-e3779b09a4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:46.542875 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67925e6d-36aa-498e-b5ef-e3779b09a4e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:46.543633 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67925e6d-36aa-498e-b5ef-e3779b09a4e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:40:46.543941 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67925e6d-36aa-498e-b5ef-e3779b09a4e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:46.545563 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67925e6d-36aa-498e-b5ef-e3779b09a4e2 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:46.557828 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1063/2113] 10.222.0.36 () {58 vars in 1152 bytes} [Fri Jun 24 22:40:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:40:46.562212 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccd1a29-2ed2-4f59-87eb-1ff8623164d4 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:46.571679 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccd1a29-2ed2-4f59-87eb-1ff8623164d4 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:46.576705 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43f99f3-d5ef-4030-a07a-32b3b78412dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:46.577349 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f99f3-d5ef-4030-a07a-32b3b78412dc admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:46.577635 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f99f3-d5ef-4030-a07a-32b3b78412dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:46.577907 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f99f3-d5ef-4030-a07a-32b3b78412dc admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:46.578605 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43f99f3-d5ef-4030-a07a-32b3b78412dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:46.580552 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43f99f3-d5ef-4030-a07a-32b3b78412dc admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:46.609973 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1051/2114] 10.222.0.36 () {60 vars in 1152 bytes} [Fri Jun 24 22:40:46 2022] POST /identity/v3/projects => generated 359 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 22:40:46.613949 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67925e6d-36aa-498e-b5ef-e3779b09a4e2 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:46.624852 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67925e6d-36aa-498e-b5ef-e3779b09a4e2 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:46.681682 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbdd80c-e0b8-4e3b-908f-96e1b0beb84f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:46.682373 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbdd80c-e0b8-4e3b-908f-96e1b0beb84f admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:46.682653 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbdd80c-e0b8-4e3b-908f-96e1b0beb84f admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:46.682922 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbdd80c-e0b8-4e3b-908f-96e1b0beb84f admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:46.683644 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbdd80c-e0b8-4e3b-908f-96e1b0beb84f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:46.685571 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbdd80c-e0b8-4e3b-908f-96e1b0beb84f admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:46.701990 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:40:46.708922 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1064/2115] 10.222.0.36 () {60 vars in 1143 bytes} [Fri Jun 24 22:40:46 2022] POST /identity/v3/users => generated 280 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:40:46.712924 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43f99f3-d5ef-4030-a07a-32b3b78412dc admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:46.723291 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43f99f3-d5ef-4030-a07a-32b3b78412dc admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:46.728524 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a7b819-e144-4aef-bb56-1501ffc5e9c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:46.729186 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a7b819-e144-4aef-bb56-1501ffc5e9c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:46.729467 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a7b819-e144-4aef-bb56-1501ffc5e9c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:46.729736 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a7b819-e144-4aef-bb56-1501ffc5e9c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:46.730461 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a7b819-e144-4aef-bb56-1501ffc5e9c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:46.732109 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a7b819-e144-4aef-bb56-1501ffc5e9c1 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:46.743339 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1052/2116] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:40:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:40:46.747441 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbdd80c-e0b8-4e3b-908f-96e1b0beb84f admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:46.758594 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbdd80c-e0b8-4e3b-908f-96e1b0beb84f admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:46.763599 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef177a4-3d73-4fb7-b3b8-88265c7d9b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:46.764271 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef177a4-3d73-4fb7-b3b8-88265c7d9b0b admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:46.764556 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef177a4-3d73-4fb7-b3b8-88265c7d9b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:46.764829 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef177a4-3d73-4fb7-b3b8-88265c7d9b0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:46.765743 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef177a4-3d73-4fb7-b3b8-88265c7d9b0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:46.767942 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef177a4-3d73-4fb7-b3b8-88265c7d9b0b admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:46.779860 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1065/2117] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:40:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:40:46.784427 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a7b819-e144-4aef-bb56-1501ffc5e9c1 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:46.794899 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a7b819-e144-4aef-bb56-1501ffc5e9c1 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:46.800538 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc07352-b774-4685-b42f-11382487b26d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:46.801426 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc07352-b774-4685-b42f-11382487b26d admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:46.801804 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc07352-b774-4685-b42f-11382487b26d admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:46.802084 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc07352-b774-4685-b42f-11382487b26d admin admin] PATH_INFO: `/v3/projects/d04cb85cfffe4f9d8a3a6fc894e0bb62/users/e7d0963ccfc14076b196793c16cbe631/roles/1928787bfcc745419829cd315900ac44` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:46.818019 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc07352-b774-4685-b42f-11382487b26d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d04cb85cfffe4f9d8a3a6fc894e0bb62, user_id=e7d0963ccfc14076b196793c16cbe631, role_id=1928787bfcc745419829cd315900ac44)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:46.820772 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc07352-b774-4685-b42f-11382487b26d admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:46.838392 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1053/2118] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 22:40:46 2022] PUT /identity/v3/projects/d04cb85cfffe4f9d8a3a6fc894e0bb62/users/e7d0963ccfc14076b196793c16cbe631/roles/1928787bfcc745419829cd315900ac44 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:40:46.850144 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb5c50-036f-449b-a975-1d035a9b5958 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:46.850455 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb5c50-036f-449b-a975-1d035a9b5958 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:46.850732 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb5c50-036f-449b-a975-1d035a9b5958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:46.878784 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-b3eb5c50-036f-449b-a975-1d035a9b5958 None None] MFA Rules not processed for user `e7d0963ccfc14076b196793c16cbe631`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:40:46.880009 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-b3eb5c50-036f-449b-a975-1d035a9b5958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:46.945429 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1066/2119] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:40:46 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:40:46.975850 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc07352-b774-4685-b42f-11382487b26d admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:46.977760 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-0bc07352-b774-4685-b42f-11382487b26d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:47.024988 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:40:47.039064 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc07352-b774-4685-b42f-11382487b26d admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:47.043363 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902323c8-a032-48fb-a940-cd976bba913f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a747e2a5684843a6ee9e3480badac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:47.044036 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902323c8-a032-48fb-a940-cd976bba913f service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:47.044315 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902323c8-a032-48fb-a940-cd976bba913f service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:47.044586 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902323c8-a032-48fb-a940-cd976bba913f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:47.053344 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902323c8-a032-48fb-a940-cd976bba913f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:47.054791 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902323c8-a032-48fb-a940-cd976bba913f service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:47.063589 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1054/2120] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:40:46 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:40:47.077889 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eb5c50-036f-449b-a975-1d035a9b5958 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:47.151448 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eb5c50-036f-449b-a975-1d035a9b5958 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:47.156754 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f30a624-2b2d-47ea-aed2-4491f4a021c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:47.157635 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f30a624-2b2d-47ea-aed2-4491f4a021c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:47.157909 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f30a624-2b2d-47ea-aed2-4491f4a021c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:47.158176 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f30a624-2b2d-47ea-aed2-4491f4a021c2 admin admin] PATH_INFO: `/v3/users/e7d0963ccfc14076b196793c16cbe631` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:47.159430 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f30a624-2b2d-47ea-aed2-4491f4a021c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7d0963ccfc14076b196793c16cbe631)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:47.161364 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f30a624-2b2d-47ea-aed2-4491f4a021c2 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:47.212006 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-1f30a624-2b2d-47ea-aed2-4491f4a021c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7d0963ccfc14076b196793c16cbe631'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:47.223154 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-1f30a624-2b2d-47ea-aed2-4491f4a021c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7d0963ccfc14076b196793c16cbe631'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:47.223881 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-1f30a624-2b2d-47ea-aed2-4491f4a021c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7d0963ccfc14076b196793c16cbe631'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:47.224470 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-1f30a624-2b2d-47ea-aed2-4491f4a021c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7d0963ccfc14076b196793c16cbe631'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:47.236935 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-1f30a624-2b2d-47ea-aed2-4491f4a021c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7d0963ccfc14076b196793c16cbe631'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:47.241536 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:40:47.260582 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1067/2121] 10.222.0.36 () {58 vars in 1223 bytes} [Fri Jun 24 22:40:47 2022] DELETE /identity/v3/users/e7d0963ccfc14076b196793c16cbe631 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:40:47.262284 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23516a7f-3502-4413-9c35-382f6578640c None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:47.262765 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23516a7f-3502-4413-9c35-382f6578640c None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:47.263131 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23516a7f-3502-4413-9c35-382f6578640c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:47.282002 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-23516a7f-3502-4413-9c35-382f6578640c None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:40:47.283155 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-23516a7f-3502-4413-9c35-382f6578640c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:47.357984 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1055/2122] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:40:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:40:47.368610 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f30a624-2b2d-47ea-aed2-4491f4a021c2 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:47.371523 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-1f30a624-2b2d-47ea-aed2-4491f4a021c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:47.434821 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f30a624-2b2d-47ea-aed2-4491f4a021c2 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:47.439265 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64513886-4b7a-4759-bb23-c70ea9f0d00f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:47.441893 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64513886-4b7a-4759-bb23-c70ea9f0d00f service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:47.442189 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64513886-4b7a-4759-bb23-c70ea9f0d00f service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:47.442487 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64513886-4b7a-4759-bb23-c70ea9f0d00f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:47.455118 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64513886-4b7a-4759-bb23-c70ea9f0d00f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:47.456628 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64513886-4b7a-4759-bb23-c70ea9f0d00f service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:47.467340 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1068/2123] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:40:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:40:47.736122 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23516a7f-3502-4413-9c35-382f6578640c None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:47.737639 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-23516a7f-3502-4413-9c35-382f6578640c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:47.750293 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23516a7f-3502-4413-9c35-382f6578640c None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:47.755504 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a498b6-19c1-4817-9f83-ac460483d56f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:47.756351 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a498b6-19c1-4817-9f83-ac460483d56f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:47.756622 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a498b6-19c1-4817-9f83-ac460483d56f admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:47.756891 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a498b6-19c1-4817-9f83-ac460483d56f admin admin] PATH_INFO: `/v3/projects/d04cb85cfffe4f9d8a3a6fc894e0bb62` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:47.758213 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a498b6-19c1-4817-9f83-ac460483d56f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d04cb85cfffe4f9d8a3a6fc894e0bb62)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:47.760207 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a498b6-19c1-4817-9f83-ac460483d56f admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:47.819979 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-f8a498b6-19c1-4817-9f83-ac460483d56f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd04cb85cfffe4f9d8a3a6fc894e0bb62', 'request_id': 'req-f8a498b6-19c1-4817-9f83-ac460483d56f'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:47.826713 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-f8a498b6-19c1-4817-9f83-ac460483d56f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd04cb85cfffe4f9d8a3a6fc894e0bb62', 'request_id': 'req-f8a498b6-19c1-4817-9f83-ac460483d56f'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:47.836786 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-f8a498b6-19c1-4817-9f83-ac460483d56f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd04cb85cfffe4f9d8a3a6fc894e0bb62', 'request_id': 'req-f8a498b6-19c1-4817-9f83-ac460483d56f'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:47.847522 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-f8a498b6-19c1-4817-9f83-ac460483d56f admin admin] The token cache is being invalidate because project d04cb85cfffe4f9d8a3a6fc894e0bb62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 22:40:47.847813 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-f8a498b6-19c1-4817-9f83-ac460483d56f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:47.848494 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-f8a498b6-19c1-4817-9f83-ac460483d56f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:47.850079 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1056/2124] 10.222.0.36 () {58 vars in 1232 bytes} [Fri Jun 24 22:40:47 2022] DELETE /identity/v3/projects/d04cb85cfffe4f9d8a3a6fc894e0bb62 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:40:47.855801 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3aeca1-c3c1-40b2-83f5-9ee90792e425 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:47.856276 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3aeca1-c3c1-40b2-83f5-9ee90792e425 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:47.856483 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3aeca1-c3c1-40b2-83f5-9ee90792e425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:47.874421 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-4d3aeca1-c3c1-40b2-83f5-9ee90792e425 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:40:47.875997 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-4d3aeca1-c3c1-40b2-83f5-9ee90792e425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:47.936680 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1069/2125] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:40:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 22:40:47.947461 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a77513-f04c-44df-b4ed-549a1f4afd35 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:47.947746 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a77513-f04c-44df-b4ed-549a1f4afd35 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:47.948017 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a77513-f04c-44df-b4ed-549a1f4afd35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:47.967075 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-13a77513-f04c-44df-b4ed-549a1f4afd35 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:40:47.968358 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-13a77513-f04c-44df-b4ed-549a1f4afd35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:47.977272 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1057/2126] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:40:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:40:47.981717 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3aeca1-c3c1-40b2-83f5-9ee90792e425 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:47.991922 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3aeca1-c3c1-40b2-83f5-9ee90792e425 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:47.997381 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c1eafa-9b62-4dbe-97e3-32b5edc00d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:47.998044 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c1eafa-9b62-4dbe-97e3-32b5edc00d38 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:47.998323 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c1eafa-9b62-4dbe-97e3-32b5edc00d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:47.998590 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c1eafa-9b62-4dbe-97e3-32b5edc00d38 admin admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:47.999347 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c1eafa-9b62-4dbe-97e3-32b5edc00d38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:40:47.999652 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c1eafa-9b62-4dbe-97e3-32b5edc00d38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:48.001606 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c1eafa-9b62-4dbe-97e3-32b5edc00d38 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:48.013953 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1070/2127] 10.222.0.36 () {58 vars in 1152 bytes} [Fri Jun 24 22:40:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:40:48.019746 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a77513-f04c-44df-b4ed-549a1f4afd35 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:48.034418 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a77513-f04c-44df-b4ed-549a1f4afd35 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:48.041683 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1533be6c-3ac9-418f-b621-f551e1443e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:48.042337 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1533be6c-3ac9-418f-b621-f551e1443e0e admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:48.042606 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1533be6c-3ac9-418f-b621-f551e1443e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:48.042867 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1533be6c-3ac9-418f-b621-f551e1443e0e admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:48.043598 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1533be6c-3ac9-418f-b621-f551e1443e0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:48.045522 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1533be6c-3ac9-418f-b621-f551e1443e0e admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:48.074876 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1058/2128] 10.222.0.36 () {60 vars in 1152 bytes} [Fri Jun 24 22:40:48 2022] POST /identity/v3/projects => generated 375 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:40:48.079006 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c1eafa-9b62-4dbe-97e3-32b5edc00d38 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:48.089217 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c1eafa-9b62-4dbe-97e3-32b5edc00d38 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:48.148301 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3584a4-75db-4a60-bf18-d3f2f7d67e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:48.148967 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3584a4-75db-4a60-bf18-d3f2f7d67e31 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:48.149272 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3584a4-75db-4a60-bf18-d3f2f7d67e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:48.149522 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3584a4-75db-4a60-bf18-d3f2f7d67e31 admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:48.150228 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3584a4-75db-4a60-bf18-d3f2f7d67e31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:48.152214 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3584a4-75db-4a60-bf18-d3f2f7d67e31 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:48.174210 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1071/2129] 10.222.0.36 () {60 vars in 1143 bytes} [Fri Jun 24 22:40:48 2022] POST /identity/v3/users => generated 288 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 22:40:48.177714 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1533be6c-3ac9-418f-b621-f551e1443e0e admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:48.188265 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1533be6c-3ac9-418f-b621-f551e1443e0e admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:48.193995 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dca46ba-c33d-4d96-9c1c-f2be1d0674b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:48.194741 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dca46ba-c33d-4d96-9c1c-f2be1d0674b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:48.195102 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dca46ba-c33d-4d96-9c1c-f2be1d0674b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:48.195415 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dca46ba-c33d-4d96-9c1c-f2be1d0674b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:48.196149 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dca46ba-c33d-4d96-9c1c-f2be1d0674b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:48.197759 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dca46ba-c33d-4d96-9c1c-f2be1d0674b4 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:48.208189 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1059/2130] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:40:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:40:48.212280 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3584a4-75db-4a60-bf18-d3f2f7d67e31 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:48.223293 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3584a4-75db-4a60-bf18-d3f2f7d67e31 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:48.228873 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696f1bee-9b1c-48ac-a091-e2e3cc6b74db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:48.229561 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696f1bee-9b1c-48ac-a091-e2e3cc6b74db admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:48.229852 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696f1bee-9b1c-48ac-a091-e2e3cc6b74db admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:48.230112 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696f1bee-9b1c-48ac-a091-e2e3cc6b74db admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:48.230841 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696f1bee-9b1c-48ac-a091-e2e3cc6b74db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:48.232480 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696f1bee-9b1c-48ac-a091-e2e3cc6b74db admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:48.243457 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1072/2131] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:40:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:40:48.249246 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dca46ba-c33d-4d96-9c1c-f2be1d0674b4 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:48.261571 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dca46ba-c33d-4d96-9c1c-f2be1d0674b4 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:48.269387 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cd131c-1ffa-42b5-80eb-cca4b755ae1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:48.270900 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cd131c-1ffa-42b5-80eb-cca4b755ae1e admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:48.271472 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cd131c-1ffa-42b5-80eb-cca4b755ae1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:48.271941 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cd131c-1ffa-42b5-80eb-cca4b755ae1e admin admin] PATH_INFO: `/v3/projects/9eb8bd9571ba43839bafe3a1c1067389/users/7f0936cc7686412aadf7824831382e3a/roles/1928787bfcc745419829cd315900ac44` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:48.288995 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cd131c-1ffa-42b5-80eb-cca4b755ae1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9eb8bd9571ba43839bafe3a1c1067389, user_id=7f0936cc7686412aadf7824831382e3a, role_id=1928787bfcc745419829cd315900ac44)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:48.291804 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cd131c-1ffa-42b5-80eb-cca4b755ae1e admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:48.307608 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1060/2132] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 22:40:48 2022] PUT /identity/v3/projects/9eb8bd9571ba43839bafe3a1c1067389/users/7f0936cc7686412aadf7824831382e3a/roles/1928787bfcc745419829cd315900ac44 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 22:40:48.318988 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e2040e-45d1-431e-bb3b-302bf7b458da None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:48.319451 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e2040e-45d1-431e-bb3b-302bf7b458da None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:48.320263 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e2040e-45d1-431e-bb3b-302bf7b458da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:48.330283 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:40:48.354784 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-f4e2040e-45d1-431e-bb3b-302bf7b458da None None] MFA Rules not processed for user `7f0936cc7686412aadf7824831382e3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:40:48.356043 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-f4e2040e-45d1-431e-bb3b-302bf7b458da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:48.426325 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1073/2133] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:40:48 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:40:48.438778 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cd131c-1ffa-42b5-80eb-cca4b755ae1e admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:48.440559 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-40cd131c-1ffa-42b5-80eb-cca4b755ae1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:48.447880 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:40:48.505338 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cd131c-1ffa-42b5-80eb-cca4b755ae1e admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:48.512279 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eee58d-671d-425e-a49f-5bf184c9247c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a747e2a5684843a6ee9e3480badac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:48.512949 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eee58d-671d-425e-a49f-5bf184c9247c service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:48.513216 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eee58d-671d-425e-a49f-5bf184c9247c service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:48.513489 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eee58d-671d-425e-a49f-5bf184c9247c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:48.523329 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eee58d-671d-425e-a49f-5bf184c9247c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:48.524909 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eee58d-671d-425e-a49f-5bf184c9247c service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:48.534508 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1061/2134] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:40:48 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:40:54.830956 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e2040e-45d1-431e-bb3b-302bf7b458da None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:54.906675 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e2040e-45d1-431e-bb3b-302bf7b458da None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:54.917622 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b4bff0-23d8-4498-8c34-666d33fc207f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:54.917622 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b4bff0-23d8-4498-8c34-666d33fc207f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:54.917622 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b4bff0-23d8-4498-8c34-666d33fc207f admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:54.917622 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b4bff0-23d8-4498-8c34-666d33fc207f admin admin] PATH_INFO: `/v3/users/7f0936cc7686412aadf7824831382e3a` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:54.918131 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b4bff0-23d8-4498-8c34-666d33fc207f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f0936cc7686412aadf7824831382e3a)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:54.918131 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b4bff0-23d8-4498-8c34-666d33fc207f admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:54.970140 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-e4b4bff0-23d8-4498-8c34-666d33fc207f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f0936cc7686412aadf7824831382e3a'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:54.979761 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-e4b4bff0-23d8-4498-8c34-666d33fc207f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f0936cc7686412aadf7824831382e3a'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:54.980685 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-e4b4bff0-23d8-4498-8c34-666d33fc207f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f0936cc7686412aadf7824831382e3a'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:54.981396 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-e4b4bff0-23d8-4498-8c34-666d33fc207f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f0936cc7686412aadf7824831382e3a'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:54.994661 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-e4b4bff0-23d8-4498-8c34-666d33fc207f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f0936cc7686412aadf7824831382e3a'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:55.008518 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1074/2135] 10.222.0.36 () {58 vars in 1223 bytes} [Fri Jun 24 22:40:54 2022] DELETE /identity/v3/users/7f0936cc7686412aadf7824831382e3a => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:40:55.013220 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7e1a05-b759-4846-b257-9a806ad3ab43 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:55.013741 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7e1a05-b759-4846-b257-9a806ad3ab43 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:55.013848 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7e1a05-b759-4846-b257-9a806ad3ab43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:55.031515 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-5b7e1a05-b759-4846-b257-9a806ad3ab43 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:40:55.032686 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-5b7e1a05-b759-4846-b257-9a806ad3ab43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:55.100717 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1062/2136] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:40:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:40:55.110662 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b4bff0-23d8-4498-8c34-666d33fc207f admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:55.112361 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-e4b4bff0-23d8-4498-8c34-666d33fc207f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:55.127903 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:40:55.172080 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b4bff0-23d8-4498-8c34-666d33fc207f admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:55.175680 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7cef9e-487e-44e5-aeff-e0b5dbff3ff5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:55.176325 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7cef9e-487e-44e5-aeff-e0b5dbff3ff5 service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:55.176608 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7cef9e-487e-44e5-aeff-e0b5dbff3ff5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:55.176882 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7cef9e-487e-44e5-aeff-e0b5dbff3ff5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:55.186156 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7cef9e-487e-44e5-aeff-e0b5dbff3ff5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:55.187639 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7cef9e-487e-44e5-aeff-e0b5dbff3ff5 service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:55.197141 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1075/2137] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:40:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:40:55.482960 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7e1a05-b759-4846-b257-9a806ad3ab43 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:55.484464 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-5b7e1a05-b759-4846-b257-9a806ad3ab43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:55.497121 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7e1a05-b759-4846-b257-9a806ad3ab43 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:55.502221 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879e23ba-8241-4f64-9054-4ab78b9768f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:55.503089 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879e23ba-8241-4f64-9054-4ab78b9768f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:55.503436 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879e23ba-8241-4f64-9054-4ab78b9768f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:55.503821 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879e23ba-8241-4f64-9054-4ab78b9768f2 admin admin] PATH_INFO: `/v3/projects/9eb8bd9571ba43839bafe3a1c1067389` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:55.505007 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879e23ba-8241-4f64-9054-4ab78b9768f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9eb8bd9571ba43839bafe3a1c1067389)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:55.506882 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879e23ba-8241-4f64-9054-4ab78b9768f2 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:55.560696 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-879e23ba-8241-4f64-9054-4ab78b9768f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9eb8bd9571ba43839bafe3a1c1067389', 'request_id': 'req-879e23ba-8241-4f64-9054-4ab78b9768f2'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:55.567445 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-879e23ba-8241-4f64-9054-4ab78b9768f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9eb8bd9571ba43839bafe3a1c1067389', 'request_id': 'req-879e23ba-8241-4f64-9054-4ab78b9768f2'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:55.577104 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-879e23ba-8241-4f64-9054-4ab78b9768f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9eb8bd9571ba43839bafe3a1c1067389', 'request_id': 'req-879e23ba-8241-4f64-9054-4ab78b9768f2'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:55.591486 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-879e23ba-8241-4f64-9054-4ab78b9768f2 admin admin] The token cache is being invalidate because project 9eb8bd9571ba43839bafe3a1c1067389 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 22:40:55.591784 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-879e23ba-8241-4f64-9054-4ab78b9768f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:55.592534 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-879e23ba-8241-4f64-9054-4ab78b9768f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:55.594261 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1063/2138] 10.222.0.36 () {58 vars in 1232 bytes} [Fri Jun 24 22:40:55 2022] DELETE /identity/v3/projects/9eb8bd9571ba43839bafe3a1c1067389 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:40:55.599233 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5839ecef-a906-47f5-ac06-e895e7fadd76 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:55.599558 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5839ecef-a906-47f5-ac06-e895e7fadd76 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:55.599842 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5839ecef-a906-47f5-ac06-e895e7fadd76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:55.618691 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-5839ecef-a906-47f5-ac06-e895e7fadd76 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:40:55.619969 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-5839ecef-a906-47f5-ac06-e895e7fadd76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:55.697248 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1076/2139] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:40:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:40:55.706092 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d423938-fd24-420c-98fa-6c8ff27376e3 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:55.706568 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d423938-fd24-420c-98fa-6c8ff27376e3 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:55.706919 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d423938-fd24-420c-98fa-6c8ff27376e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:55.732490 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-1d423938-fd24-420c-98fa-6c8ff27376e3 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:40:55.733716 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-1d423938-fd24-420c-98fa-6c8ff27376e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:55.741908 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1064/2140] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:40:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:40:55.747174 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5839ecef-a906-47f5-ac06-e895e7fadd76 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:55.761766 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5839ecef-a906-47f5-ac06-e895e7fadd76 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:55.767532 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1d0581-5104-4c2f-a2fc-27e631105af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:55.768332 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1d0581-5104-4c2f-a2fc-27e631105af1 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:55.768671 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1d0581-5104-4c2f-a2fc-27e631105af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:55.769005 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1d0581-5104-4c2f-a2fc-27e631105af1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:55.770057 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1d0581-5104-4c2f-a2fc-27e631105af1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:40:55.770484 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1d0581-5104-4c2f-a2fc-27e631105af1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:55.772420 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1d0581-5104-4c2f-a2fc-27e631105af1 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:55.786569 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1077/2141] 10.222.0.36 () {58 vars in 1152 bytes} [Fri Jun 24 22:40:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:40:55.792388 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d423938-fd24-420c-98fa-6c8ff27376e3 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:55.805653 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d423938-fd24-420c-98fa-6c8ff27376e3 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:55.810883 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dd9547-ddf6-4423-a6bf-8aa00579eaa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:55.811586 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd9547-ddf6-4423-a6bf-8aa00579eaa3 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:55.811867 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd9547-ddf6-4423-a6bf-8aa00579eaa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:55.812143 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd9547-ddf6-4423-a6bf-8aa00579eaa3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:55.812899 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dd9547-ddf6-4423-a6bf-8aa00579eaa3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:55.814811 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dd9547-ddf6-4423-a6bf-8aa00579eaa3 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:55.843047 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1065/2142] 10.222.0.36 () {60 vars in 1152 bytes} [Fri Jun 24 22:40:55 2022] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:40:55.848593 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1d0581-5104-4c2f-a2fc-27e631105af1 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:55.858970 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1d0581-5104-4c2f-a2fc-27e631105af1 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:55.922353 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a3b910-6012-4bd0-9a4c-0e64d35f4a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:55.923033 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a3b910-6012-4bd0-9a4c-0e64d35f4a69 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:55.923341 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a3b910-6012-4bd0-9a4c-0e64d35f4a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:55.923618 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a3b910-6012-4bd0-9a4c-0e64d35f4a69 admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:55.924363 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a3b910-6012-4bd0-9a4c-0e64d35f4a69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:55.926306 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a3b910-6012-4bd0-9a4c-0e64d35f4a69 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:55.951136 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1078/2143] 10.222.0.36 () {60 vars in 1143 bytes} [Fri Jun 24 22:40:55 2022] POST /identity/v3/users => generated 289 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:40:55.955375 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dd9547-ddf6-4423-a6bf-8aa00579eaa3 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:55.961259 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:40:55.968391 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dd9547-ddf6-4423-a6bf-8aa00579eaa3 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:55.974337 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b37da8e-cf7f-4e80-a2b4-3438734282a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:55.975215 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b37da8e-cf7f-4e80-a2b4-3438734282a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:55.978214 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b37da8e-cf7f-4e80-a2b4-3438734282a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:55.978214 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b37da8e-cf7f-4e80-a2b4-3438734282a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:55.978214 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b37da8e-cf7f-4e80-a2b4-3438734282a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:55.981329 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b37da8e-cf7f-4e80-a2b4-3438734282a2 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:55.992337 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1066/2144] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:40:55 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:40:55.996387 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a3b910-6012-4bd0-9a4c-0e64d35f4a69 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:56.007039 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a3b910-6012-4bd0-9a4c-0e64d35f4a69 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:56.012026 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2791ea9b-2fc2-429c-b672-561c51442909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:56.012717 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2791ea9b-2fc2-429c-b672-561c51442909 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:56.012996 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2791ea9b-2fc2-429c-b672-561c51442909 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:56.013418 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2791ea9b-2fc2-429c-b672-561c51442909 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:56.014156 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2791ea9b-2fc2-429c-b672-561c51442909 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:56.015857 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2791ea9b-2fc2-429c-b672-561c51442909 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:56.031507 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1079/2145] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:40:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:40:56.032690 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b37da8e-cf7f-4e80-a2b4-3438734282a2 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:56.050139 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b37da8e-cf7f-4e80-a2b4-3438734282a2 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:56.056794 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d4d3c4-551c-4780-8972-6266dc0cda44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:56.056989 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2791ea9b-2fc2-429c-b672-561c51442909 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:56.057916 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d4d3c4-551c-4780-8972-6266dc0cda44 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:56.058272 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d4d3c4-551c-4780-8972-6266dc0cda44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:56.058651 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d4d3c4-551c-4780-8972-6266dc0cda44 admin admin] PATH_INFO: `/v3/projects/4fb4482274fb4cbd986a2ead2229cfff/users/ab9b6eb622e84746b6d5068c912be6c8/roles/1928787bfcc745419829cd315900ac44` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:56.059634 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-2791ea9b-2fc2-429c-b672-561c51442909 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:56.073071 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2791ea9b-2fc2-429c-b672-561c51442909 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:56.078126 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f623a25-b978-461a-b010-35cc94365efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:56.078352 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d4d3c4-551c-4780-8972-6266dc0cda44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fb4482274fb4cbd986a2ead2229cfff, user_id=ab9b6eb622e84746b6d5068c912be6c8, role_id=1928787bfcc745419829cd315900ac44)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:56.079060 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f623a25-b978-461a-b010-35cc94365efc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:56.079377 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f623a25-b978-461a-b010-35cc94365efc admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:56.079659 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f623a25-b978-461a-b010-35cc94365efc admin admin] PATH_INFO: `/v3/users/463bdbbbfa5c4b2e9a461147001ba198` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:56.081479 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d4d3c4-551c-4780-8972-6266dc0cda44 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:56.081790 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f623a25-b978-461a-b010-35cc94365efc admin admin] RBAC: Authorizing `identity:delete_user(user_id=463bdbbbfa5c4b2e9a461147001ba198)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:56.083837 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f623a25-b978-461a-b010-35cc94365efc admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:56.103124 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1067/2146] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 22:40:56 2022] PUT /identity/v3/projects/4fb4482274fb4cbd986a2ead2229cfff/users/ab9b6eb622e84746b6d5068c912be6c8/roles/1928787bfcc745419829cd315900ac44 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 22:40:56.104635 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:40:56.114827 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cee4021-2bfa-4327-81df-282b6b99b7fc None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:56.115398 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cee4021-2bfa-4327-81df-282b6b99b7fc None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:56.115825 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cee4021-2bfa-4327-81df-282b6b99b7fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:56.151238 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-2cee4021-2bfa-4327-81df-282b6b99b7fc None None] MFA Rules not processed for user `ab9b6eb622e84746b6d5068c912be6c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:40:56.152822 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-2cee4021-2bfa-4327-81df-282b6b99b7fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:56.158019 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-1f623a25-b978-461a-b010-35cc94365efc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '463bdbbbfa5c4b2e9a461147001ba198'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:56.172883 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-1f623a25-b978-461a-b010-35cc94365efc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '463bdbbbfa5c4b2e9a461147001ba198'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:56.173939 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-1f623a25-b978-461a-b010-35cc94365efc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '463bdbbbfa5c4b2e9a461147001ba198'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:56.174628 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-1f623a25-b978-461a-b010-35cc94365efc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '463bdbbbfa5c4b2e9a461147001ba198'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:56.190193 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-1f623a25-b978-461a-b010-35cc94365efc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '463bdbbbfa5c4b2e9a461147001ba198'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:56.207878 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1080/2147] 10.222.0.36 () {58 vars in 1223 bytes} [Fri Jun 24 22:40:56 2022] DELETE /identity/v3/users/463bdbbbfa5c4b2e9a461147001ba198 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:40:56.213729 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271eabdc-a06c-4a58-9d9f-e577ae368e67 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:56.214281 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271eabdc-a06c-4a58-9d9f-e577ae368e67 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:56.214634 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271eabdc-a06c-4a58-9d9f-e577ae368e67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:56.235995 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-271eabdc-a06c-4a58-9d9f-e577ae368e67 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:40:56.237200 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-271eabdc-a06c-4a58-9d9f-e577ae368e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:56.244644 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1068/2148] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:40:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:40:56.249204 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cee4021-2bfa-4327-81df-282b6b99b7fc None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:56.250977 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-2cee4021-2bfa-4327-81df-282b6b99b7fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:56.308932 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1081/2149] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:40:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:40:56.321090 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271eabdc-a06c-4a58-9d9f-e577ae368e67 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:56.322974 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-271eabdc-a06c-4a58-9d9f-e577ae368e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:56.329625 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cee4021-2bfa-4327-81df-282b6b99b7fc None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:56.337457 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9733cf5d-a336-4cb5-a5be-16ea5f4b5c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:56.338617 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9733cf5d-a336-4cb5-a5be-16ea5f4b5c6d admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:56.339125 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9733cf5d-a336-4cb5-a5be-16ea5f4b5c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:56.339707 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9733cf5d-a336-4cb5-a5be-16ea5f4b5c6d admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:56.340917 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9733cf5d-a336-4cb5-a5be-16ea5f4b5c6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:56.343137 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9733cf5d-a336-4cb5-a5be-16ea5f4b5c6d admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:56.373522 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1069/2150] 10.222.0.36 () {60 vars in 1152 bytes} [Fri Jun 24 22:40:56 2022] POST /identity/v3/projects => generated 377 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:40:56.377585 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9733cf5d-a336-4cb5-a5be-16ea5f4b5c6d admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:56.396097 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271eabdc-a06c-4a58-9d9f-e577ae368e67 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:56.443755 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:40:56.454191 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3ec99f-2639-400a-81e2-8d9f523434d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:56.454858 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3ec99f-2639-400a-81e2-8d9f523434d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:56.455141 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3ec99f-2639-400a-81e2-8d9f523434d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:56.455594 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3ec99f-2639-400a-81e2-8d9f523434d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:56.461248 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9733cf5d-a336-4cb5-a5be-16ea5f4b5c6d admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:56.463787 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:40:56.467477 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4eac92-c8ce-441d-bcc5-87a54797b341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:56.468175 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4eac92-c8ce-441d-bcc5-87a54797b341 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:56.468455 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4eac92-c8ce-441d-bcc5-87a54797b341 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:56.468724 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4eac92-c8ce-441d-bcc5-87a54797b341 admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:56.468969 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3ec99f-2639-400a-81e2-8d9f523434d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:56.469416 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4eac92-c8ce-441d-bcc5-87a54797b341 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:56.471312 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3ec99f-2639-400a-81e2-8d9f523434d0 service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:56.471444 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4eac92-c8ce-441d-bcc5-87a54797b341 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:56.483737 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1082/2151] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:40:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 22:40:56.494942 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1070/2152] 10.222.0.36 () {60 vars in 1143 bytes} [Fri Jun 24 22:40:56 2022] POST /identity/v3/users => generated 289 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:40:56.499319 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3ec99f-2639-400a-81e2-8d9f523434d0 service neutron] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:56.509862 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3ec99f-2639-400a-81e2-8d9f523434d0 service neutron] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:56.514690 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65ab731-4349-472f-9666-ba9746255d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:56.515395 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65ab731-4349-472f-9666-ba9746255d8b admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:56.515679 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65ab731-4349-472f-9666-ba9746255d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:56.515954 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65ab731-4349-472f-9666-ba9746255d8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:56.516688 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65ab731-4349-472f-9666-ba9746255d8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:56.518323 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65ab731-4349-472f-9666-ba9746255d8b admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:56.529557 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1083/2153] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:40:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:40:56.533540 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4eac92-c8ce-441d-bcc5-87a54797b341 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:56.545138 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4eac92-c8ce-441d-bcc5-87a54797b341 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:56.550165 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006ae60b-3967-4267-b13b-beba4be4110d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:56.550857 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006ae60b-3967-4267-b13b-beba4be4110d admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:56.551143 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006ae60b-3967-4267-b13b-beba4be4110d admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:56.551454 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006ae60b-3967-4267-b13b-beba4be4110d admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:56.552198 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006ae60b-3967-4267-b13b-beba4be4110d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:56.553838 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006ae60b-3967-4267-b13b-beba4be4110d admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:56.566057 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1071/2154] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:40:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 22:40:56.570271 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65ab731-4349-472f-9666-ba9746255d8b admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:56.581112 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65ab731-4349-472f-9666-ba9746255d8b admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:56.587153 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d06cef-fd11-443e-83fe-bd7e1b81be5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:56.588080 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d06cef-fd11-443e-83fe-bd7e1b81be5f admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:56.588354 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d06cef-fd11-443e-83fe-bd7e1b81be5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:56.588620 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d06cef-fd11-443e-83fe-bd7e1b81be5f admin admin] PATH_INFO: `/v3/projects/6242d9e532d44572b5eed467787d7038/users/d85af99521d14458a1949ae8bb3027c2/roles/1928787bfcc745419829cd315900ac44` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:56.606174 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d06cef-fd11-443e-83fe-bd7e1b81be5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6242d9e532d44572b5eed467787d7038, user_id=d85af99521d14458a1949ae8bb3027c2, role_id=1928787bfcc745419829cd315900ac44)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:56.609371 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d06cef-fd11-443e-83fe-bd7e1b81be5f admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:56.626887 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1084/2155] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 22:40:56 2022] PUT /identity/v3/projects/6242d9e532d44572b5eed467787d7038/users/d85af99521d14458a1949ae8bb3027c2/roles/1928787bfcc745419829cd315900ac44 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 22:40:56.638373 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2830b0-aa36-4b4a-b587-a1fecee1bde9 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:56.638665 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2830b0-aa36-4b4a-b587-a1fecee1bde9 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:56.638939 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2830b0-aa36-4b4a-b587-a1fecee1bde9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:56.671340 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-ce2830b0-aa36-4b4a-b587-a1fecee1bde9 None None] MFA Rules not processed for user `d85af99521d14458a1949ae8bb3027c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:40:56.672633 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-ce2830b0-aa36-4b4a-b587-a1fecee1bde9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:56.760172 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d06cef-fd11-443e-83fe-bd7e1b81be5f admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:56.770753 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1072/2156] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:40:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:40:56.852593 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d06cef-fd11-443e-83fe-bd7e1b81be5f admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:56.858870 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f28121-3f49-492d-9aeb-b1ee661e4511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:56.860051 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f28121-3f49-492d-9aeb-b1ee661e4511 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:56.860397 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f28121-3f49-492d-9aeb-b1ee661e4511 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:56.860750 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f28121-3f49-492d-9aeb-b1ee661e4511 admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:56.862623 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f28121-3f49-492d-9aeb-b1ee661e4511 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:56.864894 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f28121-3f49-492d-9aeb-b1ee661e4511 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:56.910739 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1085/2157] 10.222.0.36 () {60 vars in 1152 bytes} [Fri Jun 24 22:40:56 2022] POST /identity/v3/projects => generated 377 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:40:56.914984 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2830b0-aa36-4b4a-b587-a1fecee1bde9 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:56.930980 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2830b0-aa36-4b4a-b587-a1fecee1bde9 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:56.978277 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f28121-3f49-492d-9aeb-b1ee661e4511 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:56.981802 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-32f28121-3f49-492d-9aeb-b1ee661e4511 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:57.023572 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8050cba-fe01-4eff-9649-ed7de0576048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:57.024339 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8050cba-fe01-4eff-9649-ed7de0576048 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:57.024623 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8050cba-fe01-4eff-9649-ed7de0576048 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:57.024898 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8050cba-fe01-4eff-9649-ed7de0576048 admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:57.026054 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8050cba-fe01-4eff-9649-ed7de0576048 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:57.027667 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8050cba-fe01-4eff-9649-ed7de0576048 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:57.057579 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1073/2158] 10.222.0.36 () {60 vars in 1143 bytes} [Fri Jun 24 22:40:56 2022] POST /identity/v3/users => generated 295 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:40:57.061405 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8050cba-fe01-4eff-9649-ed7de0576048 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:57.070563 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f28121-3f49-492d-9aeb-b1ee661e4511 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:57.072719 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8050cba-fe01-4eff-9649-ed7de0576048 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:57.077802 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296f8022-e1d4-42ec-a207-f27ab132fad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:57.078519 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296f8022-e1d4-42ec-a207-f27ab132fad3 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:57.078808 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296f8022-e1d4-42ec-a207-f27ab132fad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:57.079091 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296f8022-e1d4-42ec-a207-f27ab132fad3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:57.079194 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e022f7b-f188-424f-b1a0-80db7f05efdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:57.079860 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296f8022-e1d4-42ec-a207-f27ab132fad3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:57.080144 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e022f7b-f188-424f-b1a0-80db7f05efdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:57.080501 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e022f7b-f188-424f-b1a0-80db7f05efdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:57.080901 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e022f7b-f188-424f-b1a0-80db7f05efdd admin admin] PATH_INFO: `/v3/projects/c11b12e723bc422ca25fd1cd7cda6568` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:57.081612 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296f8022-e1d4-42ec-a207-f27ab132fad3 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:57.083173 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e022f7b-f188-424f-b1a0-80db7f05efdd admin admin] RBAC: Authorizing `identity:delete_project(project_id=c11b12e723bc422ca25fd1cd7cda6568)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:57.085587 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e022f7b-f188-424f-b1a0-80db7f05efdd admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:57.096478 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1074/2159] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:40:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 22:40:57.097564 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296f8022-e1d4-42ec-a207-f27ab132fad3 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:57.108659 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296f8022-e1d4-42ec-a207-f27ab132fad3 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:57.114445 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aae0cd-ec85-44ba-a515-7f5808312448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:57.115377 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aae0cd-ec85-44ba-a515-7f5808312448 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:57.115740 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aae0cd-ec85-44ba-a515-7f5808312448 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:57.116075 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aae0cd-ec85-44ba-a515-7f5808312448 admin admin] PATH_INFO: `/v3/projects/07c34aabdea145068518632dd43b03b9/users/fc6e203938904096a702c6b72c8b1a4e/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:57.136867 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8aae0cd-ec85-44ba-a515-7f5808312448 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07c34aabdea145068518632dd43b03b9, user_id=fc6e203938904096a702c6b72c8b1a4e, role_id=1a1c43cc97a0407eb7a7c7a1333a9d4a)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:57.139808 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8aae0cd-ec85-44ba-a515-7f5808312448 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:57.146756 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:40:57.151205 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-7e022f7b-f188-424f-b1a0-80db7f05efdd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c11b12e723bc422ca25fd1cd7cda6568', 'request_id': 'req-7e022f7b-f188-424f-b1a0-80db7f05efdd'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:57.158162 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1075/2160] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 22:40:57 2022] PUT /identity/v3/projects/07c34aabdea145068518632dd43b03b9/users/fc6e203938904096a702c6b72c8b1a4e/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:40:57.161560 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-7e022f7b-f188-424f-b1a0-80db7f05efdd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c11b12e723bc422ca25fd1cd7cda6568', 'request_id': 'req-7e022f7b-f188-424f-b1a0-80db7f05efdd'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:57.162066 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aae0cd-ec85-44ba-a515-7f5808312448 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:57.170251 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:40:57.174001 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-7e022f7b-f188-424f-b1a0-80db7f05efdd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c11b12e723bc422ca25fd1cd7cda6568', 'request_id': 'req-7e022f7b-f188-424f-b1a0-80db7f05efdd'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:57.191620 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-7e022f7b-f188-424f-b1a0-80db7f05efdd admin admin] The token cache is being invalidate because project c11b12e723bc422ca25fd1cd7cda6568 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 22:40:57.191993 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-7e022f7b-f188-424f-b1a0-80db7f05efdd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:57.192612 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-7e022f7b-f188-424f-b1a0-80db7f05efdd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:57.195072 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1086/2161] 10.222.0.36 () {58 vars in 1232 bytes} [Fri Jun 24 22:40:56 2022] DELETE /identity/v3/projects/c11b12e723bc422ca25fd1cd7cda6568 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:40:57.199143 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e022f7b-f188-424f-b1a0-80db7f05efdd admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:57.200886 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-7e022f7b-f188-424f-b1a0-80db7f05efdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:57.249803 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aae0cd-ec85-44ba-a515-7f5808312448 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:57.255754 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2c992d-b8a9-4a01-aaea-17d887b40078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:57.257013 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2c992d-b8a9-4a01-aaea-17d887b40078 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:57.257452 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2c992d-b8a9-4a01-aaea-17d887b40078 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:57.257824 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2c992d-b8a9-4a01-aaea-17d887b40078 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:57.258714 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2c992d-b8a9-4a01-aaea-17d887b40078 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:57.260881 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2c992d-b8a9-4a01-aaea-17d887b40078 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:57.275684 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1076/2162] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:40:57 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 22:40:57.277042 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2c992d-b8a9-4a01-aaea-17d887b40078 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:57.278812 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-5f2c992d-b8a9-4a01-aaea-17d887b40078 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:57.282527 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e022f7b-f188-424f-b1a0-80db7f05efdd admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:57.287604 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2c6172-ce35-4ad3-8217-bba46f3d1875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:57.288681 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2c6172-ce35-4ad3-8217-bba46f3d1875 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:57.289060 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2c6172-ce35-4ad3-8217-bba46f3d1875 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:57.289453 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2c6172-ce35-4ad3-8217-bba46f3d1875 admin admin] PATH_INFO: `/v3/users/28e985bf5e624f1dbf5a88f158fe2f7f` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:57.291083 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2c6172-ce35-4ad3-8217-bba46f3d1875 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28e985bf5e624f1dbf5a88f158fe2f7f)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:57.292291 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2c992d-b8a9-4a01-aaea-17d887b40078 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:57.293797 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2c6172-ce35-4ad3-8217-bba46f3d1875 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:57.297323 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d32e4b-43b1-4e83-b283-45199dbdeaab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:57.298241 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d32e4b-43b1-4e83-b283-45199dbdeaab admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:57.298520 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d32e4b-43b1-4e83-b283-45199dbdeaab admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:57.298795 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d32e4b-43b1-4e83-b283-45199dbdeaab admin admin] PATH_INFO: `/v3/projects/07c34aabdea145068518632dd43b03b9/users/fc6e203938904096a702c6b72c8b1a4e/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:57.301056 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d32e4b-43b1-4e83-b283-45199dbdeaab admin admin] RBAC: Authorizing `identity:create_grant(project_id=07c34aabdea145068518632dd43b03b9, user_id=fc6e203938904096a702c6b72c8b1a4e, role_id=1a1c43cc97a0407eb7a7c7a1333a9d4a)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:57.303851 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d32e4b-43b1-4e83-b283-45199dbdeaab admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:57.316404 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1077/2163] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 22:40:57 2022] PUT /identity/v3/projects/07c34aabdea145068518632dd43b03b9/users/fc6e203938904096a702c6b72c8b1a4e/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:40:57.327465 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ea8aeb-f239-489e-9a2f-b1ba35f25992 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:57.327753 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ea8aeb-f239-489e-9a2f-b1ba35f25992 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:57.328029 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ea8aeb-f239-489e-9a2f-b1ba35f25992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:57.350640 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-3c2c6172-ce35-4ad3-8217-bba46f3d1875 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28e985bf5e624f1dbf5a88f158fe2f7f'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:57.359681 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-3c2c6172-ce35-4ad3-8217-bba46f3d1875 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28e985bf5e624f1dbf5a88f158fe2f7f'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:57.360329 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-b5ea8aeb-f239-489e-9a2f-b1ba35f25992 None None] MFA Rules not processed for user `fc6e203938904096a702c6b72c8b1a4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:40:57.360731 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-3c2c6172-ce35-4ad3-8217-bba46f3d1875 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28e985bf5e624f1dbf5a88f158fe2f7f'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:57.361568 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-b5ea8aeb-f239-489e-9a2f-b1ba35f25992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:57.361734 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-3c2c6172-ce35-4ad3-8217-bba46f3d1875 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28e985bf5e624f1dbf5a88f158fe2f7f'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:57.377434 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-3c2c6172-ce35-4ad3-8217-bba46f3d1875 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28e985bf5e624f1dbf5a88f158fe2f7f'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:57.394423 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1087/2164] 10.222.0.36 () {58 vars in 1223 bytes} [Fri Jun 24 22:40:57 2022] DELETE /identity/v3/users/28e985bf5e624f1dbf5a88f158fe2f7f => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 22:40:57.443898 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1078/2165] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:40:57 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:40:57.453632 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2c6172-ce35-4ad3-8217-bba46f3d1875 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:57.455885 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-3c2c6172-ce35-4ad3-8217-bba46f3d1875 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:57.531897 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2c6172-ce35-4ad3-8217-bba46f3d1875 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:57.536632 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357610bf-0729-4d3d-83b9-a232173841e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a747e2a5684843a6ee9e3480badac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:57.537424 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357610bf-0729-4d3d-83b9-a232173841e9 service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:57.537742 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357610bf-0729-4d3d-83b9-a232173841e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:57.537993 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357610bf-0729-4d3d-83b9-a232173841e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:57.541222 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-357610bf-0729-4d3d-83b9-a232173841e9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:57.548713 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:40:57.627337 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357610bf-0729-4d3d-83b9-a232173841e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:57.629326 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357610bf-0729-4d3d-83b9-a232173841e9 service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:57.639568 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1088/2166] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:40:57 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:40:57.705015 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ea8aeb-f239-489e-9a2f-b1ba35f25992 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:57.706987 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-b5ea8aeb-f239-489e-9a2f-b1ba35f25992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:57.840296 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ea8aeb-f239-489e-9a2f-b1ba35f25992 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:57.873251 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:40:57.937901 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59627309-acba-46ba-b26b-647280abb629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:57.939406 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59627309-acba-46ba-b26b-647280abb629 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:57.939895 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59627309-acba-46ba-b26b-647280abb629 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:57.939994 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59627309-acba-46ba-b26b-647280abb629 admin admin] PATH_INFO: `/v3/projects/e7d9473408fa41898b68b167a68dfebd` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:57.941191 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59627309-acba-46ba-b26b-647280abb629 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7d9473408fa41898b68b167a68dfebd)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:57.943198 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59627309-acba-46ba-b26b-647280abb629 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:58.002353 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357610bf-0729-4d3d-83b9-a232173841e9 service cinder] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:58.004281 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-357610bf-0729-4d3d-83b9-a232173841e9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:58.022859 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-59627309-acba-46ba-b26b-647280abb629 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7d9473408fa41898b68b167a68dfebd', 'request_id': 'req-59627309-acba-46ba-b26b-647280abb629'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:58.026390 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357610bf-0729-4d3d-83b9-a232173841e9 service cinder] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:58.039294 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-59627309-acba-46ba-b26b-647280abb629 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7d9473408fa41898b68b167a68dfebd', 'request_id': 'req-59627309-acba-46ba-b26b-647280abb629'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:58.051587 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-59627309-acba-46ba-b26b-647280abb629 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7d9473408fa41898b68b167a68dfebd', 'request_id': 'req-59627309-acba-46ba-b26b-647280abb629'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:58.082034 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-59627309-acba-46ba-b26b-647280abb629 admin admin] The token cache is being invalidate because project e7d9473408fa41898b68b167a68dfebd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 22:40:58.082706 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-59627309-acba-46ba-b26b-647280abb629 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:58.083038 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-59627309-acba-46ba-b26b-647280abb629 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:58.090763 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1079/2167] 10.222.0.36 () {58 vars in 1232 bytes} [Fri Jun 24 22:40:57 2022] DELETE /identity/v3/projects/e7d9473408fa41898b68b167a68dfebd => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:40:58.094600 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d71c31-fa21-46a1-ba2b-80326c240bc9 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:58.095522 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d71c31-fa21-46a1-ba2b-80326c240bc9 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:58.096695 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d71c31-fa21-46a1-ba2b-80326c240bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:58.120268 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-34d71c31-fa21-46a1-ba2b-80326c240bc9 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:40:58.121506 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-34d71c31-fa21-46a1-ba2b-80326c240bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:58.139876 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85bc9f0-b68e-4a53-804a-f8393e6621c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:58.140875 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85bc9f0-b68e-4a53-804a-f8393e6621c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:58.141637 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85bc9f0-b68e-4a53-804a-f8393e6621c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:58.142020 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85bc9f0-b68e-4a53-804a-f8393e6621c8 admin admin] PATH_INFO: `/v3/users/97e7819579c34a7dbc0afe67de0dc3eb` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:58.143754 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85bc9f0-b68e-4a53-804a-f8393e6621c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97e7819579c34a7dbc0afe67de0dc3eb)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:58.146196 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85bc9f0-b68e-4a53-804a-f8393e6621c8 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:58.193489 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1080/2168] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:40:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 22:40:58.202060 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a4a4d9-aa45-4704-9083-0fa322eae915 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:58.202347 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a4a4d9-aa45-4704-9083-0fa322eae915 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:58.202621 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a4a4d9-aa45-4704-9083-0fa322eae915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:58.205691 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-d85bc9f0-b68e-4a53-804a-f8393e6621c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97e7819579c34a7dbc0afe67de0dc3eb'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:58.213951 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-d85bc9f0-b68e-4a53-804a-f8393e6621c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97e7819579c34a7dbc0afe67de0dc3eb'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:58.214850 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-d85bc9f0-b68e-4a53-804a-f8393e6621c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97e7819579c34a7dbc0afe67de0dc3eb'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:58.215523 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-d85bc9f0-b68e-4a53-804a-f8393e6621c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97e7819579c34a7dbc0afe67de0dc3eb'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:58.222541 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-63a4a4d9-aa45-4704-9083-0fa322eae915 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:40:58.223990 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-63a4a4d9-aa45-4704-9083-0fa322eae915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:58.229074 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-d85bc9f0-b68e-4a53-804a-f8393e6621c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97e7819579c34a7dbc0afe67de0dc3eb'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:58.232676 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1081/2169] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:40:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:40:58.237518 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a4a4d9-aa45-4704-9083-0fa322eae915 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:58.248326 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a4a4d9-aa45-4704-9083-0fa322eae915 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:58.251878 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1089/2170] 10.222.0.36 () {58 vars in 1223 bytes} [Fri Jun 24 22:40:58 2022] DELETE /identity/v3/users/97e7819579c34a7dbc0afe67de0dc3eb => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:40:58.255802 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1655e4-9500-4af1-be24-dbe6670bf1cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:58.256272 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e9c55-8e18-4650-b3d9-61f1fc6a25c2 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:58.256606 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e9c55-8e18-4650-b3d9-61f1fc6a25c2 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:58.256944 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e9c55-8e18-4650-b3d9-61f1fc6a25c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:58.257055 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1655e4-9500-4af1-be24-dbe6670bf1cd admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:58.257502 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1655e4-9500-4af1-be24-dbe6670bf1cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:58.258848 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1655e4-9500-4af1-be24-dbe6670bf1cd admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:58.258848 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1655e4-9500-4af1-be24-dbe6670bf1cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:40:58.259138 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1655e4-9500-4af1-be24-dbe6670bf1cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:58.261458 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1655e4-9500-4af1-be24-dbe6670bf1cd admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:58.277210 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1082/2171] 10.222.0.36 () {58 vars in 1152 bytes} [Fri Jun 24 22:40:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 22:40:58.277897 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-505e9c55-8e18-4650-b3d9-61f1fc6a25c2 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:40:58.279366 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-505e9c55-8e18-4650-b3d9-61f1fc6a25c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:58.281994 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1655e4-9500-4af1-be24-dbe6670bf1cd admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:58.293583 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1655e4-9500-4af1-be24-dbe6670bf1cd admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:58.314326 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:40:58.329019 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:40:58.361138 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e6e231-ab9a-452b-8019-10c8a597e448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:58.362260 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e6e231-ab9a-452b-8019-10c8a597e448 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:58.362626 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e6e231-ab9a-452b-8019-10c8a597e448 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:58.362905 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e6e231-ab9a-452b-8019-10c8a597e448 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:58.363658 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e6e231-ab9a-452b-8019-10c8a597e448 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:58.365612 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e6e231-ab9a-452b-8019-10c8a597e448 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:58.375821 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1090/2172] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:40:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:40:58.384219 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505e9c55-8e18-4650-b3d9-61f1fc6a25c2 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:58.385807 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-505e9c55-8e18-4650-b3d9-61f1fc6a25c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:58.406716 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1083/2173] 10.222.0.36 () {60 vars in 1152 bytes} [Fri Jun 24 22:40:58 2022] POST /identity/v3/projects => generated 377 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:40:58.408218 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e6e231-ab9a-452b-8019-10c8a597e448 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:58.459317 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505e9c55-8e18-4650-b3d9-61f1fc6a25c2 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:58.490798 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e6e231-ab9a-452b-8019-10c8a597e448 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:58.497067 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540cf81e-1d19-45cb-8832-ec40536736df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:58.497902 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540cf81e-1d19-45cb-8832-ec40536736df admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:58.498186 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540cf81e-1d19-45cb-8832-ec40536736df admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:58.498461 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540cf81e-1d19-45cb-8832-ec40536736df admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:58.499314 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540cf81e-1d19-45cb-8832-ec40536736df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:58.501945 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540cf81e-1d19-45cb-8832-ec40536736df admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:58.531291 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1084/2174] 10.222.0.36 () {60 vars in 1143 bytes} [Fri Jun 24 22:40:58 2022] POST /identity/v3/users => generated 289 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:40:58.533067 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540cf81e-1d19-45cb-8832-ec40536736df admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:58.535822 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97c7561-caa4-45a6-999e-a302a608b585 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:58.536756 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97c7561-caa4-45a6-999e-a302a608b585 service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:58.537137 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97c7561-caa4-45a6-999e-a302a608b585 service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:58.537516 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97c7561-caa4-45a6-999e-a302a608b585 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:58.545983 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540cf81e-1d19-45cb-8832-ec40536736df admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:58.548688 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97c7561-caa4-45a6-999e-a302a608b585 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:58.550517 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97c7561-caa4-45a6-999e-a302a608b585 service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:58.551357 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72afa68-86e1-47dd-ae44-6357cdb13546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:58.552298 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72afa68-86e1-47dd-ae44-6357cdb13546 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:58.552584 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72afa68-86e1-47dd-ae44-6357cdb13546 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:58.552858 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72afa68-86e1-47dd-ae44-6357cdb13546 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:58.553597 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72afa68-86e1-47dd-ae44-6357cdb13546 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:58.555573 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72afa68-86e1-47dd-ae44-6357cdb13546 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:58.562766 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1091/2175] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:40:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 22:40:58.571288 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1085/2176] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:40:58 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:40:58.575070 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97c7561-caa4-45a6-999e-a302a608b585 service neutron] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:58.585767 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97c7561-caa4-45a6-999e-a302a608b585 service neutron] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:58.592032 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75025c21-3cff-4617-8bad-ebc193c42bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:58.593460 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75025c21-3cff-4617-8bad-ebc193c42bd4 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:58.593901 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75025c21-3cff-4617-8bad-ebc193c42bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:58.594892 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75025c21-3cff-4617-8bad-ebc193c42bd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:58.595837 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75025c21-3cff-4617-8bad-ebc193c42bd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:58.598754 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75025c21-3cff-4617-8bad-ebc193c42bd4 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:58.614030 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1092/2177] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:40:58 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 22:40:58.619789 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72afa68-86e1-47dd-ae44-6357cdb13546 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:58.632542 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72afa68-86e1-47dd-ae44-6357cdb13546 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:58.640357 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f7ef9b-5a5c-4c0d-80a0-c4f8507f7dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:58.641528 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f7ef9b-5a5c-4c0d-80a0-c4f8507f7dc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:58.642310 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f7ef9b-5a5c-4c0d-80a0-c4f8507f7dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:58.642759 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f7ef9b-5a5c-4c0d-80a0-c4f8507f7dc0 admin admin] PATH_INFO: `/v3/projects/40e588ea16c0427fae363ddedb093634/users/be4ce8a5b1234bb5b8faf3337e122b7b/roles/1928787bfcc745419829cd315900ac44` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:58.663036 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f7ef9b-5a5c-4c0d-80a0-c4f8507f7dc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40e588ea16c0427fae363ddedb093634, user_id=be4ce8a5b1234bb5b8faf3337e122b7b, role_id=1928787bfcc745419829cd315900ac44)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:58.666655 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f7ef9b-5a5c-4c0d-80a0-c4f8507f7dc0 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:58.687232 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1086/2178] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 22:40:58 2022] PUT /identity/v3/projects/40e588ea16c0427fae363ddedb093634/users/be4ce8a5b1234bb5b8faf3337e122b7b/roles/1928787bfcc745419829cd315900ac44 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:40:58.700489 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c050885d-1784-4037-b696-15066df62b1e None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:58.700799 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c050885d-1784-4037-b696-15066df62b1e None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:58.701058 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c050885d-1784-4037-b696-15066df62b1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:58.736154 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-c050885d-1784-4037-b696-15066df62b1e None None] MFA Rules not processed for user `be4ce8a5b1234bb5b8faf3337e122b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:40:58.737412 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-c050885d-1784-4037-b696-15066df62b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:58.835868 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1093/2179] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:40:58 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:40:58.844562 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f7ef9b-5a5c-4c0d-80a0-c4f8507f7dc0 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:58.846375 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-38f7ef9b-5a5c-4c0d-80a0-c4f8507f7dc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:58.913613 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c050885d-1784-4037-b696-15066df62b1e None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:58.915048 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-c050885d-1784-4037-b696-15066df62b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:58.923095 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:40:58.924617 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f7ef9b-5a5c-4c0d-80a0-c4f8507f7dc0 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:58.931430 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f185adbc-608c-4e98-9ad3-429b8486489e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd156158fa06647569a8bb2d8d0019f28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:58.932389 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f185adbc-608c-4e98-9ad3-429b8486489e service glance] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:58.932738 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f185adbc-608c-4e98-9ad3-429b8486489e service glance] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:58.933078 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f185adbc-608c-4e98-9ad3-429b8486489e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:58.953981 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f185adbc-608c-4e98-9ad3-429b8486489e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:58.956287 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f185adbc-608c-4e98-9ad3-429b8486489e service glance] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:58.969780 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1087/2180] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:40:58 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:40:59.029754 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c050885d-1784-4037-b696-15066df62b1e None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:59.035064 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08643fea-a57e-4ebf-be7e-2ff721135d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:59.036022 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08643fea-a57e-4ebf-be7e-2ff721135d01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:59.036309 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08643fea-a57e-4ebf-be7e-2ff721135d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:59.036570 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08643fea-a57e-4ebf-be7e-2ff721135d01 admin admin] PATH_INFO: `/v3/projects/6a6326b916f641c39bc7e5d2399c02f4` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:59.037781 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08643fea-a57e-4ebf-be7e-2ff721135d01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a6326b916f641c39bc7e5d2399c02f4)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:59.040099 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08643fea-a57e-4ebf-be7e-2ff721135d01 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:59.129737 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-08643fea-a57e-4ebf-be7e-2ff721135d01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a6326b916f641c39bc7e5d2399c02f4', 'request_id': 'req-08643fea-a57e-4ebf-be7e-2ff721135d01'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:59.137660 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-08643fea-a57e-4ebf-be7e-2ff721135d01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a6326b916f641c39bc7e5d2399c02f4', 'request_id': 'req-08643fea-a57e-4ebf-be7e-2ff721135d01'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:59.150363 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-08643fea-a57e-4ebf-be7e-2ff721135d01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a6326b916f641c39bc7e5d2399c02f4', 'request_id': 'req-08643fea-a57e-4ebf-be7e-2ff721135d01'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:59.172002 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-08643fea-a57e-4ebf-be7e-2ff721135d01 admin admin] The token cache is being invalidate because project 6a6326b916f641c39bc7e5d2399c02f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 22:40:59.172360 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-08643fea-a57e-4ebf-be7e-2ff721135d01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:59.173092 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-08643fea-a57e-4ebf-be7e-2ff721135d01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:40:59.183924 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1094/2181] 10.222.0.36 () {58 vars in 1232 bytes} [Fri Jun 24 22:40:58 2022] DELETE /identity/v3/projects/6a6326b916f641c39bc7e5d2399c02f4 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 22:40:59.309616 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f185adbc-608c-4e98-9ad3-429b8486489e service glance] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:40:59.311120 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-f185adbc-608c-4e98-9ad3-429b8486489e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:59.331281 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:40:59.397314 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f185adbc-608c-4e98-9ad3-429b8486489e service glance] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:40:59.520567 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8343166a-24fe-4e00-a1f1-1bf8a8d2723a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a747e2a5684843a6ee9e3480badac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:40:59.521467 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8343166a-24fe-4e00-a1f1-1bf8a8d2723a service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:40:59.521897 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8343166a-24fe-4e00-a1f1-1bf8a8d2723a service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:40:59.523768 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8343166a-24fe-4e00-a1f1-1bf8a8d2723a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:40:59.525950 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-8343166a-24fe-4e00-a1f1-1bf8a8d2723a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:40:59.629337 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8343166a-24fe-4e00-a1f1-1bf8a8d2723a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:40:59.631980 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8343166a-24fe-4e00-a1f1-1bf8a8d2723a service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:40:59.644188 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1088/2182] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:40:59 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:41:00.471749 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08643fea-a57e-4ebf-be7e-2ff721135d01 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:41:00.473815 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-08643fea-a57e-4ebf-be7e-2ff721135d01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:41:00.487792 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08643fea-a57e-4ebf-be7e-2ff721135d01 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:41:00.492733 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5144f71a-4d91-4ce6-9338-f18d6691f83e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a747e2a5684843a6ee9e3480badac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:41:00.493400 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5144f71a-4d91-4ce6-9338-f18d6691f83e service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:00.493679 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5144f71a-4d91-4ce6-9338-f18d6691f83e service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:00.494015 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5144f71a-4d91-4ce6-9338-f18d6691f83e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:00.495954 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-5144f71a-4d91-4ce6-9338-f18d6691f83e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:41:00.574645 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5144f71a-4d91-4ce6-9338-f18d6691f83e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:41:00.576166 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5144f71a-4d91-4ce6-9338-f18d6691f83e service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:41:00.587916 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1095/2183] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:41:00 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:41:00.755844 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb6ca61-4cb1-4b28-962f-a5e35814be53 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:00.756403 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb6ca61-4cb1-4b28-962f-a5e35814be53 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:00.756403 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb6ca61-4cb1-4b28-962f-a5e35814be53 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:00.758495 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1089/2184] 10.222.0.36 () {54 vars in 921 bytes} [Fri Jun 24 22:41:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:41:00.770357 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a781b1-f070-4583-96c6-a0f17b88bac0 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:00.770747 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a781b1-f070-4583-96c6-a0f17b88bac0 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:00.771532 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a781b1-f070-4583-96c6-a0f17b88bac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:00.789616 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-c5a781b1-f070-4583-96c6-a0f17b88bac0 None None] MFA Rules not processed for user `0233b357708643be94c0ade17ac1fb3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:41:00.790764 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-c5a781b1-f070-4583-96c6-a0f17b88bac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:41:00.827640 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:41:00.863771 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb6ca61-4cb1-4b28-962f-a5e35814be53 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:41:00.865850 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-beb6ca61-4cb1-4b28-962f-a5e35814be53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:41:00.881654 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1096/2185] 10.222.0.36 () {58 vars in 1018 bytes} [Fri Jun 24 22:41:00 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 22:41:00.899566 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a781b1-f070-4583-96c6-a0f17b88bac0 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:41:00.899566 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-c5a781b1-f070-4583-96c6-a0f17b88bac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:41:00.909858 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a781b1-f070-4583-96c6-a0f17b88bac0 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:41:00.915358 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c332043-7c82-4329-97da-37100864b2d3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0233b357708643be94c0ade17ac1fb3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:41:00.915957 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c332043-7c82-4329-97da-37100864b2d3 service placement] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:00.916232 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c332043-7c82-4329-97da-37100864b2d3 service placement] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:00.916500 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c332043-7c82-4329-97da-37100864b2d3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:00.926035 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c332043-7c82-4329-97da-37100864b2d3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:41:00.927763 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c332043-7c82-4329-97da-37100864b2d3 service placement] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:41:00.938983 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1097/2186] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:41:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 22:41:00.954214 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb6ca61-4cb1-4b28-962f-a5e35814be53 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:41:00.959504 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f06b2f1-9ace-4333-977b-8ecc94b8e9df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:41:00.960329 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f06b2f1-9ace-4333-977b-8ecc94b8e9df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:00.960607 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f06b2f1-9ace-4333-977b-8ecc94b8e9df admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:00.960954 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f06b2f1-9ace-4333-977b-8ecc94b8e9df admin admin] PATH_INFO: `/v3/users/093a9e645ff24d129ee68067553bbcc6` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:00.962181 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f06b2f1-9ace-4333-977b-8ecc94b8e9df admin admin] RBAC: Authorizing `identity:delete_user(user_id=093a9e645ff24d129ee68067553bbcc6)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:41:00.964163 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f06b2f1-9ace-4333-977b-8ecc94b8e9df admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:41:00.997278 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:41:01.020568 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-0f06b2f1-9ace-4333-977b-8ecc94b8e9df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '093a9e645ff24d129ee68067553bbcc6'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:01.028990 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-0f06b2f1-9ace-4333-977b-8ecc94b8e9df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '093a9e645ff24d129ee68067553bbcc6'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:01.029875 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-0f06b2f1-9ace-4333-977b-8ecc94b8e9df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '093a9e645ff24d129ee68067553bbcc6'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:01.030758 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-0f06b2f1-9ace-4333-977b-8ecc94b8e9df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '093a9e645ff24d129ee68067553bbcc6'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:01.045401 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-0f06b2f1-9ace-4333-977b-8ecc94b8e9df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '093a9e645ff24d129ee68067553bbcc6'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:01.060422 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1090/2187] 10.222.0.36 () {58 vars in 1223 bytes} [Fri Jun 24 22:41:00 2022] DELETE /identity/v3/users/093a9e645ff24d129ee68067553bbcc6 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:41:01.249648 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c332043-7c82-4329-97da-37100864b2d3 service placement] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:41:01.263705 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c332043-7c82-4329-97da-37100864b2d3 service placement] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:41:01.338641 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6c3af3-70bc-45ab-ad8b-620e5d1cecc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:41:01.339550 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c3af3-70bc-45ab-ad8b-620e5d1cecc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:01.339833 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c3af3-70bc-45ab-ad8b-620e5d1cecc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:01.340115 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c3af3-70bc-45ab-ad8b-620e5d1cecc3 admin admin] PATH_INFO: `/v3/projects/0662077615104363a06fa97f2baae952` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:01.341394 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6c3af3-70bc-45ab-ad8b-620e5d1cecc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0662077615104363a06fa97f2baae952)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:41:01.343345 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6c3af3-70bc-45ab-ad8b-620e5d1cecc3 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:41:01.395705 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-2c6c3af3-70bc-45ab-ad8b-620e5d1cecc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0662077615104363a06fa97f2baae952', 'request_id': 'req-2c6c3af3-70bc-45ab-ad8b-620e5d1cecc3'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:01.402504 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-2c6c3af3-70bc-45ab-ad8b-620e5d1cecc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0662077615104363a06fa97f2baae952', 'request_id': 'req-2c6c3af3-70bc-45ab-ad8b-620e5d1cecc3'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:01.412291 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-2c6c3af3-70bc-45ab-ad8b-620e5d1cecc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0662077615104363a06fa97f2baae952', 'request_id': 'req-2c6c3af3-70bc-45ab-ad8b-620e5d1cecc3'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:01.425123 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-2c6c3af3-70bc-45ab-ad8b-620e5d1cecc3 admin admin] The token cache is being invalidate because project 0662077615104363a06fa97f2baae952 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 22:41:01.425415 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-2c6c3af3-70bc-45ab-ad8b-620e5d1cecc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:01.426096 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-2c6c3af3-70bc-45ab-ad8b-620e5d1cecc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:01.427950 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1098/2188] 10.222.0.36 () {58 vars in 1232 bytes} [Fri Jun 24 22:41:01 2022] DELETE /identity/v3/projects/0662077615104363a06fa97f2baae952 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:41:01.433867 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2014eb20-3acb-4a19-897d-84cd7bdcd2a7 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:01.434157 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2014eb20-3acb-4a19-897d-84cd7bdcd2a7 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:01.434431 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2014eb20-3acb-4a19-897d-84cd7bdcd2a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:01.452821 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-2014eb20-3acb-4a19-897d-84cd7bdcd2a7 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:41:01.454027 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-2014eb20-3acb-4a19-897d-84cd7bdcd2a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:41:01.520086 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1091/2189] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:41:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:41:01.533030 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b5e835-0b9e-4f37-bcbd-a4c0006cff36 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:01.533848 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b5e835-0b9e-4f37-bcbd-a4c0006cff36 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:01.533848 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b5e835-0b9e-4f37-bcbd-a4c0006cff36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:01.555473 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-b1b5e835-0b9e-4f37-bcbd-a4c0006cff36 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:41:01.556680 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-b1b5e835-0b9e-4f37-bcbd-a4c0006cff36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:41:01.565045 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1099/2190] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:41:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 22:41:01.569534 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2014eb20-3acb-4a19-897d-84cd7bdcd2a7 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:41:01.583071 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2014eb20-3acb-4a19-897d-84cd7bdcd2a7 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:41:01.591314 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7419c3c0-7579-4a15-af0c-b69e39b5d7b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:41:01.592090 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7419c3c0-7579-4a15-af0c-b69e39b5d7b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:01.592380 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7419c3c0-7579-4a15-af0c-b69e39b5d7b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:01.592656 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7419c3c0-7579-4a15-af0c-b69e39b5d7b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:01.593395 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7419c3c0-7579-4a15-af0c-b69e39b5d7b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:41:01.593685 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7419c3c0-7579-4a15-af0c-b69e39b5d7b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:41:01.595374 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7419c3c0-7579-4a15-af0c-b69e39b5d7b1 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:41:01.608481 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1092/2191] 10.222.0.36 () {58 vars in 1152 bytes} [Fri Jun 24 22:41:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:41:01.613297 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b5e835-0b9e-4f37-bcbd-a4c0006cff36 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:41:01.626157 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b5e835-0b9e-4f37-bcbd-a4c0006cff36 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:41:01.631753 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b798718a-75a6-4723-bae1-248e0b21398c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:41:01.632418 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b798718a-75a6-4723-bae1-248e0b21398c admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:01.632929 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b798718a-75a6-4723-bae1-248e0b21398c admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:01.633096 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b798718a-75a6-4723-bae1-248e0b21398c admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:01.633852 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b798718a-75a6-4723-bae1-248e0b21398c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:41:01.635945 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b798718a-75a6-4723-bae1-248e0b21398c admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:41:01.669096 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1100/2192] 10.222.0.36 () {60 vars in 1152 bytes} [Fri Jun 24 22:41:01 2022] POST /identity/v3/projects => generated 387 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:41:01.678199 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7419c3c0-7579-4a15-af0c-b69e39b5d7b1 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:41:01.691243 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7419c3c0-7579-4a15-af0c-b69e39b5d7b1 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:41:01.764410 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca27f05-1992-4560-a5bf-c747cd7ae12b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:41:01.765097 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca27f05-1992-4560-a5bf-c747cd7ae12b admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:01.765380 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca27f05-1992-4560-a5bf-c747cd7ae12b admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:01.765657 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca27f05-1992-4560-a5bf-c747cd7ae12b admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:01.766351 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca27f05-1992-4560-a5bf-c747cd7ae12b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:41:01.768593 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca27f05-1992-4560-a5bf-c747cd7ae12b admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:41:01.795873 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1093/2193] 10.222.0.36 () {60 vars in 1143 bytes} [Fri Jun 24 22:41:01 2022] POST /identity/v3/users => generated 294 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:41:01.803379 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b798718a-75a6-4723-bae1-248e0b21398c admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:41:01.814206 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b798718a-75a6-4723-bae1-248e0b21398c admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:41:01.819196 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a031ce6-a8d7-4076-b348-881e5cfc1455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:41:01.819877 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a031ce6-a8d7-4076-b348-881e5cfc1455 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:01.820197 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a031ce6-a8d7-4076-b348-881e5cfc1455 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:01.821091 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a031ce6-a8d7-4076-b348-881e5cfc1455 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:01.821879 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a031ce6-a8d7-4076-b348-881e5cfc1455 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:41:01.823562 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a031ce6-a8d7-4076-b348-881e5cfc1455 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:41:01.834767 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1101/2194] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:41:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:41:01.839151 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca27f05-1992-4560-a5bf-c747cd7ae12b admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:41:01.849265 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca27f05-1992-4560-a5bf-c747cd7ae12b admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:41:01.854701 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e7594f-5f5f-4880-9763-8bb443d54b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:41:01.855408 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e7594f-5f5f-4880-9763-8bb443d54b2f admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:01.855692 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e7594f-5f5f-4880-9763-8bb443d54b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:01.855976 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e7594f-5f5f-4880-9763-8bb443d54b2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:01.856750 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e7594f-5f5f-4880-9763-8bb443d54b2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:41:01.858332 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e7594f-5f5f-4880-9763-8bb443d54b2f admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:41:01.870887 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1094/2195] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:41:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:41:01.876038 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a031ce6-a8d7-4076-b348-881e5cfc1455 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:41:01.881569 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:41:01.887376 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a031ce6-a8d7-4076-b348-881e5cfc1455 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:41:01.894057 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cda2cc-541e-4daa-ab85-1b2a8e4ad0ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:41:01.895166 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cda2cc-541e-4daa-ab85-1b2a8e4ad0ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:01.895686 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cda2cc-541e-4daa-ab85-1b2a8e4ad0ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:01.895969 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cda2cc-541e-4daa-ab85-1b2a8e4ad0ea admin admin] PATH_INFO: `/v3/projects/d1bca745ac454a4bb5f9e67734792f34/users/f7e8bd5d6eb144298f56423c9d5a1280/roles/1928787bfcc745419829cd315900ac44` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:01.916898 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cda2cc-541e-4daa-ab85-1b2a8e4ad0ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1bca745ac454a4bb5f9e67734792f34, user_id=f7e8bd5d6eb144298f56423c9d5a1280, role_id=1928787bfcc745419829cd315900ac44)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:41:01.925658 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cda2cc-541e-4daa-ab85-1b2a8e4ad0ea admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:41:01.942166 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1102/2196] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 22:41:01 2022] PUT /identity/v3/projects/d1bca745ac454a4bb5f9e67734792f34/users/f7e8bd5d6eb144298f56423c9d5a1280/roles/1928787bfcc745419829cd315900ac44 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:41:01.954065 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61e4254-4f71-45e2-a19b-a4b19c313b12 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:01.954399 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61e4254-4f71-45e2-a19b-a4b19c313b12 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:01.954728 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61e4254-4f71-45e2-a19b-a4b19c313b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:01.997218 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:41:02.017877 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-f61e4254-4f71-45e2-a19b-a4b19c313b12 None None] MFA Rules not processed for user `f7e8bd5d6eb144298f56423c9d5a1280`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:41:02.020653 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-f61e4254-4f71-45e2-a19b-a4b19c313b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:41:02.132979 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1095/2197] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:41:01 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:41:02.138618 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cda2cc-541e-4daa-ab85-1b2a8e4ad0ea admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:41:02.206125 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cda2cc-541e-4daa-ab85-1b2a8e4ad0ea admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:41:02.210972 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec744726-34c3-4902-b44e-cd48358e9f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:41:02.211692 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec744726-34c3-4902-b44e-cd48358e9f44 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:02.211976 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec744726-34c3-4902-b44e-cd48358e9f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:02.212248 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec744726-34c3-4902-b44e-cd48358e9f44 admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:02.212942 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec744726-34c3-4902-b44e-cd48358e9f44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:41:02.214914 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec744726-34c3-4902-b44e-cd48358e9f44 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:41:02.244077 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1103/2198] 10.222.0.36 () {60 vars in 1152 bytes} [Fri Jun 24 22:41:02 2022] POST /identity/v3/projects => generated 387 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:41:02.248543 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61e4254-4f71-45e2-a19b-a4b19c313b12 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:41:02.261199 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61e4254-4f71-45e2-a19b-a4b19c313b12 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:41:02.323345 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542151a8-0e80-450e-aba0-ef42353a767f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:41:02.324081 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542151a8-0e80-450e-aba0-ef42353a767f admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:02.324362 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542151a8-0e80-450e-aba0-ef42353a767f admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:02.324754 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542151a8-0e80-450e-aba0-ef42353a767f admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:02.325484 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542151a8-0e80-450e-aba0-ef42353a767f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:41:02.327492 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542151a8-0e80-450e-aba0-ef42353a767f admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:41:02.350855 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1096/2199] 10.222.0.36 () {60 vars in 1143 bytes} [Fri Jun 24 22:41:02 2022] POST /identity/v3/users => generated 300 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:41:02.355428 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec744726-34c3-4902-b44e-cd48358e9f44 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:41:02.367244 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec744726-34c3-4902-b44e-cd48358e9f44 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:41:02.373113 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f2829d-34e7-473c-9279-63fdcd42c7f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:41:02.373788 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f2829d-34e7-473c-9279-63fdcd42c7f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:02.374069 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f2829d-34e7-473c-9279-63fdcd42c7f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:02.374356 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f2829d-34e7-473c-9279-63fdcd42c7f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:02.375090 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f2829d-34e7-473c-9279-63fdcd42c7f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:41:02.377087 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f2829d-34e7-473c-9279-63fdcd42c7f2 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:41:02.392855 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1104/2200] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:41:02 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 22:41:02.398046 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542151a8-0e80-450e-aba0-ef42353a767f admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:41:02.411620 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542151a8-0e80-450e-aba0-ef42353a767f admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:41:02.418185 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c33bbfa-60bb-424c-829d-0d5b7cd6f002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:41:02.419095 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c33bbfa-60bb-424c-829d-0d5b7cd6f002 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:02.419406 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c33bbfa-60bb-424c-829d-0d5b7cd6f002 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:02.419774 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c33bbfa-60bb-424c-829d-0d5b7cd6f002 admin admin] PATH_INFO: `/v3/projects/514241da01c94150800baa12ee596e14/users/8aaec6fb238c478b9c093bf0021854ff/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:02.441028 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c33bbfa-60bb-424c-829d-0d5b7cd6f002 admin admin] RBAC: Authorizing `identity:create_grant(project_id=514241da01c94150800baa12ee596e14, user_id=8aaec6fb238c478b9c093bf0021854ff, role_id=1a1c43cc97a0407eb7a7c7a1333a9d4a)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:41:02.443797 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c33bbfa-60bb-424c-829d-0d5b7cd6f002 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:41:02.462232 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1097/2201] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 22:41:02 2022] PUT /identity/v3/projects/514241da01c94150800baa12ee596e14/users/8aaec6fb238c478b9c093bf0021854ff/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 22:41:02.467862 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f2829d-34e7-473c-9279-63fdcd42c7f2 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:41:02.480204 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f2829d-34e7-473c-9279-63fdcd42c7f2 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:41:02.555614 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff333a9-361d-4b70-84a0-7e43717e3459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:41:02.556357 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff333a9-361d-4b70-84a0-7e43717e3459 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:02.556565 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff333a9-361d-4b70-84a0-7e43717e3459 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:02.556839 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff333a9-361d-4b70-84a0-7e43717e3459 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:02.557682 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff333a9-361d-4b70-84a0-7e43717e3459 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:41:02.559386 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff333a9-361d-4b70-84a0-7e43717e3459 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:41:02.571482 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1105/2202] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:41:02 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:41:02.576967 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c33bbfa-60bb-424c-829d-0d5b7cd6f002 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:41:02.592318 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c33bbfa-60bb-424c-829d-0d5b7cd6f002 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:41:02.599350 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d1584f-e713-456f-80f6-9305685ce43f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:41:02.600246 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d1584f-e713-456f-80f6-9305685ce43f admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:02.600705 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d1584f-e713-456f-80f6-9305685ce43f admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:02.600949 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d1584f-e713-456f-80f6-9305685ce43f admin admin] PATH_INFO: `/v3/projects/514241da01c94150800baa12ee596e14/users/8aaec6fb238c478b9c093bf0021854ff/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:02.603457 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d1584f-e713-456f-80f6-9305685ce43f admin admin] RBAC: Authorizing `identity:create_grant(project_id=514241da01c94150800baa12ee596e14, user_id=8aaec6fb238c478b9c093bf0021854ff, role_id=1a1c43cc97a0407eb7a7c7a1333a9d4a)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:41:02.606683 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d1584f-e713-456f-80f6-9305685ce43f admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:41:02.623717 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1098/2203] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 22:41:02 2022] PUT /identity/v3/projects/514241da01c94150800baa12ee596e14/users/8aaec6fb238c478b9c093bf0021854ff/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:41:02.636616 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d1f1f3-799c-420c-8829-70af8f539570 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:02.636874 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d1f1f3-799c-420c-8829-70af8f539570 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:02.637151 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d1f1f3-799c-420c-8829-70af8f539570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:02.678414 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-18d1f1f3-799c-420c-8829-70af8f539570 None None] MFA Rules not processed for user `8aaec6fb238c478b9c093bf0021854ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:41:02.680315 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-18d1f1f3-799c-420c-8829-70af8f539570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:41:02.739577 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:41:02.790372 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1106/2204] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:41:02 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:41:02.803032 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d1584f-e713-456f-80f6-9305685ce43f admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:41:02.806807 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-b1d1584f-e713-456f-80f6-9305685ce43f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:41:02.884591 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d1584f-e713-456f-80f6-9305685ce43f admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:41:02.893878 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aff3d76-f5fa-4daf-b9da-874b0402e139 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a747e2a5684843a6ee9e3480badac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:41:02.894957 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aff3d76-f5fa-4daf-b9da-874b0402e139 service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:02.895412 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aff3d76-f5fa-4daf-b9da-874b0402e139 service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:02.895697 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aff3d76-f5fa-4daf-b9da-874b0402e139 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:02.904744 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:41:02.913451 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aff3d76-f5fa-4daf-b9da-874b0402e139 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:41:02.916300 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aff3d76-f5fa-4daf-b9da-874b0402e139 service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:41:02.926378 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1099/2205] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:41:02 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:41:03.655588 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d1f1f3-799c-420c-8829-70af8f539570 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:41:03.727223 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d1f1f3-799c-420c-8829-70af8f539570 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:41:03.732524 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18a601f-3e59-4a95-8914-eb93d4cc2b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:41:03.733436 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a601f-3e59-4a95-8914-eb93d4cc2b27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:03.733729 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a601f-3e59-4a95-8914-eb93d4cc2b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:03.734006 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a601f-3e59-4a95-8914-eb93d4cc2b27 admin admin] PATH_INFO: `/v3/users/f7e8bd5d6eb144298f56423c9d5a1280` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:03.735273 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18a601f-3e59-4a95-8914-eb93d4cc2b27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7e8bd5d6eb144298f56423c9d5a1280)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:41:03.737268 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18a601f-3e59-4a95-8914-eb93d4cc2b27 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:41:03.790702 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-c18a601f-3e59-4a95-8914-eb93d4cc2b27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7e8bd5d6eb144298f56423c9d5a1280'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:03.799949 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-c18a601f-3e59-4a95-8914-eb93d4cc2b27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7e8bd5d6eb144298f56423c9d5a1280'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:03.800759 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-c18a601f-3e59-4a95-8914-eb93d4cc2b27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7e8bd5d6eb144298f56423c9d5a1280'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:03.801388 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-c18a601f-3e59-4a95-8914-eb93d4cc2b27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7e8bd5d6eb144298f56423c9d5a1280'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:03.814275 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-c18a601f-3e59-4a95-8914-eb93d4cc2b27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7e8bd5d6eb144298f56423c9d5a1280'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:03.830993 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1107/2206] 10.222.0.36 () {58 vars in 1223 bytes} [Fri Jun 24 22:41:03 2022] DELETE /identity/v3/users/f7e8bd5d6eb144298f56423c9d5a1280 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:41:03.835992 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d858a2f1-bf23-4ec5-a628-e8c41ca43ae9 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:03.836949 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d858a2f1-bf23-4ec5-a628-e8c41ca43ae9 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:03.837225 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d858a2f1-bf23-4ec5-a628-e8c41ca43ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:03.857491 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-d858a2f1-bf23-4ec5-a628-e8c41ca43ae9 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:41:03.858632 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-d858a2f1-bf23-4ec5-a628-e8c41ca43ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:41:03.936007 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1100/2207] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:41:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:41:03.945544 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18a601f-3e59-4a95-8914-eb93d4cc2b27 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:41:03.947420 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-c18a601f-3e59-4a95-8914-eb93d4cc2b27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:41:04.009164 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18a601f-3e59-4a95-8914-eb93d4cc2b27 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:41:04.018167 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd4c6ba-02ac-4bf2-8181-dc481da6411f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:41:04.018871 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd4c6ba-02ac-4bf2-8181-dc481da6411f service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:04.019155 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd4c6ba-02ac-4bf2-8181-dc481da6411f service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:04.019465 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd4c6ba-02ac-4bf2-8181-dc481da6411f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:04.027582 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:41:04.030529 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd4c6ba-02ac-4bf2-8181-dc481da6411f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:41:04.032404 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd4c6ba-02ac-4bf2-8181-dc481da6411f service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:41:04.044055 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1108/2208] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:41:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:41:04.353883 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d858a2f1-bf23-4ec5-a628-e8c41ca43ae9 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:41:04.355553 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-d858a2f1-bf23-4ec5-a628-e8c41ca43ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:41:04.368482 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d858a2f1-bf23-4ec5-a628-e8c41ca43ae9 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:41:04.374393 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2ca9e6-f316-4c92-a619-3268d634162d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:41:04.375761 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2ca9e6-f316-4c92-a619-3268d634162d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:04.376126 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2ca9e6-f316-4c92-a619-3268d634162d admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:04.376506 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2ca9e6-f316-4c92-a619-3268d634162d admin admin] PATH_INFO: `/v3/projects/d1bca745ac454a4bb5f9e67734792f34` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:04.378082 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2ca9e6-f316-4c92-a619-3268d634162d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1bca745ac454a4bb5f9e67734792f34)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:41:04.390438 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2ca9e6-f316-4c92-a619-3268d634162d admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:41:04.456731 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-cc2ca9e6-f316-4c92-a619-3268d634162d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1bca745ac454a4bb5f9e67734792f34', 'request_id': 'req-cc2ca9e6-f316-4c92-a619-3268d634162d'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:04.464874 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-cc2ca9e6-f316-4c92-a619-3268d634162d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1bca745ac454a4bb5f9e67734792f34', 'request_id': 'req-cc2ca9e6-f316-4c92-a619-3268d634162d'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:04.474812 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-cc2ca9e6-f316-4c92-a619-3268d634162d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1bca745ac454a4bb5f9e67734792f34', 'request_id': 'req-cc2ca9e6-f316-4c92-a619-3268d634162d'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:04.490905 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-cc2ca9e6-f316-4c92-a619-3268d634162d admin admin] The token cache is being invalidate because project d1bca745ac454a4bb5f9e67734792f34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 22:41:04.491202 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-cc2ca9e6-f316-4c92-a619-3268d634162d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:04.491967 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-cc2ca9e6-f316-4c92-a619-3268d634162d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:04.493826 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1101/2209] 10.222.0.36 () {58 vars in 1232 bytes} [Fri Jun 24 22:41:04 2022] DELETE /identity/v3/projects/d1bca745ac454a4bb5f9e67734792f34 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:41:04.498056 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd4c6ba-02ac-4bf2-8181-dc481da6411f service neutron] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:41:04.507887 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd4c6ba-02ac-4bf2-8181-dc481da6411f service neutron] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:41:04.573659 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad03cc9-0ad9-4077-9bbe-8fbb33a3805b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:41:04.574603 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad03cc9-0ad9-4077-9bbe-8fbb33a3805b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:04.574864 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad03cc9-0ad9-4077-9bbe-8fbb33a3805b admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:04.575134 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad03cc9-0ad9-4077-9bbe-8fbb33a3805b admin admin] PATH_INFO: `/v3/users/8aaec6fb238c478b9c093bf0021854ff` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:04.576484 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad03cc9-0ad9-4077-9bbe-8fbb33a3805b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8aaec6fb238c478b9c093bf0021854ff)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:41:04.578611 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad03cc9-0ad9-4077-9bbe-8fbb33a3805b admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:41:04.641796 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2ca9e6-f316-4c92-a619-3268d634162d admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:41:04.641970 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-4ad03cc9-0ad9-4077-9bbe-8fbb33a3805b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8aaec6fb238c478b9c093bf0021854ff'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:04.643204 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-cc2ca9e6-f316-4c92-a619-3268d634162d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:41:04.648882 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-4ad03cc9-0ad9-4077-9bbe-8fbb33a3805b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8aaec6fb238c478b9c093bf0021854ff'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:04.649536 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-4ad03cc9-0ad9-4077-9bbe-8fbb33a3805b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8aaec6fb238c478b9c093bf0021854ff'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:04.650134 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-4ad03cc9-0ad9-4077-9bbe-8fbb33a3805b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8aaec6fb238c478b9c093bf0021854ff'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:04.659067 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2ca9e6-f316-4c92-a619-3268d634162d admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:41:04.663925 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-4ad03cc9-0ad9-4077-9bbe-8fbb33a3805b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8aaec6fb238c478b9c093bf0021854ff'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:04.665358 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426afb2d-ec6a-41df-a93b-cde51d827115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:41:04.666536 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426afb2d-ec6a-41df-a93b-cde51d827115 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:04.667106 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426afb2d-ec6a-41df-a93b-cde51d827115 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:04.667106 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426afb2d-ec6a-41df-a93b-cde51d827115 admin admin] PATH_INFO: `/v3/users/ab9b6eb622e84746b6d5068c912be6c8` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:04.668518 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426afb2d-ec6a-41df-a93b-cde51d827115 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab9b6eb622e84746b6d5068c912be6c8)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:41:04.670750 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426afb2d-ec6a-41df-a93b-cde51d827115 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:41:04.679592 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1109/2210] 10.222.0.36 () {58 vars in 1223 bytes} [Fri Jun 24 22:41:04 2022] DELETE /identity/v3/users/8aaec6fb238c478b9c093bf0021854ff => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:41:04.726700 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-426afb2d-ec6a-41df-a93b-cde51d827115 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab9b6eb622e84746b6d5068c912be6c8'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:04.734821 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-426afb2d-ec6a-41df-a93b-cde51d827115 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab9b6eb622e84746b6d5068c912be6c8'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:04.735928 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-426afb2d-ec6a-41df-a93b-cde51d827115 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab9b6eb622e84746b6d5068c912be6c8'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:04.736683 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-426afb2d-ec6a-41df-a93b-cde51d827115 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab9b6eb622e84746b6d5068c912be6c8'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:04.748576 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:41:04.750086 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-426afb2d-ec6a-41df-a93b-cde51d827115 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab9b6eb622e84746b6d5068c912be6c8'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:04.772510 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1102/2211] 10.222.0.36 () {58 vars in 1223 bytes} [Fri Jun 24 22:41:04 2022] DELETE /identity/v3/users/ab9b6eb622e84746b6d5068c912be6c8 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 22:41:04.774254 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be65b5e8-2473-4d20-9c4a-f2cc1e547acb None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:04.774611 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be65b5e8-2473-4d20-9c4a-f2cc1e547acb None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:04.775045 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be65b5e8-2473-4d20-9c4a-f2cc1e547acb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:04.793276 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-be65b5e8-2473-4d20-9c4a-f2cc1e547acb None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:41:04.794546 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-be65b5e8-2473-4d20-9c4a-f2cc1e547acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:41:04.863684 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1110/2212] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:41:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:41:04.874348 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426afb2d-ec6a-41df-a93b-cde51d827115 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:41:04.876311 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-426afb2d-ec6a-41df-a93b-cde51d827115 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:41:04.942854 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426afb2d-ec6a-41df-a93b-cde51d827115 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:41:04.947240 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e174bf0-10e9-4f78-8052-568245a05bac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:41:04.947928 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e174bf0-10e9-4f78-8052-568245a05bac service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:04.948174 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e174bf0-10e9-4f78-8052-568245a05bac service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:04.948450 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e174bf0-10e9-4f78-8052-568245a05bac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:04.965121 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e174bf0-10e9-4f78-8052-568245a05bac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:41:04.966617 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e174bf0-10e9-4f78-8052-568245a05bac service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:41:04.978482 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1103/2213] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:41:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:41:05.001493 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be65b5e8-2473-4d20-9c4a-f2cc1e547acb None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:41:05.003054 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-be65b5e8-2473-4d20-9c4a-f2cc1e547acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:41:05.016082 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be65b5e8-2473-4d20-9c4a-f2cc1e547acb None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:41:05.024045 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3372c5-c26e-4a8d-ab1f-b199f8b0e122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:41:05.026438 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3372c5-c26e-4a8d-ab1f-b199f8b0e122 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:05.026737 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3372c5-c26e-4a8d-ab1f-b199f8b0e122 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:05.027046 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3372c5-c26e-4a8d-ab1f-b199f8b0e122 admin admin] PATH_INFO: `/v3/projects/514241da01c94150800baa12ee596e14` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:05.028652 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3372c5-c26e-4a8d-ab1f-b199f8b0e122 admin admin] RBAC: Authorizing `identity:delete_project(project_id=514241da01c94150800baa12ee596e14)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:41:05.030755 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3372c5-c26e-4a8d-ab1f-b199f8b0e122 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:41:05.054698 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:41:05.100250 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-ea3372c5-c26e-4a8d-ab1f-b199f8b0e122 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '514241da01c94150800baa12ee596e14', 'request_id': 'req-ea3372c5-c26e-4a8d-ab1f-b199f8b0e122'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:05.107911 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-ea3372c5-c26e-4a8d-ab1f-b199f8b0e122 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '514241da01c94150800baa12ee596e14', 'request_id': 'req-ea3372c5-c26e-4a8d-ab1f-b199f8b0e122'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:05.118730 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-ea3372c5-c26e-4a8d-ab1f-b199f8b0e122 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '514241da01c94150800baa12ee596e14', 'request_id': 'req-ea3372c5-c26e-4a8d-ab1f-b199f8b0e122'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:05.130521 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-ea3372c5-c26e-4a8d-ab1f-b199f8b0e122 admin admin] The token cache is being invalidate because project 514241da01c94150800baa12ee596e14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 22:41:05.130876 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-ea3372c5-c26e-4a8d-ab1f-b199f8b0e122 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:05.131552 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-ea3372c5-c26e-4a8d-ab1f-b199f8b0e122 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:05.133459 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1111/2214] 10.222.0.36 () {58 vars in 1232 bytes} [Fri Jun 24 22:41:05 2022] DELETE /identity/v3/projects/514241da01c94150800baa12ee596e14 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:41:05.139221 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f0e4e8-c1ac-49f9-b988-244aab0be0ee None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:05.139564 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f0e4e8-c1ac-49f9-b988-244aab0be0ee None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:05.139841 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f0e4e8-c1ac-49f9-b988-244aab0be0ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:05.160397 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-24f0e4e8-c1ac-49f9-b988-244aab0be0ee None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:41:05.162170 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-24f0e4e8-c1ac-49f9-b988-244aab0be0ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:41:05.228190 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1104/2215] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:41:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:41:05.236330 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c189a66b-90f3-4a07-a8a1-7e0867ce0cc7 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:05.236636 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c189a66b-90f3-4a07-a8a1-7e0867ce0cc7 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:05.237629 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c189a66b-90f3-4a07-a8a1-7e0867ce0cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:05.258587 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-c189a66b-90f3-4a07-a8a1-7e0867ce0cc7 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:41:05.259990 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-c189a66b-90f3-4a07-a8a1-7e0867ce0cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:41:05.269086 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1112/2216] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:41:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:41:05.274415 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f0e4e8-c1ac-49f9-b988-244aab0be0ee None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:41:05.276321 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c189a66b-90f3-4a07-a8a1-7e0867ce0cc7 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:41:05.277826 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-c189a66b-90f3-4a07-a8a1-7e0867ce0cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:41:05.286200 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f0e4e8-c1ac-49f9-b988-244aab0be0ee None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:41:05.291139 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c189a66b-90f3-4a07-a8a1-7e0867ce0cc7 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:41:05.296286 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4e9935-a944-44d3-a0b9-06c29f4de819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:41:05.296720 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990711cd-830d-48aa-8e7f-5b36b62d20b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:41:05.297303 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e9935-a944-44d3-a0b9-06c29f4de819 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:05.297732 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990711cd-830d-48aa-8e7f-5b36b62d20b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:05.297855 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e9935-a944-44d3-a0b9-06c29f4de819 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:05.298123 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990711cd-830d-48aa-8e7f-5b36b62d20b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:05.298412 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e9935-a944-44d3-a0b9-06c29f4de819 admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:05.298537 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990711cd-830d-48aa-8e7f-5b36b62d20b2 admin admin] PATH_INFO: `/v3/projects/4fb4482274fb4cbd986a2ead2229cfff` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:05.299640 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4e9935-a944-44d3-a0b9-06c29f4de819 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:41:05.299902 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990711cd-830d-48aa-8e7f-5b36b62d20b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fb4482274fb4cbd986a2ead2229cfff)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:41:05.300202 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4e9935-a944-44d3-a0b9-06c29f4de819 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:41:05.301994 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990711cd-830d-48aa-8e7f-5b36b62d20b2 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:41:05.303501 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4e9935-a944-44d3-a0b9-06c29f4de819 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:41:05.319316 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1105/2217] 10.222.0.36 () {58 vars in 1152 bytes} [Fri Jun 24 22:41:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:41:05.323881 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4e9935-a944-44d3-a0b9-06c29f4de819 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:41:05.334388 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4e9935-a944-44d3-a0b9-06c29f4de819 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:41:05.341930 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd13f964-1c95-4411-9ea1-b8d231b216bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:41:05.343002 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd13f964-1c95-4411-9ea1-b8d231b216bb admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:05.343424 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd13f964-1c95-4411-9ea1-b8d231b216bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:05.343851 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd13f964-1c95-4411-9ea1-b8d231b216bb admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:05.344930 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd13f964-1c95-4411-9ea1-b8d231b216bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:41:05.348117 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd13f964-1c95-4411-9ea1-b8d231b216bb admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:41:05.354961 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-990711cd-830d-48aa-8e7f-5b36b62d20b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fb4482274fb4cbd986a2ead2229cfff', 'request_id': 'req-990711cd-830d-48aa-8e7f-5b36b62d20b2'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:05.361634 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-990711cd-830d-48aa-8e7f-5b36b62d20b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fb4482274fb4cbd986a2ead2229cfff', 'request_id': 'req-990711cd-830d-48aa-8e7f-5b36b62d20b2'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:05.377596 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-990711cd-830d-48aa-8e7f-5b36b62d20b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fb4482274fb4cbd986a2ead2229cfff', 'request_id': 'req-990711cd-830d-48aa-8e7f-5b36b62d20b2'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:05.391937 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1106/2218] 10.222.0.36 () {60 vars in 1152 bytes} [Fri Jun 24 22:41:05 2022] POST /identity/v3/projects => generated 375 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 22:41:05.392122 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-990711cd-830d-48aa-8e7f-5b36b62d20b2 admin admin] The token cache is being invalidate because project 4fb4482274fb4cbd986a2ead2229cfff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 22:41:05.392122 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-990711cd-830d-48aa-8e7f-5b36b62d20b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:05.392122 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-990711cd-830d-48aa-8e7f-5b36b62d20b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:05.392122 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1113/2219] 10.222.0.36 () {58 vars in 1232 bytes} [Fri Jun 24 22:41:05 2022] DELETE /identity/v3/projects/4fb4482274fb4cbd986a2ead2229cfff => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 22:41:05.395454 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990711cd-830d-48aa-8e7f-5b36b62d20b2 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:41:05.395580 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd13f964-1c95-4411-9ea1-b8d231b216bb admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:41:05.396839 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-990711cd-830d-48aa-8e7f-5b36b62d20b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:41:05.397426 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-fd13f964-1c95-4411-9ea1-b8d231b216bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:41:05.465390 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990711cd-830d-48aa-8e7f-5b36b62d20b2 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:41:05.468268 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:41:05.472604 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd13f964-1c95-4411-9ea1-b8d231b216bb admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:41:05.478589 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff01100a-cb69-4b14-96ef-f8ce3f355474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:41:05.479528 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff01100a-cb69-4b14-96ef-f8ce3f355474 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:05.479811 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff01100a-cb69-4b14-96ef-f8ce3f355474 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:05.480089 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff01100a-cb69-4b14-96ef-f8ce3f355474 admin admin] PATH_INFO: `/v3/users/d85af99521d14458a1949ae8bb3027c2` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:05.481299 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff01100a-cb69-4b14-96ef-f8ce3f355474 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d85af99521d14458a1949ae8bb3027c2)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:41:05.481691 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022085dc-139b-44a0-aeda-2f7a61950f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:41:05.482600 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022085dc-139b-44a0-aeda-2f7a61950f97 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:05.483118 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022085dc-139b-44a0-aeda-2f7a61950f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:05.483241 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff01100a-cb69-4b14-96ef-f8ce3f355474 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:41:05.483545 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022085dc-139b-44a0-aeda-2f7a61950f97 admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:05.484321 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022085dc-139b-44a0-aeda-2f7a61950f97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:41:05.486550 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022085dc-139b-44a0-aeda-2f7a61950f97 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:41:05.500030 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:41:05.509793 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1107/2220] 10.222.0.36 () {60 vars in 1143 bytes} [Fri Jun 24 22:41:05 2022] POST /identity/v3/users => generated 288 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:41:05.513901 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022085dc-139b-44a0-aeda-2f7a61950f97 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:41:05.529590 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022085dc-139b-44a0-aeda-2f7a61950f97 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:41:05.535190 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731f609b-dfc9-4a02-b729-832f32d70198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:41:05.536565 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f609b-dfc9-4a02-b729-832f32d70198 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:05.536565 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f609b-dfc9-4a02-b729-832f32d70198 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:05.536565 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f609b-dfc9-4a02-b729-832f32d70198 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:05.537137 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731f609b-dfc9-4a02-b729-832f32d70198 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:41:05.537406 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-ff01100a-cb69-4b14-96ef-f8ce3f355474 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd85af99521d14458a1949ae8bb3027c2'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:05.538787 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731f609b-dfc9-4a02-b729-832f32d70198 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:41:05.548295 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-ff01100a-cb69-4b14-96ef-f8ce3f355474 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd85af99521d14458a1949ae8bb3027c2'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:05.549092 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-ff01100a-cb69-4b14-96ef-f8ce3f355474 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd85af99521d14458a1949ae8bb3027c2'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:05.549768 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-ff01100a-cb69-4b14-96ef-f8ce3f355474 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd85af99521d14458a1949ae8bb3027c2'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:05.555136 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1108/2221] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:41:05 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:41:05.559448 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731f609b-dfc9-4a02-b729-832f32d70198 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:41:05.561635 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-731f609b-dfc9-4a02-b729-832f32d70198 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:41:05.566303 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-ff01100a-cb69-4b14-96ef-f8ce3f355474 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd85af99521d14458a1949ae8bb3027c2'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:05.578085 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731f609b-dfc9-4a02-b729-832f32d70198 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:41:05.581899 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1114/2222] 10.222.0.36 () {58 vars in 1223 bytes} [Fri Jun 24 22:41:05 2022] DELETE /identity/v3/users/d85af99521d14458a1949ae8bb3027c2 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:41:05.586801 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9c45f9-ac53-4dcc-bf39-94b8de8f04dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:41:05.587546 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9c45f9-ac53-4dcc-bf39-94b8de8f04dc admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:05.587835 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9c45f9-ac53-4dcc-bf39-94b8de8f04dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:05.592137 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9c45f9-ac53-4dcc-bf39-94b8de8f04dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:05.592137 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9c45f9-ac53-4dcc-bf39-94b8de8f04dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:41:05.592137 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9c45f9-ac53-4dcc-bf39-94b8de8f04dc admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:41:05.603114 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1109/2223] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:41:05 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 22:41:05.607031 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff01100a-cb69-4b14-96ef-f8ce3f355474 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:41:05.677628 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff01100a-cb69-4b14-96ef-f8ce3f355474 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:41:05.684277 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525294da-8beb-47f9-a29d-39795377f5ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:41:05.685682 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525294da-8beb-47f9-a29d-39795377f5ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:05.686128 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525294da-8beb-47f9-a29d-39795377f5ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:05.686536 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525294da-8beb-47f9-a29d-39795377f5ae admin admin] PATH_INFO: `/v3/projects/0e47629ef85949bd9fc74ecf9fd80b2b/users/0bb2b4bf46914155b05d4a7b9e57562b/roles/1928787bfcc745419829cd315900ac44` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:05.705786 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525294da-8beb-47f9-a29d-39795377f5ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e47629ef85949bd9fc74ecf9fd80b2b, user_id=0bb2b4bf46914155b05d4a7b9e57562b, role_id=1928787bfcc745419829cd315900ac44)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:41:05.708747 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525294da-8beb-47f9-a29d-39795377f5ae admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:41:05.723430 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1115/2224] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 22:41:05 2022] PUT /identity/v3/projects/0e47629ef85949bd9fc74ecf9fd80b2b/users/0bb2b4bf46914155b05d4a7b9e57562b/roles/1928787bfcc745419829cd315900ac44 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:41:05.736069 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eced92-e4fc-4e13-8994-6a09abc88133 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:05.736438 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eced92-e4fc-4e13-8994-6a09abc88133 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:05.736789 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eced92-e4fc-4e13-8994-6a09abc88133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:05.779891 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-20eced92-e4fc-4e13-8994-6a09abc88133 None None] MFA Rules not processed for user `0bb2b4bf46914155b05d4a7b9e57562b`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:41:05.781251 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-20eced92-e4fc-4e13-8994-6a09abc88133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:41:05.886394 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1110/2225] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:41:05 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:41:05.890973 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525294da-8beb-47f9-a29d-39795377f5ae admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:41:05.967004 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525294da-8beb-47f9-a29d-39795377f5ae admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:41:05.982017 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb42b3a-7fb0-4a82-9fbc-dcc621bb5838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:41:05.983096 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb42b3a-7fb0-4a82-9fbc-dcc621bb5838 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:05.983243 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb42b3a-7fb0-4a82-9fbc-dcc621bb5838 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:05.983485 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb42b3a-7fb0-4a82-9fbc-dcc621bb5838 admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:05.984326 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb42b3a-7fb0-4a82-9fbc-dcc621bb5838 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:41:05.986838 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb42b3a-7fb0-4a82-9fbc-dcc621bb5838 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:41:06.000690 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eced92-e4fc-4e13-8994-6a09abc88133 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:41:06.002187 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-20eced92-e4fc-4e13-8994-6a09abc88133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:41:06.036337 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1116/2226] 10.222.0.36 () {60 vars in 1152 bytes} [Fri Jun 24 22:41:05 2022] POST /identity/v3/projects => generated 375 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:41:06.050919 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb42b3a-7fb0-4a82-9fbc-dcc621bb5838 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:41:06.052207 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eced92-e4fc-4e13-8994-6a09abc88133 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:41:06.067327 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:DELETE=9,keystone:SELECT=88,keystone:INSERT=3 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:41:06.153548 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d83d09b-a142-4c59-afe8-2bd5fc185b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:41:06.154507 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d83d09b-a142-4c59-afe8-2bd5fc185b00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:06.154793 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d83d09b-a142-4c59-afe8-2bd5fc185b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:06.155077 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d83d09b-a142-4c59-afe8-2bd5fc185b00 admin admin] PATH_INFO: `/v3/projects/6242d9e532d44572b5eed467787d7038` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:06.156329 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d83d09b-a142-4c59-afe8-2bd5fc185b00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6242d9e532d44572b5eed467787d7038)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:41:06.158309 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d83d09b-a142-4c59-afe8-2bd5fc185b00 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:41:06.173048 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb42b3a-7fb0-4a82-9fbc-dcc621bb5838 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:41:06.178457 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370034d3-cc74-483e-912a-85bb4b732028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:41:06.179961 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370034d3-cc74-483e-912a-85bb4b732028 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:06.181029 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370034d3-cc74-483e-912a-85bb4b732028 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:06.181466 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370034d3-cc74-483e-912a-85bb4b732028 admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:06.182306 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370034d3-cc74-483e-912a-85bb4b732028 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:41:06.184936 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370034d3-cc74-483e-912a-85bb4b732028 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:41:06.215336 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1117/2227] 10.222.0.36 () {60 vars in 1143 bytes} [Fri Jun 24 22:41:06 2022] POST /identity/v3/users => generated 294 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:41:06.219200 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370034d3-cc74-483e-912a-85bb4b732028 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:41:06.223587 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-7d83d09b-a142-4c59-afe8-2bd5fc185b00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6242d9e532d44572b5eed467787d7038', 'request_id': 'req-7d83d09b-a142-4c59-afe8-2bd5fc185b00'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:06.229185 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370034d3-cc74-483e-912a-85bb4b732028 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:41:06.230244 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-7d83d09b-a142-4c59-afe8-2bd5fc185b00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6242d9e532d44572b5eed467787d7038', 'request_id': 'req-7d83d09b-a142-4c59-afe8-2bd5fc185b00'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:06.232871 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:41:06.240682 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-7d83d09b-a142-4c59-afe8-2bd5fc185b00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6242d9e532d44572b5eed467787d7038', 'request_id': 'req-7d83d09b-a142-4c59-afe8-2bd5fc185b00'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:06.253970 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-7d83d09b-a142-4c59-afe8-2bd5fc185b00 admin admin] The token cache is being invalidate because project 6242d9e532d44572b5eed467787d7038 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 22:41:06.254348 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-7d83d09b-a142-4c59-afe8-2bd5fc185b00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:06.255064 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-7d83d09b-a142-4c59-afe8-2bd5fc185b00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:06.256759 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1111/2228] 10.222.0.36 () {58 vars in 1232 bytes} [Fri Jun 24 22:41:05 2022] DELETE /identity/v3/projects/6242d9e532d44572b5eed467787d7038 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:41:06.260683 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d83d09b-a142-4c59-afe8-2bd5fc185b00 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:41:06.262044 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-7d83d09b-a142-4c59-afe8-2bd5fc185b00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:41:06.292236 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ec4a54-9ea4-475e-9922-44f37beaeed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:41:06.292917 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ec4a54-9ea4-475e-9922-44f37beaeed4 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:06.293219 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ec4a54-9ea4-475e-9922-44f37beaeed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:06.293621 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ec4a54-9ea4-475e-9922-44f37beaeed4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:06.294333 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ec4a54-9ea4-475e-9922-44f37beaeed4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:41:06.296002 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ec4a54-9ea4-475e-9922-44f37beaeed4 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:41:06.308176 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1118/2229] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:41:06 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:41:06.312261 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ec4a54-9ea4-475e-9922-44f37beaeed4 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:41:06.313984 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-d2ec4a54-9ea4-475e-9922-44f37beaeed4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:41:06.329377 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ec4a54-9ea4-475e-9922-44f37beaeed4 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:41:06.334151 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8106257-bcb4-41d9-867e-c950315ea350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:41:06.335063 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8106257-bcb4-41d9-867e-c950315ea350 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:06.335330 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d83d09b-a142-4c59-afe8-2bd5fc185b00 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:41:06.335448 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8106257-bcb4-41d9-867e-c950315ea350 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:06.335653 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8106257-bcb4-41d9-867e-c950315ea350 admin admin] PATH_INFO: `/v3/projects/a4fa44f9a3a94c89bddd2352b4312251/users/b768448b16084dc9a9e1ae916a4ffd26/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:06.341132 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d32d182-5a3d-4519-a3f5-ebe0f3a901be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:41:06.342012 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d32d182-5a3d-4519-a3f5-ebe0f3a901be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:06.342292 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d32d182-5a3d-4519-a3f5-ebe0f3a901be admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:06.342551 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d32d182-5a3d-4519-a3f5-ebe0f3a901be admin admin] PATH_INFO: `/v3/users/fc6e203938904096a702c6b72c8b1a4e` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:06.343814 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d32d182-5a3d-4519-a3f5-ebe0f3a901be admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc6e203938904096a702c6b72c8b1a4e)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:41:06.345809 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d32d182-5a3d-4519-a3f5-ebe0f3a901be admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:41:06.352005 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8106257-bcb4-41d9-867e-c950315ea350 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4fa44f9a3a94c89bddd2352b4312251, user_id=b768448b16084dc9a9e1ae916a4ffd26, role_id=1a1c43cc97a0407eb7a7c7a1333a9d4a)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:41:06.354738 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8106257-bcb4-41d9-867e-c950315ea350 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:41:06.371728 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1119/2230] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 22:41:06 2022] PUT /identity/v3/projects/a4fa44f9a3a94c89bddd2352b4312251/users/b768448b16084dc9a9e1ae916a4ffd26/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 22:41:06.376319 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8106257-bcb4-41d9-867e-c950315ea350 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:41:06.406859 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-6d32d182-5a3d-4519-a3f5-ebe0f3a901be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc6e203938904096a702c6b72c8b1a4e'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:06.413822 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-6d32d182-5a3d-4519-a3f5-ebe0f3a901be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc6e203938904096a702c6b72c8b1a4e'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:06.414957 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-6d32d182-5a3d-4519-a3f5-ebe0f3a901be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc6e203938904096a702c6b72c8b1a4e'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:06.415706 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-6d32d182-5a3d-4519-a3f5-ebe0f3a901be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc6e203938904096a702c6b72c8b1a4e'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:06.432898 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-6d32d182-5a3d-4519-a3f5-ebe0f3a901be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc6e203938904096a702c6b72c8b1a4e'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:06.450062 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1112/2231] 10.222.0.36 () {58 vars in 1223 bytes} [Fri Jun 24 22:41:06 2022] DELETE /identity/v3/users/fc6e203938904096a702c6b72c8b1a4e => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 22:41:06.450988 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8106257-bcb4-41d9-867e-c950315ea350 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:41:06.459283 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:41:06.512787 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e376e645-3e6a-4474-99ca-07b95dfa05a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:41:06.513553 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e376e645-3e6a-4474-99ca-07b95dfa05a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:06.513844 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e376e645-3e6a-4474-99ca-07b95dfa05a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:06.514099 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e376e645-3e6a-4474-99ca-07b95dfa05a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:06.514839 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e376e645-3e6a-4474-99ca-07b95dfa05a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:41:06.516555 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e376e645-3e6a-4474-99ca-07b95dfa05a8 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:41:06.526871 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1120/2232] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:41:06 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 22:41:06.531124 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d32d182-5a3d-4519-a3f5-ebe0f3a901be admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:41:06.532916 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-6d32d182-5a3d-4519-a3f5-ebe0f3a901be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:41:06.547526 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d32d182-5a3d-4519-a3f5-ebe0f3a901be admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:41:06.553107 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d86c06-42d6-493c-b45c-2fd2c2a14ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:41:06.554159 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d86c06-42d6-493c-b45c-2fd2c2a14ea9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:06.554324 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d86c06-42d6-493c-b45c-2fd2c2a14ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:06.554568 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d86c06-42d6-493c-b45c-2fd2c2a14ea9 admin admin] PATH_INFO: `/v3/projects/a4fa44f9a3a94c89bddd2352b4312251/users/b768448b16084dc9a9e1ae916a4ffd26/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:06.557060 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d86c06-42d6-493c-b45c-2fd2c2a14ea9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4fa44f9a3a94c89bddd2352b4312251, user_id=b768448b16084dc9a9e1ae916a4ffd26, role_id=1a1c43cc97a0407eb7a7c7a1333a9d4a)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:41:06.559975 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d86c06-42d6-493c-b45c-2fd2c2a14ea9 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:41:06.572122 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1113/2233] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 22:41:06 2022] PUT /identity/v3/projects/a4fa44f9a3a94c89bddd2352b4312251/users/b768448b16084dc9a9e1ae916a4ffd26/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:41:06.582364 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a24a759-6f3d-441f-a559-541612a226a1 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:06.582644 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a24a759-6f3d-441f-a559-541612a226a1 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:06.582931 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a24a759-6f3d-441f-a559-541612a226a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:06.613285 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-1a24a759-6f3d-441f-a559-541612a226a1 None None] MFA Rules not processed for user `b768448b16084dc9a9e1ae916a4ffd26`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:41:06.615007 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-1a24a759-6f3d-441f-a559-541612a226a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:41:06.692861 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1121/2234] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:41:06 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:41:06.705544 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d86c06-42d6-493c-b45c-2fd2c2a14ea9 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:41:06.707057 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-a9d86c06-42d6-493c-b45c-2fd2c2a14ea9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:41:06.744248 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a24a759-6f3d-441f-a559-541612a226a1 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:41:06.746020 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-1a24a759-6f3d-441f-a559-541612a226a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:41:06.774189 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d86c06-42d6-493c-b45c-2fd2c2a14ea9 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:41:06.778594 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210a88a5-d6dc-4007-b8c2-8e544191a474 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a747e2a5684843a6ee9e3480badac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:41:06.779699 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210a88a5-d6dc-4007-b8c2-8e544191a474 service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:06.780286 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210a88a5-d6dc-4007-b8c2-8e544191a474 service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:06.780568 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210a88a5-d6dc-4007-b8c2-8e544191a474 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:06.782845 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-210a88a5-d6dc-4007-b8c2-8e544191a474 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:41:06.788803 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:41:06.837564 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a24a759-6f3d-441f-a559-541612a226a1 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:41:06.842660 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d6e138-6114-4089-89fd-40f4ed3c36de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:41:06.843718 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d6e138-6114-4089-89fd-40f4ed3c36de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:06.844016 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d6e138-6114-4089-89fd-40f4ed3c36de admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:06.844286 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d6e138-6114-4089-89fd-40f4ed3c36de admin admin] PATH_INFO: `/v3/projects/07c34aabdea145068518632dd43b03b9` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:06.845552 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d6e138-6114-4089-89fd-40f4ed3c36de admin admin] RBAC: Authorizing `identity:delete_project(project_id=07c34aabdea145068518632dd43b03b9)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:41:06.847500 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d6e138-6114-4089-89fd-40f4ed3c36de admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:41:06.860431 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210a88a5-d6dc-4007-b8c2-8e544191a474 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:41:06.861997 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210a88a5-d6dc-4007-b8c2-8e544191a474 service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:41:06.872429 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1114/2235] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:41:06 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:41:06.893793 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:41:06.905193 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-31d6e138-6114-4089-89fd-40f4ed3c36de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07c34aabdea145068518632dd43b03b9', 'request_id': 'req-31d6e138-6114-4089-89fd-40f4ed3c36de'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:06.912324 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-31d6e138-6114-4089-89fd-40f4ed3c36de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07c34aabdea145068518632dd43b03b9', 'request_id': 'req-31d6e138-6114-4089-89fd-40f4ed3c36de'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:06.922452 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-31d6e138-6114-4089-89fd-40f4ed3c36de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07c34aabdea145068518632dd43b03b9', 'request_id': 'req-31d6e138-6114-4089-89fd-40f4ed3c36de'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:06.939913 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-31d6e138-6114-4089-89fd-40f4ed3c36de admin admin] The token cache is being invalidate because project 07c34aabdea145068518632dd43b03b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 22:41:06.940235 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-31d6e138-6114-4089-89fd-40f4ed3c36de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:06.941056 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-31d6e138-6114-4089-89fd-40f4ed3c36de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:06.942784 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1122/2236] 10.222.0.36 () {58 vars in 1232 bytes} [Fri Jun 24 22:41:06 2022] DELETE /identity/v3/projects/07c34aabdea145068518632dd43b03b9 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:41:06.947977 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5789273f-2b6f-480b-9fc9-09e9086a85a4 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:06.948510 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5789273f-2b6f-480b-9fc9-09e9086a85a4 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:06.948668 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5789273f-2b6f-480b-9fc9-09e9086a85a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:06.969771 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-5789273f-2b6f-480b-9fc9-09e9086a85a4 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:41:06.971218 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-5789273f-2b6f-480b-9fc9-09e9086a85a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:41:07.053187 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1115/2237] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:41:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:41:07.063534 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b7b4ed-e149-48f4-8085-168743e1be02 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:07.064082 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b7b4ed-e149-48f4-8085-168743e1be02 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:07.064466 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b7b4ed-e149-48f4-8085-168743e1be02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:07.087613 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-f8b7b4ed-e149-48f4-8085-168743e1be02 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:41:07.088950 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-f8b7b4ed-e149-48f4-8085-168743e1be02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:41:07.098883 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1123/2238] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:41:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:41:07.103362 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5789273f-2b6f-480b-9fc9-09e9086a85a4 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:41:07.114276 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5789273f-2b6f-480b-9fc9-09e9086a85a4 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:41:07.120134 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aefbaed-85a0-414c-87da-d3730ce52c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:41:07.120685 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aefbaed-85a0-414c-87da-d3730ce52c8a admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:07.121068 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aefbaed-85a0-414c-87da-d3730ce52c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:07.121560 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aefbaed-85a0-414c-87da-d3730ce52c8a admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:07.122597 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aefbaed-85a0-414c-87da-d3730ce52c8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:41:07.123001 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aefbaed-85a0-414c-87da-d3730ce52c8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:41:07.124879 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aefbaed-85a0-414c-87da-d3730ce52c8a admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:41:07.147293 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1116/2239] 10.222.0.36 () {58 vars in 1152 bytes} [Fri Jun 24 22:41:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:41:07.151546 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b7b4ed-e149-48f4-8085-168743e1be02 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:41:07.171768 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b7b4ed-e149-48f4-8085-168743e1be02 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:41:07.177720 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be18769d-40c6-4169-bbad-ebbeb1b48480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:41:07.178459 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be18769d-40c6-4169-bbad-ebbeb1b48480 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:07.178744 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be18769d-40c6-4169-bbad-ebbeb1b48480 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:07.179017 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be18769d-40c6-4169-bbad-ebbeb1b48480 admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:07.180345 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be18769d-40c6-4169-bbad-ebbeb1b48480 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:41:07.182456 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be18769d-40c6-4169-bbad-ebbeb1b48480 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:41:07.232448 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1124/2240] 10.222.0.36 () {60 vars in 1152 bytes} [Fri Jun 24 22:41:07 2022] POST /identity/v3/projects => generated 385 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:41:07.236683 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aefbaed-85a0-414c-87da-d3730ce52c8a admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:41:07.247808 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aefbaed-85a0-414c-87da-d3730ce52c8a admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:41:07.318802 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0494b999-73e7-4524-ad2e-5bc3e4961e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:41:07.319516 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0494b999-73e7-4524-ad2e-5bc3e4961e65 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:07.319797 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0494b999-73e7-4524-ad2e-5bc3e4961e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:07.320072 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0494b999-73e7-4524-ad2e-5bc3e4961e65 admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:07.320898 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0494b999-73e7-4524-ad2e-5bc3e4961e65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:41:07.322858 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0494b999-73e7-4524-ad2e-5bc3e4961e65 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:41:07.345103 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1117/2241] 10.222.0.36 () {60 vars in 1143 bytes} [Fri Jun 24 22:41:07 2022] POST /identity/v3/users => generated 293 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 22:41:07.349320 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be18769d-40c6-4169-bbad-ebbeb1b48480 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:41:07.360205 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be18769d-40c6-4169-bbad-ebbeb1b48480 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:41:07.365237 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c825aeee-f5a0-40c4-b032-6a70f147efbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:41:07.366049 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c825aeee-f5a0-40c4-b032-6a70f147efbc admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:07.366336 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c825aeee-f5a0-40c4-b032-6a70f147efbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:07.366614 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c825aeee-f5a0-40c4-b032-6a70f147efbc admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:07.367430 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c825aeee-f5a0-40c4-b032-6a70f147efbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:41:07.369281 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c825aeee-f5a0-40c4-b032-6a70f147efbc admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:41:07.381420 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1125/2242] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:41:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:41:07.385959 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0494b999-73e7-4524-ad2e-5bc3e4961e65 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:41:07.396452 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0494b999-73e7-4524-ad2e-5bc3e4961e65 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:41:07.401457 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01109c37-806b-43ff-8dd2-b50978339fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:41:07.402239 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01109c37-806b-43ff-8dd2-b50978339fc3 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:07.402525 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01109c37-806b-43ff-8dd2-b50978339fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:07.402799 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01109c37-806b-43ff-8dd2-b50978339fc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:07.403638 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01109c37-806b-43ff-8dd2-b50978339fc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:41:07.405208 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01109c37-806b-43ff-8dd2-b50978339fc3 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:41:07.416163 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1118/2243] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:41:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:41:07.420517 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c825aeee-f5a0-40c4-b032-6a70f147efbc admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:41:07.433033 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c825aeee-f5a0-40c4-b032-6a70f147efbc admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:41:07.438727 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20948f20-a5e7-4551-b2cb-ccf71186644d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:41:07.439668 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20948f20-a5e7-4551-b2cb-ccf71186644d admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:07.439950 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20948f20-a5e7-4551-b2cb-ccf71186644d admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:07.440221 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20948f20-a5e7-4551-b2cb-ccf71186644d admin admin] PATH_INFO: `/v3/projects/2540c43fde07450db78aacff973ea9c1/users/e4065e7325d944948b092165a641f8c3/roles/1928787bfcc745419829cd315900ac44` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:07.458894 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20948f20-a5e7-4551-b2cb-ccf71186644d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2540c43fde07450db78aacff973ea9c1, user_id=e4065e7325d944948b092165a641f8c3, role_id=1928787bfcc745419829cd315900ac44)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:41:07.463026 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20948f20-a5e7-4551-b2cb-ccf71186644d admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:41:07.481515 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1126/2244] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 22:41:07 2022] PUT /identity/v3/projects/2540c43fde07450db78aacff973ea9c1/users/e4065e7325d944948b092165a641f8c3/roles/1928787bfcc745419829cd315900ac44 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:41:07.492906 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c40384c-bac5-4440-9ac3-770fc848df4d None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:07.493326 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c40384c-bac5-4440-9ac3-770fc848df4d None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:07.493776 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c40384c-bac5-4440-9ac3-770fc848df4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:07.521958 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:41:07.530867 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-9c40384c-bac5-4440-9ac3-770fc848df4d None None] MFA Rules not processed for user `e4065e7325d944948b092165a641f8c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:41:07.532858 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-9c40384c-bac5-4440-9ac3-770fc848df4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:41:07.608455 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1119/2245] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:41:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:41:07.613077 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20948f20-a5e7-4551-b2cb-ccf71186644d admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:41:07.681080 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20948f20-a5e7-4551-b2cb-ccf71186644d admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:41:07.686935 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb3b86f-f14c-48e3-acef-009570803cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:41:07.687573 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb3b86f-f14c-48e3-acef-009570803cd8 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:07.687856 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb3b86f-f14c-48e3-acef-009570803cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:07.688127 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb3b86f-f14c-48e3-acef-009570803cd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:07.688834 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb3b86f-f14c-48e3-acef-009570803cd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:41:07.690772 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb3b86f-f14c-48e3-acef-009570803cd8 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:41:07.718839 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1127/2246] 10.222.0.36 () {60 vars in 1152 bytes} [Fri Jun 24 22:41:07 2022] POST /identity/v3/projects => generated 381 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:41:07.723130 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c40384c-bac5-4440-9ac3-770fc848df4d None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:41:07.734917 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c40384c-bac5-4440-9ac3-770fc848df4d None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:41:07.793500 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248c69b3-432b-459b-9d6e-37bb9cf76fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:41:07.794177 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248c69b3-432b-459b-9d6e-37bb9cf76fb0 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:07.794460 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248c69b3-432b-459b-9d6e-37bb9cf76fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:07.794732 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248c69b3-432b-459b-9d6e-37bb9cf76fb0 admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:07.795445 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248c69b3-432b-459b-9d6e-37bb9cf76fb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:41:07.797379 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248c69b3-432b-459b-9d6e-37bb9cf76fb0 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:41:07.821110 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1120/2247] 10.222.0.36 () {60 vars in 1143 bytes} [Fri Jun 24 22:41:07 2022] POST /identity/v3/users => generated 291 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:41:07.825331 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb3b86f-f14c-48e3-acef-009570803cd8 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:41:07.835873 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb3b86f-f14c-48e3-acef-009570803cd8 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:41:07.840713 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed35b2c8-a31f-431d-a013-3f081370d8e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:41:07.841369 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed35b2c8-a31f-431d-a013-3f081370d8e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:07.841762 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed35b2c8-a31f-431d-a013-3f081370d8e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:07.842004 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed35b2c8-a31f-431d-a013-3f081370d8e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:07.842817 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed35b2c8-a31f-431d-a013-3f081370d8e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:41:07.844729 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed35b2c8-a31f-431d-a013-3f081370d8e7 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:41:07.857201 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1128/2248] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:41:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:41:07.861629 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248c69b3-432b-459b-9d6e-37bb9cf76fb0 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:41:07.872132 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248c69b3-432b-459b-9d6e-37bb9cf76fb0 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:41:07.877310 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99718d9f-a3d1-424e-988d-0c49d6fabdcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:41:07.877996 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99718d9f-a3d1-424e-988d-0c49d6fabdcf admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:07.878275 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99718d9f-a3d1-424e-988d-0c49d6fabdcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:07.878554 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99718d9f-a3d1-424e-988d-0c49d6fabdcf admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:07.879298 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99718d9f-a3d1-424e-988d-0c49d6fabdcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:41:07.880932 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99718d9f-a3d1-424e-988d-0c49d6fabdcf admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:41:07.891083 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1121/2249] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:41:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:41:07.895989 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed35b2c8-a31f-431d-a013-3f081370d8e7 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:41:07.907167 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed35b2c8-a31f-431d-a013-3f081370d8e7 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:41:07.912126 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5123a5be-f636-4f36-a3b2-d4ad8ce13850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:41:07.913025 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5123a5be-f636-4f36-a3b2-d4ad8ce13850 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:07.913298 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5123a5be-f636-4f36-a3b2-d4ad8ce13850 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:07.913568 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5123a5be-f636-4f36-a3b2-d4ad8ce13850 admin admin] PATH_INFO: `/v3/projects/badc5d74fa94487c8b35ce1d74124a6b/users/ce4873601eb74e13ada870fe15b59146/roles/1928787bfcc745419829cd315900ac44` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:07.928049 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5123a5be-f636-4f36-a3b2-d4ad8ce13850 admin admin] RBAC: Authorizing `identity:create_grant(project_id=badc5d74fa94487c8b35ce1d74124a6b, user_id=ce4873601eb74e13ada870fe15b59146, role_id=1928787bfcc745419829cd315900ac44)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:41:07.930934 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5123a5be-f636-4f36-a3b2-d4ad8ce13850 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:41:07.946199 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1129/2250] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 22:41:07 2022] PUT /identity/v3/projects/badc5d74fa94487c8b35ce1d74124a6b/users/ce4873601eb74e13ada870fe15b59146/roles/1928787bfcc745419829cd315900ac44 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:41:07.956773 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea1ac2d-87ed-47b3-b95b-bdc12f248a43 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:07.957344 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea1ac2d-87ed-47b3-b95b-bdc12f248a43 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:07.957344 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea1ac2d-87ed-47b3-b95b-bdc12f248a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:07.986712 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-1ea1ac2d-87ed-47b3-b95b-bdc12f248a43 None None] MFA Rules not processed for user `ce4873601eb74e13ada870fe15b59146`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:41:07.988073 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-1ea1ac2d-87ed-47b3-b95b-bdc12f248a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:41:08.055995 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1122/2251] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:41:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:41:08.060710 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5123a5be-f636-4f36-a3b2-d4ad8ce13850 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:41:08.071192 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:DELETE=5,keystone:SELECT=90,keystone:INSERT=5 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:41:08.129247 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5123a5be-f636-4f36-a3b2-d4ad8ce13850 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:41:08.135171 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d46420-6602-4643-9821-38276fdf05eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:41:08.135874 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d46420-6602-4643-9821-38276fdf05eb admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:08.136162 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d46420-6602-4643-9821-38276fdf05eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:08.136731 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d46420-6602-4643-9821-38276fdf05eb admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:08.137171 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d46420-6602-4643-9821-38276fdf05eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:41:08.139106 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d46420-6602-4643-9821-38276fdf05eb admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:41:08.169323 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1130/2252] 10.222.0.36 () {60 vars in 1152 bytes} [Fri Jun 24 22:41:08 2022] POST /identity/v3/projects => generated 385 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:41:08.173733 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea1ac2d-87ed-47b3-b95b-bdc12f248a43 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:41:08.185880 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea1ac2d-87ed-47b3-b95b-bdc12f248a43 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:41:08.191171 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:41:08.248438 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ee536b-5645-4d27-a93c-b6ad157a4378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:41:08.249132 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ee536b-5645-4d27-a93c-b6ad157a4378 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:08.249415 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ee536b-5645-4d27-a93c-b6ad157a4378 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:08.249694 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ee536b-5645-4d27-a93c-b6ad157a4378 admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:08.250749 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ee536b-5645-4d27-a93c-b6ad157a4378 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:41:08.252748 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ee536b-5645-4d27-a93c-b6ad157a4378 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:41:08.280446 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1123/2253] 10.222.0.36 () {60 vars in 1143 bytes} [Fri Jun 24 22:41:08 2022] POST /identity/v3/users => generated 299 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:41:08.284561 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d46420-6602-4643-9821-38276fdf05eb admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:41:08.295276 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d46420-6602-4643-9821-38276fdf05eb admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:41:08.300997 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ced61e-9d34-4c97-b575-65b215329511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:41:08.301827 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ced61e-9d34-4c97-b575-65b215329511 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:08.302155 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ced61e-9d34-4c97-b575-65b215329511 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:08.302525 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ced61e-9d34-4c97-b575-65b215329511 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:08.303524 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ced61e-9d34-4c97-b575-65b215329511 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:41:08.305540 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ced61e-9d34-4c97-b575-65b215329511 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:41:08.317030 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1131/2254] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:41:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:41:08.321957 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ee536b-5645-4d27-a93c-b6ad157a4378 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:41:08.332643 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ee536b-5645-4d27-a93c-b6ad157a4378 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:41:08.338394 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2330afe-3792-4784-a41a-0e0d91b34452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:41:08.339286 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2330afe-3792-4784-a41a-0e0d91b34452 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:08.339588 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2330afe-3792-4784-a41a-0e0d91b34452 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:08.339859 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2330afe-3792-4784-a41a-0e0d91b34452 admin admin] PATH_INFO: `/v3/projects/1fe3108341cd460c8bb5a0bc02fce1c3/users/786ed09703af43c2a580efbded328273/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:08.355265 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2330afe-3792-4784-a41a-0e0d91b34452 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fe3108341cd460c8bb5a0bc02fce1c3, user_id=786ed09703af43c2a580efbded328273, role_id=1a1c43cc97a0407eb7a7c7a1333a9d4a)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:41:08.358077 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2330afe-3792-4784-a41a-0e0d91b34452 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:41:08.374445 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1124/2255] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 22:41:08 2022] PUT /identity/v3/projects/1fe3108341cd460c8bb5a0bc02fce1c3/users/786ed09703af43c2a580efbded328273/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 22:41:08.378927 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ced61e-9d34-4c97-b575-65b215329511 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:41:08.389710 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ced61e-9d34-4c97-b575-65b215329511 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:41:08.454957 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d427f98b-6fca-45a0-a4af-11a1e0d94cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:41:08.456075 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d427f98b-6fca-45a0-a4af-11a1e0d94cb9 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:08.456453 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d427f98b-6fca-45a0-a4af-11a1e0d94cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:08.456924 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d427f98b-6fca-45a0-a4af-11a1e0d94cb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:08.458780 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d427f98b-6fca-45a0-a4af-11a1e0d94cb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:41:08.462816 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d427f98b-6fca-45a0-a4af-11a1e0d94cb9 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:41:08.478412 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1132/2256] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:41:08 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:41:08.483132 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2330afe-3792-4784-a41a-0e0d91b34452 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:41:08.493731 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2330afe-3792-4784-a41a-0e0d91b34452 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:41:08.498364 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3884813a-97fa-4327-b611-086ca2087622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:41:08.499274 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3884813a-97fa-4327-b611-086ca2087622 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:08.499572 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3884813a-97fa-4327-b611-086ca2087622 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:08.499848 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3884813a-97fa-4327-b611-086ca2087622 admin admin] PATH_INFO: `/v3/projects/1fe3108341cd460c8bb5a0bc02fce1c3/users/786ed09703af43c2a580efbded328273/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:08.502167 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3884813a-97fa-4327-b611-086ca2087622 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fe3108341cd460c8bb5a0bc02fce1c3, user_id=786ed09703af43c2a580efbded328273, role_id=1a1c43cc97a0407eb7a7c7a1333a9d4a)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:41:08.504910 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3884813a-97fa-4327-b611-086ca2087622 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:41:08.515169 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1125/2257] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 22:41:08 2022] PUT /identity/v3/projects/1fe3108341cd460c8bb5a0bc02fce1c3/users/786ed09703af43c2a580efbded328273/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:41:08.527520 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad857cbd-1026-4a81-bb8e-e04cc89aac2a None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:08.527851 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad857cbd-1026-4a81-bb8e-e04cc89aac2a None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:08.528252 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad857cbd-1026-4a81-bb8e-e04cc89aac2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:08.561338 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-ad857cbd-1026-4a81-bb8e-e04cc89aac2a None None] MFA Rules not processed for user `786ed09703af43c2a580efbded328273`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:41:08.562573 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-ad857cbd-1026-4a81-bb8e-e04cc89aac2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:41:08.638982 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1133/2258] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:41:08 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:41:08.650649 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3884813a-97fa-4327-b611-086ca2087622 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:41:08.652773 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-3884813a-97fa-4327-b611-086ca2087622 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:41:08.715410 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3884813a-97fa-4327-b611-086ca2087622 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:41:08.719543 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69732f6-bf8f-422d-9ada-e89e9cda644e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a747e2a5684843a6ee9e3480badac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:41:08.720194 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69732f6-bf8f-422d-9ada-e89e9cda644e service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:08.720475 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69732f6-bf8f-422d-9ada-e89e9cda644e service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:08.720748 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69732f6-bf8f-422d-9ada-e89e9cda644e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:08.790212 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69732f6-bf8f-422d-9ada-e89e9cda644e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:41:08.791619 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69732f6-bf8f-422d-9ada-e89e9cda644e service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:41:08.801046 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1126/2259] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:41:08 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:41:10.327364 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad857cbd-1026-4a81-bb8e-e04cc89aac2a None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:41:10.328794 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-ad857cbd-1026-4a81-bb8e-e04cc89aac2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:41:10.337483 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:41:10.341382 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad857cbd-1026-4a81-bb8e-e04cc89aac2a None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:41:10.346304 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9867d7-0052-4a2a-b887-bd91ba5a5ab9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a747e2a5684843a6ee9e3480badac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:41:10.347156 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9867d7-0052-4a2a-b887-bd91ba5a5ab9 service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:10.347524 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9867d7-0052-4a2a-b887-bd91ba5a5ab9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:10.347937 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9867d7-0052-4a2a-b887-bd91ba5a5ab9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:10.413694 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9867d7-0052-4a2a-b887-bd91ba5a5ab9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:41:10.415104 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9867d7-0052-4a2a-b887-bd91ba5a5ab9 service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:41:10.426667 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1134/2260] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:41:10 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:41:10.535304 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69732f6-bf8f-422d-9ada-e89e9cda644e service cinder] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:41:10.536944 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-e69732f6-bf8f-422d-9ada-e89e9cda644e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:41:10.558470 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:41:10.610655 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69732f6-bf8f-422d-9ada-e89e9cda644e service cinder] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:41:10.615125 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdb9bc1-31df-41d0-a493-0e263373721e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:41:10.616043 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdb9bc1-31df-41d0-a493-0e263373721e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:10.616337 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdb9bc1-31df-41d0-a493-0e263373721e admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:10.616615 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdb9bc1-31df-41d0-a493-0e263373721e admin admin] PATH_INFO: `/v3/users/0bb2b4bf46914155b05d4a7b9e57562b` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:10.617819 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdb9bc1-31df-41d0-a493-0e263373721e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bb2b4bf46914155b05d4a7b9e57562b)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:41:10.620413 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdb9bc1-31df-41d0-a493-0e263373721e admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:41:10.673872 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-2bdb9bc1-31df-41d0-a493-0e263373721e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bb2b4bf46914155b05d4a7b9e57562b'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:10.682333 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-2bdb9bc1-31df-41d0-a493-0e263373721e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bb2b4bf46914155b05d4a7b9e57562b'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:10.683180 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-2bdb9bc1-31df-41d0-a493-0e263373721e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bb2b4bf46914155b05d4a7b9e57562b'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:10.683903 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-2bdb9bc1-31df-41d0-a493-0e263373721e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bb2b4bf46914155b05d4a7b9e57562b'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:10.698538 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-2bdb9bc1-31df-41d0-a493-0e263373721e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bb2b4bf46914155b05d4a7b9e57562b'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:10.715839 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1127/2261] 10.222.0.36 () {58 vars in 1223 bytes} [Fri Jun 24 22:41:10 2022] DELETE /identity/v3/users/0bb2b4bf46914155b05d4a7b9e57562b => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:41:10.720541 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32f6144-4452-432e-8dfe-a7db65eff2a6 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:10.721127 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32f6144-4452-432e-8dfe-a7db65eff2a6 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:10.721409 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32f6144-4452-432e-8dfe-a7db65eff2a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:10.739783 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-d32f6144-4452-432e-8dfe-a7db65eff2a6 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:41:10.740991 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-d32f6144-4452-432e-8dfe-a7db65eff2a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:41:10.814753 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1135/2262] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:41:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:41:10.820476 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdb9bc1-31df-41d0-a493-0e263373721e admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:41:10.822495 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-2bdb9bc1-31df-41d0-a493-0e263373721e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:41:10.891421 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdb9bc1-31df-41d0-a493-0e263373721e admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:41:10.894954 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35eebeb-f99b-4236-8e3c-40fe549e1529 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:41:10.895615 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35eebeb-f99b-4236-8e3c-40fe549e1529 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:10.895893 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35eebeb-f99b-4236-8e3c-40fe549e1529 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:10.896165 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35eebeb-f99b-4236-8e3c-40fe549e1529 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:10.905874 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35eebeb-f99b-4236-8e3c-40fe549e1529 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:41:10.907398 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35eebeb-f99b-4236-8e3c-40fe549e1529 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:41:10.919320 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1128/2263] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:41:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:41:11.018269 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32f6144-4452-432e-8dfe-a7db65eff2a6 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:41:11.019865 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-d32f6144-4452-432e-8dfe-a7db65eff2a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:41:11.092058 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32f6144-4452-432e-8dfe-a7db65eff2a6 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:41:11.095797 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2d31c7-67ff-4969-b3e2-f6d58d6161cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a747e2a5684843a6ee9e3480badac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:41:11.096519 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2d31c7-67ff-4969-b3e2-f6d58d6161cd service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:11.096874 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2d31c7-67ff-4969-b3e2-f6d58d6161cd service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:11.097218 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2d31c7-67ff-4969-b3e2-f6d58d6161cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:11.099109 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-4b2d31c7-67ff-4969-b3e2-f6d58d6161cd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:41:11.165020 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:41:11.168955 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2d31c7-67ff-4969-b3e2-f6d58d6161cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:41:11.170511 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2d31c7-67ff-4969-b3e2-f6d58d6161cd service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:41:11.181484 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1136/2264] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:41:11 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:41:11.291697 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35eebeb-f99b-4236-8e3c-40fe549e1529 service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:41:11.293308 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-e35eebeb-f99b-4236-8e3c-40fe549e1529 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:41:11.308355 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35eebeb-f99b-4236-8e3c-40fe549e1529 service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:41:11.313437 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90614354-44e5-4791-b08c-02bc1a995769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:41:11.314383 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90614354-44e5-4791-b08c-02bc1a995769 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:11.314746 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90614354-44e5-4791-b08c-02bc1a995769 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:11.315023 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90614354-44e5-4791-b08c-02bc1a995769 admin admin] PATH_INFO: `/v3/projects/0e47629ef85949bd9fc74ecf9fd80b2b` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:11.323936 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90614354-44e5-4791-b08c-02bc1a995769 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e47629ef85949bd9fc74ecf9fd80b2b)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:41:11.325995 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90614354-44e5-4791-b08c-02bc1a995769 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:41:11.367271 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:41:11.381396 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-90614354-44e5-4791-b08c-02bc1a995769 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e47629ef85949bd9fc74ecf9fd80b2b', 'request_id': 'req-90614354-44e5-4791-b08c-02bc1a995769'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:11.388070 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-90614354-44e5-4791-b08c-02bc1a995769 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e47629ef85949bd9fc74ecf9fd80b2b', 'request_id': 'req-90614354-44e5-4791-b08c-02bc1a995769'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:11.396806 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-90614354-44e5-4791-b08c-02bc1a995769 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e47629ef85949bd9fc74ecf9fd80b2b', 'request_id': 'req-90614354-44e5-4791-b08c-02bc1a995769'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:11.406916 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-90614354-44e5-4791-b08c-02bc1a995769 admin admin] The token cache is being invalidate because project 0e47629ef85949bd9fc74ecf9fd80b2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 22:41:11.407200 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-90614354-44e5-4791-b08c-02bc1a995769 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:11.407827 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-90614354-44e5-4791-b08c-02bc1a995769 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:11.409362 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1129/2265] 10.222.0.36 () {58 vars in 1232 bytes} [Fri Jun 24 22:41:11 2022] DELETE /identity/v3/projects/0e47629ef85949bd9fc74ecf9fd80b2b => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:41:11.413479 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2d31c7-67ff-4969-b3e2-f6d58d6161cd service cinder] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:41:11.424196 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2d31c7-67ff-4969-b3e2-f6d58d6161cd service cinder] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:41:11.487836 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b25433-1448-4496-a291-13e9ba00a129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:41:11.488740 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b25433-1448-4496-a291-13e9ba00a129 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:11.489023 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b25433-1448-4496-a291-13e9ba00a129 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:11.489299 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b25433-1448-4496-a291-13e9ba00a129 admin admin] PATH_INFO: `/v3/users/b768448b16084dc9a9e1ae916a4ffd26` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:11.490572 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b25433-1448-4496-a291-13e9ba00a129 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b768448b16084dc9a9e1ae916a4ffd26)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:41:11.492575 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b25433-1448-4496-a291-13e9ba00a129 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:41:11.541289 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-78b25433-1448-4496-a291-13e9ba00a129 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b768448b16084dc9a9e1ae916a4ffd26'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:11.548390 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-78b25433-1448-4496-a291-13e9ba00a129 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b768448b16084dc9a9e1ae916a4ffd26'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:11.549090 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-78b25433-1448-4496-a291-13e9ba00a129 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b768448b16084dc9a9e1ae916a4ffd26'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:11.549784 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-78b25433-1448-4496-a291-13e9ba00a129 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b768448b16084dc9a9e1ae916a4ffd26'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:11.563180 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-78b25433-1448-4496-a291-13e9ba00a129 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b768448b16084dc9a9e1ae916a4ffd26'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:11.582093 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1137/2266] 10.222.0.36 () {58 vars in 1223 bytes} [Fri Jun 24 22:41:11 2022] DELETE /identity/v3/users/b768448b16084dc9a9e1ae916a4ffd26 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 22:41:11.865402 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90614354-44e5-4791-b08c-02bc1a995769 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:41:11.866877 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-90614354-44e5-4791-b08c-02bc1a995769 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:41:11.881602 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90614354-44e5-4791-b08c-02bc1a995769 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:41:11.940887 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ac8fd6-b928-4a86-a530-eed8fb27bbba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:41:11.941749 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ac8fd6-b928-4a86-a530-eed8fb27bbba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:11.942032 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ac8fd6-b928-4a86-a530-eed8fb27bbba admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:11.942304 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ac8fd6-b928-4a86-a530-eed8fb27bbba admin admin] PATH_INFO: `/v3/projects/a4fa44f9a3a94c89bddd2352b4312251` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:11.943710 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ac8fd6-b928-4a86-a530-eed8fb27bbba admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4fa44f9a3a94c89bddd2352b4312251)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:41:11.945571 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ac8fd6-b928-4a86-a530-eed8fb27bbba admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:41:11.994757 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-13ac8fd6-b928-4a86-a530-eed8fb27bbba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4fa44f9a3a94c89bddd2352b4312251', 'request_id': 'req-13ac8fd6-b928-4a86-a530-eed8fb27bbba'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:12.002497 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-13ac8fd6-b928-4a86-a530-eed8fb27bbba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4fa44f9a3a94c89bddd2352b4312251', 'request_id': 'req-13ac8fd6-b928-4a86-a530-eed8fb27bbba'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:12.013466 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-13ac8fd6-b928-4a86-a530-eed8fb27bbba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4fa44f9a3a94c89bddd2352b4312251', 'request_id': 'req-13ac8fd6-b928-4a86-a530-eed8fb27bbba'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:12.032302 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-13ac8fd6-b928-4a86-a530-eed8fb27bbba admin admin] The token cache is being invalidate because project a4fa44f9a3a94c89bddd2352b4312251 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 22:41:12.032653 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-13ac8fd6-b928-4a86-a530-eed8fb27bbba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:12.033338 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-13ac8fd6-b928-4a86-a530-eed8fb27bbba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:12.035342 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1130/2267] 10.222.0.36 () {58 vars in 1232 bytes} [Fri Jun 24 22:41:11 2022] DELETE /identity/v3/projects/a4fa44f9a3a94c89bddd2352b4312251 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:41:12.042269 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb9d59-55fd-4d02-88b6-e711f28166a3 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:12.042559 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb9d59-55fd-4d02-88b6-e711f28166a3 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:12.042837 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb9d59-55fd-4d02-88b6-e711f28166a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:12.060762 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-b7eb9d59-55fd-4d02-88b6-e711f28166a3 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:41:12.061988 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-b7eb9d59-55fd-4d02-88b6-e711f28166a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:41:12.124476 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1138/2268] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:41:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:41:12.133798 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cc7036-91cc-4776-b8a3-d2974782c32d None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:12.134335 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cc7036-91cc-4776-b8a3-d2974782c32d None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:12.134508 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cc7036-91cc-4776-b8a3-d2974782c32d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:12.153621 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-c0cc7036-91cc-4776-b8a3-d2974782c32d None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:41:12.154840 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-c0cc7036-91cc-4776-b8a3-d2974782c32d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:41:12.164539 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1131/2269] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:41:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:41:12.171851 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eb9d59-55fd-4d02-88b6-e711f28166a3 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:41:12.185704 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eb9d59-55fd-4d02-88b6-e711f28166a3 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:41:12.190909 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76305298-b5e6-476f-a8a4-36f598219c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:41:12.191617 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76305298-b5e6-476f-a8a4-36f598219c95 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:12.191990 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76305298-b5e6-476f-a8a4-36f598219c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:12.192143 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76305298-b5e6-476f-a8a4-36f598219c95 admin admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:12.192894 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76305298-b5e6-476f-a8a4-36f598219c95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:41:12.193225 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76305298-b5e6-476f-a8a4-36f598219c95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:41:12.194918 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76305298-b5e6-476f-a8a4-36f598219c95 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:41:12.203882 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:41:12.207728 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1139/2270] 10.222.0.36 () {58 vars in 1152 bytes} [Fri Jun 24 22:41:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:41:12.213635 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cc7036-91cc-4776-b8a3-d2974782c32d None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:41:12.223382 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cc7036-91cc-4776-b8a3-d2974782c32d None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:41:12.228443 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd3e084-4e99-4c03-babb-086b3f8aeb69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:41:12.229102 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd3e084-4e99-4c03-babb-086b3f8aeb69 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:12.229379 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd3e084-4e99-4c03-babb-086b3f8aeb69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:12.229647 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd3e084-4e99-4c03-babb-086b3f8aeb69 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:12.230349 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd3e084-4e99-4c03-babb-086b3f8aeb69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:41:12.232322 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd3e084-4e99-4c03-babb-086b3f8aeb69 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:41:12.260897 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1132/2271] 10.222.0.36 () {60 vars in 1152 bytes} [Fri Jun 24 22:41:12 2022] POST /identity/v3/projects => generated 361 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 22:41:12.265287 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76305298-b5e6-476f-a8a4-36f598219c95 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:41:12.276737 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76305298-b5e6-476f-a8a4-36f598219c95 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:41:12.347555 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8b7344-e0e7-4fc5-9efb-51f1832f84a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:41:12.348485 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8b7344-e0e7-4fc5-9efb-51f1832f84a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:12.348626 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8b7344-e0e7-4fc5-9efb-51f1832f84a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:12.348897 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8b7344-e0e7-4fc5-9efb-51f1832f84a7 admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:12.349586 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8b7344-e0e7-4fc5-9efb-51f1832f84a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:41:12.352508 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8b7344-e0e7-4fc5-9efb-51f1832f84a7 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:41:12.387274 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1140/2272] 10.222.0.36 () {60 vars in 1143 bytes} [Fri Jun 24 22:41:12 2022] POST /identity/v3/users => generated 281 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:41:12.391370 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd3e084-4e99-4c03-babb-086b3f8aeb69 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:41:12.403665 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd3e084-4e99-4c03-babb-086b3f8aeb69 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:41:12.411687 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9634869-a2ae-4efd-8ac8-a8417f4d742e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:41:12.412408 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9634869-a2ae-4efd-8ac8-a8417f4d742e admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:12.412692 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9634869-a2ae-4efd-8ac8-a8417f4d742e admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:12.412967 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9634869-a2ae-4efd-8ac8-a8417f4d742e admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:12.413708 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9634869-a2ae-4efd-8ac8-a8417f4d742e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:41:12.415429 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9634869-a2ae-4efd-8ac8-a8417f4d742e admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:41:12.429822 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1133/2273] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:41:12 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:41:12.431192 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8b7344-e0e7-4fc5-9efb-51f1832f84a7 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:41:12.446144 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8b7344-e0e7-4fc5-9efb-51f1832f84a7 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:41:12.451344 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be41572-58d9-4dc8-8f2b-1eb547bf850b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:41:12.452478 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be41572-58d9-4dc8-8f2b-1eb547bf850b admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:12.452762 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be41572-58d9-4dc8-8f2b-1eb547bf850b admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:12.453036 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be41572-58d9-4dc8-8f2b-1eb547bf850b admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:12.453769 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be41572-58d9-4dc8-8f2b-1eb547bf850b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:41:12.455562 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be41572-58d9-4dc8-8f2b-1eb547bf850b admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:41:12.466572 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1141/2274] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:41:12 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:41:12.471163 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9634869-a2ae-4efd-8ac8-a8417f4d742e admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:41:12.481672 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9634869-a2ae-4efd-8ac8-a8417f4d742e admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:41:12.486521 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f703fb-5b93-4c00-939e-b460ab9db015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:41:12.487534 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f703fb-5b93-4c00-939e-b460ab9db015 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:12.487876 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f703fb-5b93-4c00-939e-b460ab9db015 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:12.488210 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f703fb-5b93-4c00-939e-b460ab9db015 admin admin] PATH_INFO: `/v3/projects/0c5d4da13772457d88e53c7c37f2987b/users/e8b5ca58c9a5435bb188c67eb593b191/roles/1928787bfcc745419829cd315900ac44` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:12.496891 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:41:12.505576 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f703fb-5b93-4c00-939e-b460ab9db015 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c5d4da13772457d88e53c7c37f2987b, user_id=e8b5ca58c9a5435bb188c67eb593b191, role_id=1928787bfcc745419829cd315900ac44)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:41:12.508984 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f703fb-5b93-4c00-939e-b460ab9db015 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:41:12.523843 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1134/2275] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 22:41:12 2022] PUT /identity/v3/projects/0c5d4da13772457d88e53c7c37f2987b/users/e8b5ca58c9a5435bb188c67eb593b191/roles/1928787bfcc745419829cd315900ac44 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:41:12.534267 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e25b95-1e40-4b96-a2a2-a5bd5371e22b None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:12.534631 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e25b95-1e40-4b96-a2a2-a5bd5371e22b None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:12.534979 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e25b95-1e40-4b96-a2a2-a5bd5371e22b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:12.564303 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-41e25b95-1e40-4b96-a2a2-a5bd5371e22b None None] MFA Rules not processed for user `e8b5ca58c9a5435bb188c67eb593b191`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:41:12.565517 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-41e25b95-1e40-4b96-a2a2-a5bd5371e22b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:41:12.648592 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1142/2276] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:41:12 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:41:12.661826 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f703fb-5b93-4c00-939e-b460ab9db015 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:41:12.663621 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-c1f703fb-5b93-4c00-939e-b460ab9db015 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:41:12.726835 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f703fb-5b93-4c00-939e-b460ab9db015 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:41:12.730787 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eed2c57-f2d1-4537-b3fd-1011e29f4cdc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a747e2a5684843a6ee9e3480badac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:41:12.731477 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eed2c57-f2d1-4537-b3fd-1011e29f4cdc service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:12.731765 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eed2c57-f2d1-4537-b3fd-1011e29f4cdc service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:12.732044 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eed2c57-f2d1-4537-b3fd-1011e29f4cdc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:12.741451 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eed2c57-f2d1-4537-b3fd-1011e29f4cdc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:41:12.742904 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eed2c57-f2d1-4537-b3fd-1011e29f4cdc service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:41:12.754304 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1135/2277] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:41:12 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:41:15.079940 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e25b95-1e40-4b96-a2a2-a5bd5371e22b None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:41:15.081604 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-41e25b95-1e40-4b96-a2a2-a5bd5371e22b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:41:15.163921 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e25b95-1e40-4b96-a2a2-a5bd5371e22b None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:41:15.169876 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24dd7c5-3caf-4ab4-bb87-2b69074ea779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:41:15.170571 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24dd7c5-3caf-4ab4-bb87-2b69074ea779 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:15.170851 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24dd7c5-3caf-4ab4-bb87-2b69074ea779 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:15.171122 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24dd7c5-3caf-4ab4-bb87-2b69074ea779 admin admin] PATH_INFO: `/v3/users/e4065e7325d944948b092165a641f8c3` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:15.172368 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24dd7c5-3caf-4ab4-bb87-2b69074ea779 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4065e7325d944948b092165a641f8c3)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:41:15.174818 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24dd7c5-3caf-4ab4-bb87-2b69074ea779 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:41:15.186925 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:41:15.238559 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-e24dd7c5-3caf-4ab4-bb87-2b69074ea779 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4065e7325d944948b092165a641f8c3'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:15.246550 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-e24dd7c5-3caf-4ab4-bb87-2b69074ea779 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4065e7325d944948b092165a641f8c3'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:15.247451 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-e24dd7c5-3caf-4ab4-bb87-2b69074ea779 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4065e7325d944948b092165a641f8c3'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:15.248141 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-e24dd7c5-3caf-4ab4-bb87-2b69074ea779 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4065e7325d944948b092165a641f8c3'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:15.262465 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-e24dd7c5-3caf-4ab4-bb87-2b69074ea779 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4065e7325d944948b092165a641f8c3'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:15.278433 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1143/2278] 10.222.0.36 () {58 vars in 1223 bytes} [Fri Jun 24 22:41:15 2022] DELETE /identity/v3/users/e4065e7325d944948b092165a641f8c3 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:41:15.282878 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9db15a9-fa4f-4f68-b528-703a868a75b7 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:15.283448 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9db15a9-fa4f-4f68-b528-703a868a75b7 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:15.283448 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9db15a9-fa4f-4f68-b528-703a868a75b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:15.301032 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-a9db15a9-fa4f-4f68-b528-703a868a75b7 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:41:15.302316 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-a9db15a9-fa4f-4f68-b528-703a868a75b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:41:15.373893 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1136/2279] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:41:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:41:15.384685 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24dd7c5-3caf-4ab4-bb87-2b69074ea779 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:41:15.386526 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-e24dd7c5-3caf-4ab4-bb87-2b69074ea779 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:41:15.451690 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24dd7c5-3caf-4ab4-bb87-2b69074ea779 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:41:15.456211 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b5918f-0967-4df5-94a5-852972785170 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:41:15.456930 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b5918f-0967-4df5-94a5-852972785170 service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:15.457276 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b5918f-0967-4df5-94a5-852972785170 service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:15.457683 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b5918f-0967-4df5-94a5-852972785170 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:15.468210 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b5918f-0967-4df5-94a5-852972785170 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:41:15.469782 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b5918f-0967-4df5-94a5-852972785170 service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:41:15.480284 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1144/2280] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:41:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:41:15.773095 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9db15a9-fa4f-4f68-b528-703a868a75b7 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:41:15.774934 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-a9db15a9-fa4f-4f68-b528-703a868a75b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:41:15.791901 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9db15a9-fa4f-4f68-b528-703a868a75b7 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:41:15.796562 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f621ba2e-860c-4465-89fb-367f72b007e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:41:15.797438 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f621ba2e-860c-4465-89fb-367f72b007e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:15.797713 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f621ba2e-860c-4465-89fb-367f72b007e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:15.797984 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f621ba2e-860c-4465-89fb-367f72b007e1 admin admin] PATH_INFO: `/v3/projects/2540c43fde07450db78aacff973ea9c1` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:15.799194 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f621ba2e-860c-4465-89fb-367f72b007e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2540c43fde07450db78aacff973ea9c1)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:41:15.801147 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f621ba2e-860c-4465-89fb-367f72b007e1 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:41:15.860345 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-f621ba2e-860c-4465-89fb-367f72b007e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2540c43fde07450db78aacff973ea9c1', 'request_id': 'req-f621ba2e-860c-4465-89fb-367f72b007e1'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:15.866930 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-f621ba2e-860c-4465-89fb-367f72b007e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2540c43fde07450db78aacff973ea9c1', 'request_id': 'req-f621ba2e-860c-4465-89fb-367f72b007e1'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:15.876715 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-f621ba2e-860c-4465-89fb-367f72b007e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2540c43fde07450db78aacff973ea9c1', 'request_id': 'req-f621ba2e-860c-4465-89fb-367f72b007e1'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:15.889578 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-f621ba2e-860c-4465-89fb-367f72b007e1 admin admin] The token cache is being invalidate because project 2540c43fde07450db78aacff973ea9c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 22:41:15.890360 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-f621ba2e-860c-4465-89fb-367f72b007e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:15.891115 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-f621ba2e-860c-4465-89fb-367f72b007e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:15.895710 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1137/2281] 10.222.0.36 () {58 vars in 1232 bytes} [Fri Jun 24 22:41:15 2022] DELETE /identity/v3/projects/2540c43fde07450db78aacff973ea9c1 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:41:15.897050 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b5918f-0967-4df5-94a5-852972785170 service neutron] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:41:15.908964 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b5918f-0967-4df5-94a5-852972785170 service neutron] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:41:15.969492 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b82994f-bbb4-46ce-a840-200ef78b0f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:41:15.970388 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b82994f-bbb4-46ce-a840-200ef78b0f6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:15.970672 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b82994f-bbb4-46ce-a840-200ef78b0f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:15.970951 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b82994f-bbb4-46ce-a840-200ef78b0f6b admin admin] PATH_INFO: `/v3/users/ce4873601eb74e13ada870fe15b59146` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:15.972277 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b82994f-bbb4-46ce-a840-200ef78b0f6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce4873601eb74e13ada870fe15b59146)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:41:15.974208 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b82994f-bbb4-46ce-a840-200ef78b0f6b admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:41:16.008494 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:41:16.023591 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-0b82994f-bbb4-46ce-a840-200ef78b0f6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce4873601eb74e13ada870fe15b59146'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:16.033623 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-0b82994f-bbb4-46ce-a840-200ef78b0f6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce4873601eb74e13ada870fe15b59146'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:16.033623 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-0b82994f-bbb4-46ce-a840-200ef78b0f6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce4873601eb74e13ada870fe15b59146'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:16.034721 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-0b82994f-bbb4-46ce-a840-200ef78b0f6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce4873601eb74e13ada870fe15b59146'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:16.045754 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-0b82994f-bbb4-46ce-a840-200ef78b0f6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce4873601eb74e13ada870fe15b59146'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:16.059736 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1145/2282] 10.222.0.36 () {58 vars in 1223 bytes} [Fri Jun 24 22:41:15 2022] DELETE /identity/v3/users/ce4873601eb74e13ada870fe15b59146 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:41:16.342955 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f621ba2e-860c-4465-89fb-367f72b007e1 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:41:16.344547 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-f621ba2e-860c-4465-89fb-367f72b007e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:41:16.358974 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f621ba2e-860c-4465-89fb-367f72b007e1 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:41:16.369357 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:41:16.420726 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae4c65f-fa2c-4f9f-ba4e-7c68b2167bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:41:16.421593 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae4c65f-fa2c-4f9f-ba4e-7c68b2167bed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:16.421876 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae4c65f-fa2c-4f9f-ba4e-7c68b2167bed admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:16.422146 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae4c65f-fa2c-4f9f-ba4e-7c68b2167bed admin admin] PATH_INFO: `/v3/projects/badc5d74fa94487c8b35ce1d74124a6b` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:16.423365 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae4c65f-fa2c-4f9f-ba4e-7c68b2167bed admin admin] RBAC: Authorizing `identity:delete_project(project_id=badc5d74fa94487c8b35ce1d74124a6b)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:41:16.425285 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae4c65f-fa2c-4f9f-ba4e-7c68b2167bed admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:41:16.483968 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-5ae4c65f-fa2c-4f9f-ba4e-7c68b2167bed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'badc5d74fa94487c8b35ce1d74124a6b', 'request_id': 'req-5ae4c65f-fa2c-4f9f-ba4e-7c68b2167bed'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:16.490341 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-5ae4c65f-fa2c-4f9f-ba4e-7c68b2167bed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'badc5d74fa94487c8b35ce1d74124a6b', 'request_id': 'req-5ae4c65f-fa2c-4f9f-ba4e-7c68b2167bed'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:16.501020 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-5ae4c65f-fa2c-4f9f-ba4e-7c68b2167bed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'badc5d74fa94487c8b35ce1d74124a6b', 'request_id': 'req-5ae4c65f-fa2c-4f9f-ba4e-7c68b2167bed'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:16.514513 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-5ae4c65f-fa2c-4f9f-ba4e-7c68b2167bed admin admin] The token cache is being invalidate because project badc5d74fa94487c8b35ce1d74124a6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 22:41:16.514796 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-5ae4c65f-fa2c-4f9f-ba4e-7c68b2167bed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:16.515591 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-5ae4c65f-fa2c-4f9f-ba4e-7c68b2167bed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:16.517311 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1138/2283] 10.222.0.36 () {58 vars in 1232 bytes} [Fri Jun 24 22:41:16 2022] DELETE /identity/v3/projects/badc5d74fa94487c8b35ce1d74124a6b => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:41:16.521445 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b82994f-bbb4-46ce-a840-200ef78b0f6b admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:41:16.523036 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-0b82994f-bbb4-46ce-a840-200ef78b0f6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:41:16.535957 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b82994f-bbb4-46ce-a840-200ef78b0f6b admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:41:16.594553 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbd2e62-19ea-41df-bea8-186dad50c8d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:41:16.595437 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbd2e62-19ea-41df-bea8-186dad50c8d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:16.595699 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbd2e62-19ea-41df-bea8-186dad50c8d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:16.596055 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbd2e62-19ea-41df-bea8-186dad50c8d2 admin admin] PATH_INFO: `/v3/users/786ed09703af43c2a580efbded328273` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:16.597894 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbd2e62-19ea-41df-bea8-186dad50c8d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=786ed09703af43c2a580efbded328273)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:41:16.599901 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbd2e62-19ea-41df-bea8-186dad50c8d2 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:41:16.651221 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-afbd2e62-19ea-41df-bea8-186dad50c8d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '786ed09703af43c2a580efbded328273'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:16.658280 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-afbd2e62-19ea-41df-bea8-186dad50c8d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '786ed09703af43c2a580efbded328273'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:16.658958 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-afbd2e62-19ea-41df-bea8-186dad50c8d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '786ed09703af43c2a580efbded328273'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:16.659555 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-afbd2e62-19ea-41df-bea8-186dad50c8d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '786ed09703af43c2a580efbded328273'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:16.672360 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-afbd2e62-19ea-41df-bea8-186dad50c8d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '786ed09703af43c2a580efbded328273'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:16.687653 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1146/2284] 10.222.0.36 () {58 vars in 1223 bytes} [Fri Jun 24 22:41:16 2022] DELETE /identity/v3/users/786ed09703af43c2a580efbded328273 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:41:16.972606 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae4c65f-fa2c-4f9f-ba4e-7c68b2167bed admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:41:16.974312 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-5ae4c65f-fa2c-4f9f-ba4e-7c68b2167bed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:41:16.990680 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae4c65f-fa2c-4f9f-ba4e-7c68b2167bed admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:41:17.062748 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942f78f9-7387-4034-802c-a1197cdb76e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:41:17.063540 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942f78f9-7387-4034-802c-a1197cdb76e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:17.063826 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942f78f9-7387-4034-802c-a1197cdb76e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:17.064102 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942f78f9-7387-4034-802c-a1197cdb76e7 admin admin] PATH_INFO: `/v3/projects/1fe3108341cd460c8bb5a0bc02fce1c3` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:17.065299 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942f78f9-7387-4034-802c-a1197cdb76e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fe3108341cd460c8bb5a0bc02fce1c3)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:41:17.067230 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942f78f9-7387-4034-802c-a1197cdb76e7 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:41:17.113139 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:41:17.116572 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-942f78f9-7387-4034-802c-a1197cdb76e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fe3108341cd460c8bb5a0bc02fce1c3', 'request_id': 'req-942f78f9-7387-4034-802c-a1197cdb76e7'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:17.126253 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-942f78f9-7387-4034-802c-a1197cdb76e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fe3108341cd460c8bb5a0bc02fce1c3', 'request_id': 'req-942f78f9-7387-4034-802c-a1197cdb76e7'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:17.136512 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-942f78f9-7387-4034-802c-a1197cdb76e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fe3108341cd460c8bb5a0bc02fce1c3', 'request_id': 'req-942f78f9-7387-4034-802c-a1197cdb76e7'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:17.161705 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-942f78f9-7387-4034-802c-a1197cdb76e7 admin admin] The token cache is being invalidate because project 1fe3108341cd460c8bb5a0bc02fce1c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 22:41:17.162000 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-942f78f9-7387-4034-802c-a1197cdb76e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:17.162675 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-942f78f9-7387-4034-802c-a1197cdb76e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:17.164281 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1139/2285] 10.222.0.36 () {58 vars in 1232 bytes} [Fri Jun 24 22:41:16 2022] DELETE /identity/v3/projects/1fe3108341cd460c8bb5a0bc02fce1c3 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:41:17.169418 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d18730-a057-48e5-80d7-4377beee4f35 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:17.169711 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d18730-a057-48e5-80d7-4377beee4f35 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:17.169986 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d18730-a057-48e5-80d7-4377beee4f35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:17.207204 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:41:17.227032 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-d8d18730-a057-48e5-80d7-4377beee4f35 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:41:17.228329 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-d8d18730-a057-48e5-80d7-4377beee4f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:41:17.331884 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1147/2286] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:41:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:41:17.344092 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3955127-6435-4d49-9531-9bfc2f484b71 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:17.344609 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3955127-6435-4d49-9531-9bfc2f484b71 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:17.344721 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3955127-6435-4d49-9531-9bfc2f484b71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:17.366454 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-c3955127-6435-4d49-9531-9bfc2f484b71 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:41:17.367708 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-c3955127-6435-4d49-9531-9bfc2f484b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:41:17.377131 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1140/2287] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:41:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:41:17.382022 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d18730-a057-48e5-80d7-4377beee4f35 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:41:17.397789 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d18730-a057-48e5-80d7-4377beee4f35 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:41:17.404446 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355cc943-a48e-451f-a4ce-b9559f992c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:41:17.405102 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355cc943-a48e-451f-a4ce-b9559f992c83 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:17.405384 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355cc943-a48e-451f-a4ce-b9559f992c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:17.405652 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355cc943-a48e-451f-a4ce-b9559f992c83 admin admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:17.406390 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355cc943-a48e-451f-a4ce-b9559f992c83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:41:17.406719 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355cc943-a48e-451f-a4ce-b9559f992c83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:41:17.408379 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355cc943-a48e-451f-a4ce-b9559f992c83 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:41:17.420837 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1148/2288] 10.222.0.36 () {58 vars in 1152 bytes} [Fri Jun 24 22:41:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:41:17.425243 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3955127-6435-4d49-9531-9bfc2f484b71 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:41:17.435164 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3955127-6435-4d49-9531-9bfc2f484b71 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:41:17.441076 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ac0d9e-5191-4fca-9783-39b058d740b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:41:17.441769 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ac0d9e-5191-4fca-9783-39b058d740b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:17.442049 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ac0d9e-5191-4fca-9783-39b058d740b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:17.442326 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ac0d9e-5191-4fca-9783-39b058d740b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:17.443031 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ac0d9e-5191-4fca-9783-39b058d740b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:41:17.445012 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ac0d9e-5191-4fca-9783-39b058d740b7 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:41:17.474514 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1141/2289] 10.222.0.36 () {60 vars in 1152 bytes} [Fri Jun 24 22:41:17 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:41:17.478894 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355cc943-a48e-451f-a4ce-b9559f992c83 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:41:17.488893 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355cc943-a48e-451f-a4ce-b9559f992c83 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:41:17.546177 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82202fb4-bd86-467a-abbe-f25b1c7b4726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:41:17.546979 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82202fb4-bd86-467a-abbe-f25b1c7b4726 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:17.547425 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82202fb4-bd86-467a-abbe-f25b1c7b4726 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:17.547784 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82202fb4-bd86-467a-abbe-f25b1c7b4726 admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:17.548863 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82202fb4-bd86-467a-abbe-f25b1c7b4726 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:41:17.551978 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82202fb4-bd86-467a-abbe-f25b1c7b4726 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:41:17.576872 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1149/2290] 10.222.0.36 () {60 vars in 1143 bytes} [Fri Jun 24 22:41:17 2022] POST /identity/v3/users => generated 287 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:41:17.582391 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ac0d9e-5191-4fca-9783-39b058d740b7 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:41:17.593354 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ac0d9e-5191-4fca-9783-39b058d740b7 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:41:17.598239 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e6ef94-dd34-4fab-a344-dc26c554673c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:41:17.598937 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e6ef94-dd34-4fab-a344-dc26c554673c admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:17.599213 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e6ef94-dd34-4fab-a344-dc26c554673c admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:17.599685 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e6ef94-dd34-4fab-a344-dc26c554673c admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:17.600508 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e6ef94-dd34-4fab-a344-dc26c554673c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:41:17.602079 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e6ef94-dd34-4fab-a344-dc26c554673c admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:41:17.612078 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1142/2291] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:41:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:41:17.616168 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82202fb4-bd86-467a-abbe-f25b1c7b4726 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:41:17.628634 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82202fb4-bd86-467a-abbe-f25b1c7b4726 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:41:17.636260 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20fde8a-1a0c-48d8-aa9a-b1e129a2ab6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:41:17.637310 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20fde8a-1a0c-48d8-aa9a-b1e129a2ab6a admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:17.637652 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20fde8a-1a0c-48d8-aa9a-b1e129a2ab6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:17.638155 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20fde8a-1a0c-48d8-aa9a-b1e129a2ab6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:17.639320 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20fde8a-1a0c-48d8-aa9a-b1e129a2ab6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:41:17.641825 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20fde8a-1a0c-48d8-aa9a-b1e129a2ab6a admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:41:17.655662 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1150/2292] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:41:17 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:41:17.659800 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e6ef94-dd34-4fab-a344-dc26c554673c admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:41:17.670515 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e6ef94-dd34-4fab-a344-dc26c554673c admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:41:17.675902 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcf4aa2-c6ff-49fb-9f47-087b03836982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:41:17.676809 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcf4aa2-c6ff-49fb-9f47-087b03836982 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:17.677098 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcf4aa2-c6ff-49fb-9f47-087b03836982 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:17.677377 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcf4aa2-c6ff-49fb-9f47-087b03836982 admin admin] PATH_INFO: `/v3/projects/57da4de8134348f8958c3d49e764e3b8/users/05e58da940ea43c494073fa77fb5c530/roles/1928787bfcc745419829cd315900ac44` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:17.692395 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcf4aa2-c6ff-49fb-9f47-087b03836982 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57da4de8134348f8958c3d49e764e3b8, user_id=05e58da940ea43c494073fa77fb5c530, role_id=1928787bfcc745419829cd315900ac44)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:41:17.695076 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcf4aa2-c6ff-49fb-9f47-087b03836982 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:41:17.711202 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1143/2293] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 22:41:17 2022] PUT /identity/v3/projects/57da4de8134348f8958c3d49e764e3b8/users/05e58da940ea43c494073fa77fb5c530/roles/1928787bfcc745419829cd315900ac44 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:41:17.721974 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b64be0f-e1c8-44b1-b65d-28efc1c583f2 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:17.722269 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b64be0f-e1c8-44b1-b65d-28efc1c583f2 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:17.722545 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b64be0f-e1c8-44b1-b65d-28efc1c583f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:17.751142 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-4b64be0f-e1c8-44b1-b65d-28efc1c583f2 None None] MFA Rules not processed for user `05e58da940ea43c494073fa77fb5c530`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:41:17.752386 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-4b64be0f-e1c8-44b1-b65d-28efc1c583f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:41:17.761747 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:41:17.820142 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1151/2294] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:41:17 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:41:17.830901 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcf4aa2-c6ff-49fb-9f47-087b03836982 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:41:17.833042 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-2bcf4aa2-c6ff-49fb-9f47-087b03836982 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:41:17.908971 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcf4aa2-c6ff-49fb-9f47-087b03836982 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:41:17.912941 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee5d45e-6403-43f2-b360-c634e1e00bc4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a747e2a5684843a6ee9e3480badac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:41:17.913595 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee5d45e-6403-43f2-b360-c634e1e00bc4 service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:17.913873 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee5d45e-6403-43f2-b360-c634e1e00bc4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:17.914145 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee5d45e-6403-43f2-b360-c634e1e00bc4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:17.923221 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee5d45e-6403-43f2-b360-c634e1e00bc4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:41:17.924779 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee5d45e-6403-43f2-b360-c634e1e00bc4 service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:41:17.938070 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1144/2295] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:41:17 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:41:19.304577 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9221542-891f-4c38-a5cf-66a29c14d7c7 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:19.305101 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9221542-891f-4c38-a5cf-66a29c14d7c7 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:19.305101 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9221542-891f-4c38-a5cf-66a29c14d7c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:19.324163 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-a9221542-891f-4c38-a5cf-66a29c14d7c7 None None] MFA Rules not processed for user `05e58da940ea43c494073fa77fb5c530`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:41:19.325545 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-a9221542-891f-4c38-a5cf-66a29c14d7c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:41:19.338842 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1152/2296] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:41:19 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:41:27.933723 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:DELETE=4,keystone:SELECT=72,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:41:29.318276 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=25 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:41:29.592706 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee5d45e-6403-43f2-b360-c634e1e00bc4 service cinder] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:41:29.594911 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-eee5d45e-6403-43f2-b360-c634e1e00bc4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:41:29.694571 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee5d45e-6403-43f2-b360-c634e1e00bc4 service cinder] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:41:29.699164 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a0006f-43ac-4222-a984-765fc63efe57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:41:29.700427 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a0006f-43ac-4222-a984-765fc63efe57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:29.700601 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a0006f-43ac-4222-a984-765fc63efe57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:29.701044 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a0006f-43ac-4222-a984-765fc63efe57 admin admin] PATH_INFO: `/v3/users/be4ce8a5b1234bb5b8faf3337e122b7b` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:29.702593 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a0006f-43ac-4222-a984-765fc63efe57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be4ce8a5b1234bb5b8faf3337e122b7b)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:41:29.704721 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a0006f-43ac-4222-a984-765fc63efe57 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:41:29.759089 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-b2a0006f-43ac-4222-a984-765fc63efe57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be4ce8a5b1234bb5b8faf3337e122b7b'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:29.766231 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-b2a0006f-43ac-4222-a984-765fc63efe57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be4ce8a5b1234bb5b8faf3337e122b7b'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:29.766973 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-b2a0006f-43ac-4222-a984-765fc63efe57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be4ce8a5b1234bb5b8faf3337e122b7b'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:29.767599 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-b2a0006f-43ac-4222-a984-765fc63efe57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be4ce8a5b1234bb5b8faf3337e122b7b'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:29.780892 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-b2a0006f-43ac-4222-a984-765fc63efe57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be4ce8a5b1234bb5b8faf3337e122b7b'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:29.802335 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1145/2297] 10.222.0.36 () {58 vars in 1223 bytes} [Fri Jun 24 22:41:29 2022] DELETE /identity/v3/users/be4ce8a5b1234bb5b8faf3337e122b7b => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:41:29.806953 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d973e4b8-fe4a-4b33-8213-8bd57b42ebb0 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:29.807352 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d973e4b8-fe4a-4b33-8213-8bd57b42ebb0 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:29.807687 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d973e4b8-fe4a-4b33-8213-8bd57b42ebb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:29.828868 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-d973e4b8-fe4a-4b33-8213-8bd57b42ebb0 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:41:29.831402 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-d973e4b8-fe4a-4b33-8213-8bd57b42ebb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:41:29.907006 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1153/2298] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:41:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:41:29.920672 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a0006f-43ac-4222-a984-765fc63efe57 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:41:29.922425 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-b2a0006f-43ac-4222-a984-765fc63efe57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:41:30.004295 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a0006f-43ac-4222-a984-765fc63efe57 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:41:30.008063 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da46ee44-3c22-438a-afa7-437cc2015d12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:41:30.009004 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da46ee44-3c22-438a-afa7-437cc2015d12 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:30.009004 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da46ee44-3c22-438a-afa7-437cc2015d12 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:30.009245 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da46ee44-3c22-438a-afa7-437cc2015d12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:30.019749 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da46ee44-3c22-438a-afa7-437cc2015d12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:41:30.021240 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da46ee44-3c22-438a-afa7-437cc2015d12 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:41:30.031045 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1146/2299] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:41:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:41:30.329556 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d973e4b8-fe4a-4b33-8213-8bd57b42ebb0 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:41:30.331174 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-d973e4b8-fe4a-4b33-8213-8bd57b42ebb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:41:30.343620 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d973e4b8-fe4a-4b33-8213-8bd57b42ebb0 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:41:30.348684 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfb1655-2371-45e4-8814-8de34e82fbe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:41:30.349569 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb1655-2371-45e4-8814-8de34e82fbe0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:30.349841 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb1655-2371-45e4-8814-8de34e82fbe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:30.350257 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb1655-2371-45e4-8814-8de34e82fbe0 admin admin] PATH_INFO: `/v3/projects/40e588ea16c0427fae363ddedb093634` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:30.351533 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfb1655-2371-45e4-8814-8de34e82fbe0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40e588ea16c0427fae363ddedb093634)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:41:30.353473 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfb1655-2371-45e4-8814-8de34e82fbe0 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:41:30.402251 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-3cfb1655-2371-45e4-8814-8de34e82fbe0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40e588ea16c0427fae363ddedb093634', 'request_id': 'req-3cfb1655-2371-45e4-8814-8de34e82fbe0'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:30.408564 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-3cfb1655-2371-45e4-8814-8de34e82fbe0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40e588ea16c0427fae363ddedb093634', 'request_id': 'req-3cfb1655-2371-45e4-8814-8de34e82fbe0'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:30.417903 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-3cfb1655-2371-45e4-8814-8de34e82fbe0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40e588ea16c0427fae363ddedb093634', 'request_id': 'req-3cfb1655-2371-45e4-8814-8de34e82fbe0'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:30.429405 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-3cfb1655-2371-45e4-8814-8de34e82fbe0 admin admin] The token cache is being invalidate because project 40e588ea16c0427fae363ddedb093634 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 22:41:30.429719 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-3cfb1655-2371-45e4-8814-8de34e82fbe0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:30.430387 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-3cfb1655-2371-45e4-8814-8de34e82fbe0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:41:30.432233 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1154/2300] 10.222.0.36 () {58 vars in 1232 bytes} [Fri Jun 24 22:41:30 2022] DELETE /identity/v3/projects/40e588ea16c0427fae363ddedb093634 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:41:30.437494 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4d85f4-fe71-49ba-884d-a17317cf25f0 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:30.437795 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4d85f4-fe71-49ba-884d-a17317cf25f0 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:30.438075 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4d85f4-fe71-49ba-884d-a17317cf25f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:30.442140 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:41:30.471115 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-0a4d85f4-fe71-49ba-884d-a17317cf25f0 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:41:30.472351 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-0a4d85f4-fe71-49ba-884d-a17317cf25f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:41:30.539631 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1147/2301] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:41:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:41:30.548007 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b863ca-8627-4858-8ab3-a3a0a8826c23 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:30.548295 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b863ca-8627-4858-8ab3-a3a0a8826c23 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:30.548573 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b863ca-8627-4858-8ab3-a3a0a8826c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:30.568070 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-15b863ca-8627-4858-8ab3-a3a0a8826c23 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:41:30.569281 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-15b863ca-8627-4858-8ab3-a3a0a8826c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:41:30.578177 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1155/2302] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:41:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:41:30.582329 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4d85f4-fe71-49ba-884d-a17317cf25f0 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:41:30.592603 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4d85f4-fe71-49ba-884d-a17317cf25f0 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:41:30.600101 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840deffe-be33-49fd-9964-d046c2ef71bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:41:30.600765 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840deffe-be33-49fd-9964-d046c2ef71bf admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:30.601093 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840deffe-be33-49fd-9964-d046c2ef71bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:30.601352 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840deffe-be33-49fd-9964-d046c2ef71bf admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:30.602123 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840deffe-be33-49fd-9964-d046c2ef71bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:41:30.602446 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840deffe-be33-49fd-9964-d046c2ef71bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:41:30.604149 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840deffe-be33-49fd-9964-d046c2ef71bf admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:41:30.616577 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1148/2303] 10.222.0.36 () {58 vars in 1152 bytes} [Fri Jun 24 22:41:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:41:30.621029 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b863ca-8627-4858-8ab3-a3a0a8826c23 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:41:30.631159 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b863ca-8627-4858-8ab3-a3a0a8826c23 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:41:30.637364 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092bc723-5cee-43db-8733-b84c92ccd6b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:41:30.638025 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092bc723-5cee-43db-8733-b84c92ccd6b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:30.638302 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092bc723-5cee-43db-8733-b84c92ccd6b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:30.638571 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092bc723-5cee-43db-8733-b84c92ccd6b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:30.639336 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092bc723-5cee-43db-8733-b84c92ccd6b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:41:30.641331 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092bc723-5cee-43db-8733-b84c92ccd6b1 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:41:30.673375 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1156/2304] 10.222.0.36 () {60 vars in 1152 bytes} [Fri Jun 24 22:41:30 2022] POST /identity/v3/projects => generated 375 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 22:41:30.679377 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840deffe-be33-49fd-9964-d046c2ef71bf admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:41:30.690642 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840deffe-be33-49fd-9964-d046c2ef71bf admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:41:30.749697 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468161fd-b343-44d8-b718-bd399de24df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:41:30.750748 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468161fd-b343-44d8-b718-bd399de24df7 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:30.751124 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468161fd-b343-44d8-b718-bd399de24df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:30.751427 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468161fd-b343-44d8-b718-bd399de24df7 admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:30.752212 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468161fd-b343-44d8-b718-bd399de24df7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:41:30.754543 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468161fd-b343-44d8-b718-bd399de24df7 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:41:30.778542 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1149/2305] 10.222.0.36 () {60 vars in 1143 bytes} [Fri Jun 24 22:41:30 2022] POST /identity/v3/users => generated 288 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:41:30.783476 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092bc723-5cee-43db-8733-b84c92ccd6b1 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:41:30.794173 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092bc723-5cee-43db-8733-b84c92ccd6b1 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:41:30.799128 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f58482-b2ae-4b15-ad13-c132b2c88f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:41:30.799829 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f58482-b2ae-4b15-ad13-c132b2c88f2d admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:30.800113 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f58482-b2ae-4b15-ad13-c132b2c88f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:30.800388 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f58482-b2ae-4b15-ad13-c132b2c88f2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:30.801126 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f58482-b2ae-4b15-ad13-c132b2c88f2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:41:30.802774 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f58482-b2ae-4b15-ad13-c132b2c88f2d admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:41:30.814378 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1157/2306] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:41:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:41:30.818813 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468161fd-b343-44d8-b718-bd399de24df7 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:41:30.832515 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468161fd-b343-44d8-b718-bd399de24df7 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:41:30.837427 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3878d0-45d9-4c10-835b-5ddf872d728a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:41:30.838211 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3878d0-45d9-4c10-835b-5ddf872d728a admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:30.838502 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3878d0-45d9-4c10-835b-5ddf872d728a admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:30.838781 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3878d0-45d9-4c10-835b-5ddf872d728a admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:30.839579 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3878d0-45d9-4c10-835b-5ddf872d728a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:41:30.841197 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3878d0-45d9-4c10-835b-5ddf872d728a admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:41:30.855522 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1150/2307] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:41:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 22:41:30.856812 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f58482-b2ae-4b15-ad13-c132b2c88f2d admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:41:30.867811 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f58482-b2ae-4b15-ad13-c132b2c88f2d admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:41:30.872726 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c65b57-962a-4a2a-ac0b-a96bd4b0a3a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:41:30.874334 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c65b57-962a-4a2a-ac0b-a96bd4b0a3a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:30.874615 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c65b57-962a-4a2a-ac0b-a96bd4b0a3a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:30.874895 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c65b57-962a-4a2a-ac0b-a96bd4b0a3a2 admin admin] PATH_INFO: `/v3/projects/fc4172c312e24d66944e1743c79bc668/users/94eaab09476843a5b7fde50732473092/roles/1928787bfcc745419829cd315900ac44` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:30.890560 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c65b57-962a-4a2a-ac0b-a96bd4b0a3a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc4172c312e24d66944e1743c79bc668, user_id=94eaab09476843a5b7fde50732473092, role_id=1928787bfcc745419829cd315900ac44)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:41:30.893321 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c65b57-962a-4a2a-ac0b-a96bd4b0a3a2 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:41:30.909074 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1158/2308] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 22:41:30 2022] PUT /identity/v3/projects/fc4172c312e24d66944e1743c79bc668/users/94eaab09476843a5b7fde50732473092/roles/1928787bfcc745419829cd315900ac44 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:41:30.920767 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27d0a23-1204-4b8d-b548-985a2ef8bac1 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:30.921407 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27d0a23-1204-4b8d-b548-985a2ef8bac1 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:30.921792 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27d0a23-1204-4b8d-b548-985a2ef8bac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:30.953866 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-a27d0a23-1204-4b8d-b548-985a2ef8bac1 None None] MFA Rules not processed for user `94eaab09476843a5b7fde50732473092`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:41:30.955297 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-a27d0a23-1204-4b8d-b548-985a2ef8bac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:41:31.004321 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:41:31.026226 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1151/2309] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:41:30 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:41:31.039593 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c65b57-962a-4a2a-ac0b-a96bd4b0a3a2 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:41:31.041586 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-e3c65b57-962a-4a2a-ac0b-a96bd4b0a3a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:41:31.066831 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:41:31.114702 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c65b57-962a-4a2a-ac0b-a96bd4b0a3a2 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:41:31.119355 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743e75d0-0f44-49ac-b54b-77b961d49690 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a747e2a5684843a6ee9e3480badac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:41:31.120097 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743e75d0-0f44-49ac-b54b-77b961d49690 service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:31.120444 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743e75d0-0f44-49ac-b54b-77b961d49690 service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:31.121062 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743e75d0-0f44-49ac-b54b-77b961d49690 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:31.133443 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743e75d0-0f44-49ac-b54b-77b961d49690 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:41:31.135193 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743e75d0-0f44-49ac-b54b-77b961d49690 service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:41:31.145804 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1159/2310] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:41:31 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:41:41.023518 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=5 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:41:41.144588 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=17 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:41:49.666856 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90acb11-4a0e-4a07-a587-6a5ebe07d505 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:49.667354 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90acb11-4a0e-4a07-a587-6a5ebe07d505 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:49.667457 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90acb11-4a0e-4a07-a587-6a5ebe07d505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:49.685489 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-c90acb11-4a0e-4a07-a587-6a5ebe07d505 None None] MFA Rules not processed for user `5ef9341f6c60435fa653581ebaa05cbc`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:41:49.686779 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-c90acb11-4a0e-4a07-a587-6a5ebe07d505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:41:49.753681 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1152/2311] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:41:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:41:58.861746 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3ac1f4-531e-49c7-a884-c6ecfa435c05 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:58.862258 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3ac1f4-531e-49c7-a884-c6ecfa435c05 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:58.862366 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3ac1f4-531e-49c7-a884-c6ecfa435c05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:58.889861 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-fc3ac1f4-531e-49c7-a884-c6ecfa435c05 None None] MFA Rules not processed for user `542ea2e5a8114792836d0cdfd36b4c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:41:58.891052 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-fc3ac1f4-531e-49c7-a884-c6ecfa435c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:41:58.962695 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1160/2312] 10.222.0.36 () {58 vars in 1009 bytes} [Fri Jun 24 22:41:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:41:59.007528 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90acb11-4a0e-4a07-a587-6a5ebe07d505 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:41:59.009081 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-c90acb11-4a0e-4a07-a587-6a5ebe07d505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:41:59.089337 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90acb11-4a0e-4a07-a587-6a5ebe07d505 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:41:59.096137 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ac2985-d674-4a84-9043-0d31be950e9a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b95846f7f2a453f85ddb41a5d3327f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:41:59.096137 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ac2985-d674-4a84-9043-0d31be950e9a service swift] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:59.096436 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ac2985-d674-4a84-9043-0d31be950e9a service swift] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:59.096654 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ac2985-d674-4a84-9043-0d31be950e9a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:59.105595 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ac2985-d674-4a84-9043-0d31be950e9a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:41:59.107276 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ac2985-d674-4a84-9043-0d31be950e9a service swift] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:41:59.115526 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1153/2313] 10.222.0.36 () {60 vars in 1384 bytes} [Fri Jun 24 22:41:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 22:41:59.695201 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4aa0b8-9222-4898-9804-9a49a8cd2a77 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:59.695551 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4aa0b8-9222-4898-9804-9a49a8cd2a77 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:59.695830 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4aa0b8-9222-4898-9804-9a49a8cd2a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:59.713758 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-cb4aa0b8-9222-4898-9804-9a49a8cd2a77 None None] MFA Rules not processed for user `542ea2e5a8114792836d0cdfd36b4c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:41:59.714969 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-cb4aa0b8-9222-4898-9804-9a49a8cd2a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:41:59.723269 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1161/2314] 10.222.0.36 () {58 vars in 967 bytes} [Fri Jun 24 22:41:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:41:59.736522 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ac2985-d674-4a84-9043-0d31be950e9a service swift] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:41:59.749013 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ac2985-d674-4a84-9043-0d31be950e9a service swift] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:41:59.758355 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adc1b1c-1f8b-4f2b-9917-9d2efebf146c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b95846f7f2a453f85ddb41a5d3327f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:41:59.759143 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adc1b1c-1f8b-4f2b-9917-9d2efebf146c service swift] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:41:59.759457 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adc1b1c-1f8b-4f2b-9917-9d2efebf146c service swift] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:41:59.759732 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adc1b1c-1f8b-4f2b-9917-9d2efebf146c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:41:59.768523 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adc1b1c-1f8b-4f2b-9917-9d2efebf146c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:41:59.770131 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adc1b1c-1f8b-4f2b-9917-9d2efebf146c service swift] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:41:59.778802 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1154/2315] 10.222.0.36 () {60 vars in 1384 bytes} [Fri Jun 24 22:41:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 22:42:00.008189 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c6c029-1370-48e3-a404-ff59a6703b86 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:42:00.008683 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c6c029-1370-48e3-a404-ff59a6703b86 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:42:00.008799 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c6c029-1370-48e3-a404-ff59a6703b86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:42:00.026689 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-e3c6c029-1370-48e3-a404-ff59a6703b86 None None] MFA Rules not processed for user `542ea2e5a8114792836d0cdfd36b4c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:42:00.027912 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-e3c6c029-1370-48e3-a404-ff59a6703b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:42:00.035284 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1162/2316] 10.222.0.36 () {58 vars in 1009 bytes} [Fri Jun 24 22:42:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:42:00.047829 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adc1b1c-1f8b-4f2b-9917-9d2efebf146c service swift] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:42:00.058748 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adc1b1c-1f8b-4f2b-9917-9d2efebf146c service swift] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:42:00.064806 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7fd7bf-b2f0-4373-af5b-1e5019d01f65 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b95846f7f2a453f85ddb41a5d3327f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:42:00.065443 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7fd7bf-b2f0-4373-af5b-1e5019d01f65 service swift] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:42:00.065720 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7fd7bf-b2f0-4373-af5b-1e5019d01f65 service swift] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:42:00.065992 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7fd7bf-b2f0-4373-af5b-1e5019d01f65 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:42:00.074442 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7fd7bf-b2f0-4373-af5b-1e5019d01f65 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:42:00.076077 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7fd7bf-b2f0-4373-af5b-1e5019d01f65 service swift] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:42:00.084231 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1155/2317] 10.222.0.36 () {60 vars in 1384 bytes} [Fri Jun 24 22:42:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 22:42:00.301794 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c6c029-1370-48e3-a404-ff59a6703b86 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:42:00.366761 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c6c029-1370-48e3-a404-ff59a6703b86 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:42:00.372062 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3194f3-8e4c-4fd7-9f88-a768793eba0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:42:00.372970 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3194f3-8e4c-4fd7-9f88-a768793eba0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:42:00.373246 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3194f3-8e4c-4fd7-9f88-a768793eba0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:42:00.373498 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3194f3-8e4c-4fd7-9f88-a768793eba0e admin admin] PATH_INFO: `/v3/users/94eaab09476843a5b7fde50732473092` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:42:00.374693 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3194f3-8e4c-4fd7-9f88-a768793eba0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=94eaab09476843a5b7fde50732473092)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:42:00.377379 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3194f3-8e4c-4fd7-9f88-a768793eba0e admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:42:00.430151 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2301e397-5b12-475e-9bd9-a6fcd4e220f8 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:42:00.430556 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2301e397-5b12-475e-9bd9-a6fcd4e220f8 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:42:00.430921 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2301e397-5b12-475e-9bd9-a6fcd4e220f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:42:00.436624 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-6f3194f3-8e4c-4fd7-9f88-a768793eba0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94eaab09476843a5b7fde50732473092'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:42:00.444783 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-6f3194f3-8e4c-4fd7-9f88-a768793eba0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94eaab09476843a5b7fde50732473092'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:42:00.445602 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-6f3194f3-8e4c-4fd7-9f88-a768793eba0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94eaab09476843a5b7fde50732473092'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:42:00.446395 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-6f3194f3-8e4c-4fd7-9f88-a768793eba0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94eaab09476843a5b7fde50732473092'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:42:00.450358 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-2301e397-5b12-475e-9bd9-a6fcd4e220f8 None None] MFA Rules not processed for user `542ea2e5a8114792836d0cdfd36b4c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:42:00.451764 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-2301e397-5b12-475e-9bd9-a6fcd4e220f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:42:00.459524 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-6f3194f3-8e4c-4fd7-9f88-a768793eba0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94eaab09476843a5b7fde50732473092'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:42:00.459993 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1156/2318] 10.222.0.36 () {58 vars in 967 bytes} [Fri Jun 24 22:42:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 22:42:00.465622 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:42:00.474060 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2301e397-5b12-475e-9bd9-a6fcd4e220f8 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:42:00.475893 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-2301e397-5b12-475e-9bd9-a6fcd4e220f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:42:00.479218 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1163/2319] 10.222.0.36 () {58 vars in 1223 bytes} [Fri Jun 24 22:42:00 2022] DELETE /identity/v3/users/94eaab09476843a5b7fde50732473092 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:42:00.483639 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670bf076-a4e2-4db1-8aac-20912308e82d None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:42:00.483927 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670bf076-a4e2-4db1-8aac-20912308e82d None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:42:00.484205 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670bf076-a4e2-4db1-8aac-20912308e82d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:42:00.492364 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2301e397-5b12-475e-9bd9-a6fcd4e220f8 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:42:00.501355 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-670bf076-a4e2-4db1-8aac-20912308e82d None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:42:00.502559 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-670bf076-a4e2-4db1-8aac-20912308e82d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:42:00.545729 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:42:00.552898 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf8f172-69ff-4a95-8a80-0ecf09cf8157 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b95846f7f2a453f85ddb41a5d3327f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:42:00.553799 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf8f172-69ff-4a95-8a80-0ecf09cf8157 service swift] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:42:00.554114 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf8f172-69ff-4a95-8a80-0ecf09cf8157 service swift] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:42:00.554453 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf8f172-69ff-4a95-8a80-0ecf09cf8157 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:42:00.564691 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1164/2320] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:42:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 22:42:00.575110 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670bf076-a4e2-4db1-8aac-20912308e82d None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:42:00.576602 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-670bf076-a4e2-4db1-8aac-20912308e82d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:42:00.612604 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf8f172-69ff-4a95-8a80-0ecf09cf8157 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:42:00.614251 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf8f172-69ff-4a95-8a80-0ecf09cf8157 service swift] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:42:00.622608 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1157/2321] 10.222.0.36 () {60 vars in 1384 bytes} [Fri Jun 24 22:42:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 24 22:42:00.640822 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670bf076-a4e2-4db1-8aac-20912308e82d None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:42:00.645275 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e515fa8-42ad-4bdb-892f-2487bb00698c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:42:00.646014 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e515fa8-42ad-4bdb-892f-2487bb00698c service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:42:00.646294 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e515fa8-42ad-4bdb-892f-2487bb00698c service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:42:00.646659 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e515fa8-42ad-4bdb-892f-2487bb00698c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:42:00.656856 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e515fa8-42ad-4bdb-892f-2487bb00698c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:42:00.658288 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e515fa8-42ad-4bdb-892f-2487bb00698c service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:42:00.670121 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1165/2322] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:42:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 22:42:00.978067 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf8f172-69ff-4a95-8a80-0ecf09cf8157 service swift] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:42:00.979814 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-0cf8f172-69ff-4a95-8a80-0ecf09cf8157 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:42:00.996652 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf8f172-69ff-4a95-8a80-0ecf09cf8157 service swift] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:42:01.002160 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896013b4-f21b-47a0-b665-f7a1e0613fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:42:01.003042 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896013b4-f21b-47a0-b665-f7a1e0613fe3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:42:01.003360 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896013b4-f21b-47a0-b665-f7a1e0613fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:42:01.003637 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896013b4-f21b-47a0-b665-f7a1e0613fe3 admin admin] PATH_INFO: `/v3/projects/fc4172c312e24d66944e1743c79bc668` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:42:01.005078 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896013b4-f21b-47a0-b665-f7a1e0613fe3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc4172c312e24d66944e1743c79bc668)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:42:01.008371 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896013b4-f21b-47a0-b665-f7a1e0613fe3 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:42:01.058404 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-896013b4-f21b-47a0-b665-f7a1e0613fe3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc4172c312e24d66944e1743c79bc668', 'request_id': 'req-896013b4-f21b-47a0-b665-f7a1e0613fe3'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:42:01.064829 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-896013b4-f21b-47a0-b665-f7a1e0613fe3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc4172c312e24d66944e1743c79bc668', 'request_id': 'req-896013b4-f21b-47a0-b665-f7a1e0613fe3'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:42:01.073969 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-896013b4-f21b-47a0-b665-f7a1e0613fe3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc4172c312e24d66944e1743c79bc668', 'request_id': 'req-896013b4-f21b-47a0-b665-f7a1e0613fe3'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:42:01.084130 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-896013b4-f21b-47a0-b665-f7a1e0613fe3 admin admin] The token cache is being invalidate because project fc4172c312e24d66944e1743c79bc668 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 22:42:01.084412 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-896013b4-f21b-47a0-b665-f7a1e0613fe3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:42:01.085026 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-896013b4-f21b-47a0-b665-f7a1e0613fe3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:42:01.086776 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1158/2323] 10.222.0.36 () {58 vars in 1232 bytes} [Fri Jun 24 22:42:00 2022] DELETE /identity/v3/projects/fc4172c312e24d66944e1743c79bc668 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:42:01.091817 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3117ddc0-d9cd-4bb1-b2d1-25fa2aa03ec8 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:42:01.092333 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3117ddc0-d9cd-4bb1-b2d1-25fa2aa03ec8 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:42:01.092432 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3117ddc0-d9cd-4bb1-b2d1-25fa2aa03ec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:42:01.109888 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-3117ddc0-d9cd-4bb1-b2d1-25fa2aa03ec8 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:42:01.111166 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-3117ddc0-d9cd-4bb1-b2d1-25fa2aa03ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:42:01.177872 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1166/2324] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:42:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:42:01.185600 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201df9d1-4b56-4f4b-b305-69bda2037a37 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:42:01.185897 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201df9d1-4b56-4f4b-b305-69bda2037a37 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:42:01.186176 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201df9d1-4b56-4f4b-b305-69bda2037a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:42:01.207202 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-201df9d1-4b56-4f4b-b305-69bda2037a37 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:42:01.208549 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-201df9d1-4b56-4f4b-b305-69bda2037a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:42:01.216498 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1159/2325] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:42:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:42:01.220906 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3117ddc0-d9cd-4bb1-b2d1-25fa2aa03ec8 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:42:01.231165 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3117ddc0-d9cd-4bb1-b2d1-25fa2aa03ec8 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:42:01.236113 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d0d8ac-4d52-4908-86b2-cdd1842c6d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:42:01.236848 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d0d8ac-4d52-4908-86b2-cdd1842c6d73 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:42:01.237166 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d0d8ac-4d52-4908-86b2-cdd1842c6d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:42:01.237411 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d0d8ac-4d52-4908-86b2-cdd1842c6d73 admin admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:42:01.238268 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d0d8ac-4d52-4908-86b2-cdd1842c6d73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:42:01.238588 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d0d8ac-4d52-4908-86b2-cdd1842c6d73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:42:01.241671 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d0d8ac-4d52-4908-86b2-cdd1842c6d73 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:42:01.254848 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1167/2326] 10.222.0.36 () {58 vars in 1152 bytes} [Fri Jun 24 22:42:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:42:01.260842 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201df9d1-4b56-4f4b-b305-69bda2037a37 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:42:01.270889 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201df9d1-4b56-4f4b-b305-69bda2037a37 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:42:01.279533 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d23d960-6c63-4fc2-8d37-da72e4a87c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:42:01.280222 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d23d960-6c63-4fc2-8d37-da72e4a87c5a admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:42:01.280509 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d23d960-6c63-4fc2-8d37-da72e4a87c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:42:01.280811 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d23d960-6c63-4fc2-8d37-da72e4a87c5a admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:42:01.281509 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d23d960-6c63-4fc2-8d37-da72e4a87c5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:42:01.283543 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d23d960-6c63-4fc2-8d37-da72e4a87c5a admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:42:01.315111 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1160/2327] 10.222.0.36 () {60 vars in 1152 bytes} [Fri Jun 24 22:42:01 2022] POST /identity/v3/projects => generated 367 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:42:01.316516 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d0d8ac-4d52-4908-86b2-cdd1842c6d73 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:42:01.326983 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d0d8ac-4d52-4908-86b2-cdd1842c6d73 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:42:01.352037 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:42:01.384972 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a003124a-bf2b-4b33-94cc-a22d724a1161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:42:01.385652 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a003124a-bf2b-4b33-94cc-a22d724a1161 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:42:01.385929 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a003124a-bf2b-4b33-94cc-a22d724a1161 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:42:01.386225 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a003124a-bf2b-4b33-94cc-a22d724a1161 admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:42:01.387079 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a003124a-bf2b-4b33-94cc-a22d724a1161 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:42:01.389177 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a003124a-bf2b-4b33-94cc-a22d724a1161 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:42:01.413238 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1168/2328] 10.222.0.36 () {60 vars in 1143 bytes} [Fri Jun 24 22:42:01 2022] POST /identity/v3/users => generated 284 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:42:01.417857 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d23d960-6c63-4fc2-8d37-da72e4a87c5a admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:42:01.430659 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d23d960-6c63-4fc2-8d37-da72e4a87c5a admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:42:01.435605 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f81f05-c0a3-48be-a533-a15823cb3858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:42:01.436309 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f81f05-c0a3-48be-a533-a15823cb3858 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:42:01.436593 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f81f05-c0a3-48be-a533-a15823cb3858 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:42:01.436871 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f81f05-c0a3-48be-a533-a15823cb3858 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:42:01.437609 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f81f05-c0a3-48be-a533-a15823cb3858 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:42:01.439231 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f81f05-c0a3-48be-a533-a15823cb3858 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:42:01.450553 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1161/2329] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:42:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:42:01.454699 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a003124a-bf2b-4b33-94cc-a22d724a1161 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:42:01.466399 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a003124a-bf2b-4b33-94cc-a22d724a1161 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:42:01.471104 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578ffb64-9f09-4764-81ec-223380549b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:42:01.472065 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578ffb64-9f09-4764-81ec-223380549b60 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:42:01.472292 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578ffb64-9f09-4764-81ec-223380549b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:42:01.472385 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578ffb64-9f09-4764-81ec-223380549b60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:42:01.473068 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578ffb64-9f09-4764-81ec-223380549b60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:42:01.475083 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578ffb64-9f09-4764-81ec-223380549b60 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:42:01.485749 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1169/2330] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:42:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:42:01.489919 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f81f05-c0a3-48be-a533-a15823cb3858 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:42:01.500792 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f81f05-c0a3-48be-a533-a15823cb3858 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:42:01.505659 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cf1cd3-2faa-45ea-8316-96899d7fc79f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:42:01.506665 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cf1cd3-2faa-45ea-8316-96899d7fc79f admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:42:01.507066 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cf1cd3-2faa-45ea-8316-96899d7fc79f admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:42:01.507366 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cf1cd3-2faa-45ea-8316-96899d7fc79f admin admin] PATH_INFO: `/v3/projects/5f70d171d26c491da3cf9f49e6d12ef2/users/e25bdfc813ab46f48f2bd4d51f53ce60/roles/1928787bfcc745419829cd315900ac44` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:42:01.523482 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cf1cd3-2faa-45ea-8316-96899d7fc79f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f70d171d26c491da3cf9f49e6d12ef2, user_id=e25bdfc813ab46f48f2bd4d51f53ce60, role_id=1928787bfcc745419829cd315900ac44)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:42:01.526584 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cf1cd3-2faa-45ea-8316-96899d7fc79f admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:42:01.541606 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1162/2331] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 22:42:01 2022] PUT /identity/v3/projects/5f70d171d26c491da3cf9f49e6d12ef2/users/e25bdfc813ab46f48f2bd4d51f53ce60/roles/1928787bfcc745419829cd315900ac44 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:42:01.551964 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c1d893-e8e3-4762-b697-989947dd69ab None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:42:01.552255 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c1d893-e8e3-4762-b697-989947dd69ab None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:42:01.552527 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c1d893-e8e3-4762-b697-989947dd69ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:42:01.582067 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-33c1d893-e8e3-4762-b697-989947dd69ab None None] MFA Rules not processed for user `e25bdfc813ab46f48f2bd4d51f53ce60`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:42:01.583273 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-33c1d893-e8e3-4762-b697-989947dd69ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:42:01.650341 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1170/2332] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:42:01 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:42:01.663306 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cf1cd3-2faa-45ea-8316-96899d7fc79f admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:42:01.665174 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-30cf1cd3-2faa-45ea-8316-96899d7fc79f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:42:01.691850 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:42:01.726937 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cf1cd3-2faa-45ea-8316-96899d7fc79f admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:42:01.730556 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1198ae-ac98-4e69-b7c5-89a48024e545 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd156158fa06647569a8bb2d8d0019f28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:42:01.731205 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1198ae-ac98-4e69-b7c5-89a48024e545 service glance] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:42:01.731595 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1198ae-ac98-4e69-b7c5-89a48024e545 service glance] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:42:01.731868 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1198ae-ac98-4e69-b7c5-89a48024e545 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:42:01.739969 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1198ae-ac98-4e69-b7c5-89a48024e545 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:42:01.741487 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1198ae-ac98-4e69-b7c5-89a48024e545 service glance] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:42:01.750622 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1163/2333] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:42:01 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:42:02.743657 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c1d893-e8e3-4762-b697-989947dd69ab None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:42:02.745619 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-33c1d893-e8e3-4762-b697-989947dd69ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:42:02.817689 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c1d893-e8e3-4762-b697-989947dd69ab None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:42:02.824154 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5cadd1-edac-4c0a-ae41-112756473036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:42:02.825249 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5cadd1-edac-4c0a-ae41-112756473036 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:42:02.826524 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5cadd1-edac-4c0a-ae41-112756473036 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:42:02.827498 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5cadd1-edac-4c0a-ae41-112756473036 admin admin] PATH_INFO: `/v3/users/05e58da940ea43c494073fa77fb5c530` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:42:02.832771 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5cadd1-edac-4c0a-ae41-112756473036 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05e58da940ea43c494073fa77fb5c530)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:42:02.834745 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5cadd1-edac-4c0a-ae41-112756473036 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:42:02.877585 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:42:02.886572 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-fe5cadd1-edac-4c0a-ae41-112756473036 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05e58da940ea43c494073fa77fb5c530'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:42:02.893532 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-fe5cadd1-edac-4c0a-ae41-112756473036 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05e58da940ea43c494073fa77fb5c530'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:42:02.894239 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-fe5cadd1-edac-4c0a-ae41-112756473036 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05e58da940ea43c494073fa77fb5c530'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:42:02.894841 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-fe5cadd1-edac-4c0a-ae41-112756473036 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05e58da940ea43c494073fa77fb5c530'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:42:02.911284 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-fe5cadd1-edac-4c0a-ae41-112756473036 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05e58da940ea43c494073fa77fb5c530'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:42:02.930237 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1171/2334] 10.222.0.36 () {58 vars in 1223 bytes} [Fri Jun 24 22:42:02 2022] DELETE /identity/v3/users/05e58da940ea43c494073fa77fb5c530 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:42:02.935174 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00f6826-3146-49ca-ba20-9c7218ac5b8b None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:42:02.935750 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00f6826-3146-49ca-ba20-9c7218ac5b8b None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:42:02.935846 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00f6826-3146-49ca-ba20-9c7218ac5b8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:42:02.954741 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-d00f6826-3146-49ca-ba20-9c7218ac5b8b None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:42:02.956022 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-d00f6826-3146-49ca-ba20-9c7218ac5b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:42:03.019124 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1164/2335] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:42:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:42:03.031179 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5cadd1-edac-4c0a-ae41-112756473036 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:42:03.033086 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-fe5cadd1-edac-4c0a-ae41-112756473036 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:42:03.094296 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5cadd1-edac-4c0a-ae41-112756473036 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:42:03.098225 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a383aa41-ffc7-466c-be3d-b0691d674bc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:42:03.098896 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a383aa41-ffc7-466c-be3d-b0691d674bc3 service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:42:03.099178 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a383aa41-ffc7-466c-be3d-b0691d674bc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:42:03.099472 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a383aa41-ffc7-466c-be3d-b0691d674bc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:42:03.112994 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a383aa41-ffc7-466c-be3d-b0691d674bc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:42:03.114496 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a383aa41-ffc7-466c-be3d-b0691d674bc3 service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:42:03.126770 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1172/2336] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:42:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:42:03.314361 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00f6826-3146-49ca-ba20-9c7218ac5b8b None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:42:03.318281 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-d00f6826-3146-49ca-ba20-9c7218ac5b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:42:03.335922 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00f6826-3146-49ca-ba20-9c7218ac5b8b None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:42:03.344417 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259f0707-ad74-4872-973c-b9c84fb643b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:42:03.346585 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259f0707-ad74-4872-973c-b9c84fb643b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:42:03.346992 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259f0707-ad74-4872-973c-b9c84fb643b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:42:03.347287 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259f0707-ad74-4872-973c-b9c84fb643b6 admin admin] PATH_INFO: `/v3/projects/57da4de8134348f8958c3d49e764e3b8` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:42:03.348962 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259f0707-ad74-4872-973c-b9c84fb643b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57da4de8134348f8958c3d49e764e3b8)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:42:03.351008 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259f0707-ad74-4872-973c-b9c84fb643b6 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:42:03.415796 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-259f0707-ad74-4872-973c-b9c84fb643b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57da4de8134348f8958c3d49e764e3b8', 'request_id': 'req-259f0707-ad74-4872-973c-b9c84fb643b6'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:42:03.426694 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-259f0707-ad74-4872-973c-b9c84fb643b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57da4de8134348f8958c3d49e764e3b8', 'request_id': 'req-259f0707-ad74-4872-973c-b9c84fb643b6'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:42:03.440031 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-259f0707-ad74-4872-973c-b9c84fb643b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57da4de8134348f8958c3d49e764e3b8', 'request_id': 'req-259f0707-ad74-4872-973c-b9c84fb643b6'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:42:03.453853 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-259f0707-ad74-4872-973c-b9c84fb643b6 admin admin] The token cache is being invalidate because project 57da4de8134348f8958c3d49e764e3b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 22:42:03.454151 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-259f0707-ad74-4872-973c-b9c84fb643b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:42:03.454805 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-259f0707-ad74-4872-973c-b9c84fb643b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:42:03.456544 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1165/2337] 10.222.0.36 () {58 vars in 1232 bytes} [Fri Jun 24 22:42:03 2022] DELETE /identity/v3/projects/57da4de8134348f8958c3d49e764e3b8 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:42:03.462103 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81d8e7a-10e2-4232-b43f-aca4a3f62e30 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:42:03.462627 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81d8e7a-10e2-4232-b43f-aca4a3f62e30 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:42:03.463018 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81d8e7a-10e2-4232-b43f-aca4a3f62e30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:42:03.480739 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-d81d8e7a-10e2-4232-b43f-aca4a3f62e30 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:42:03.481951 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-d81d8e7a-10e2-4232-b43f-aca4a3f62e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:42:03.566412 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1173/2338] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:42:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:42:03.574649 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b955399-b6c8-4d88-8422-cde0b30557c1 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:42:03.574945 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b955399-b6c8-4d88-8422-cde0b30557c1 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:42:03.575290 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b955399-b6c8-4d88-8422-cde0b30557c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:42:03.599638 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-1b955399-b6c8-4d88-8422-cde0b30557c1 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:42:03.600896 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-1b955399-b6c8-4d88-8422-cde0b30557c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:42:03.610201 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1166/2339] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:42:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 22:42:03.614170 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81d8e7a-10e2-4232-b43f-aca4a3f62e30 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:42:03.628054 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81d8e7a-10e2-4232-b43f-aca4a3f62e30 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:42:03.633719 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25b0812-faff-4c88-8e0c-66634faf5791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:42:03.634413 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25b0812-faff-4c88-8e0c-66634faf5791 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:42:03.634700 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25b0812-faff-4c88-8e0c-66634faf5791 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:42:03.634979 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25b0812-faff-4c88-8e0c-66634faf5791 admin admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:42:03.636034 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25b0812-faff-4c88-8e0c-66634faf5791 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:42:03.636347 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25b0812-faff-4c88-8e0c-66634faf5791 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:42:03.638654 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25b0812-faff-4c88-8e0c-66634faf5791 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:42:03.652695 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1174/2340] 10.222.0.36 () {58 vars in 1152 bytes} [Fri Jun 24 22:42:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 22:42:03.657624 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b955399-b6c8-4d88-8422-cde0b30557c1 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:42:03.680952 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b955399-b6c8-4d88-8422-cde0b30557c1 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:42:03.686611 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1fa63a-555b-4687-a28b-1ed025a20983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:42:03.687469 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1fa63a-555b-4687-a28b-1ed025a20983 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:42:03.694221 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1fa63a-555b-4687-a28b-1ed025a20983 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:42:03.694221 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1fa63a-555b-4687-a28b-1ed025a20983 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:42:03.694221 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1fa63a-555b-4687-a28b-1ed025a20983 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:42:03.694221 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1fa63a-555b-4687-a28b-1ed025a20983 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:42:03.735522 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1167/2341] 10.222.0.36 () {60 vars in 1152 bytes} [Fri Jun 24 22:42:03 2022] POST /identity/v3/projects => generated 383 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:42:03.737121 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25b0812-faff-4c88-8e0c-66634faf5791 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:42:03.750671 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25b0812-faff-4c88-8e0c-66634faf5791 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:42:03.822437 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:42:03.843804 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6cd799-bc89-4973-93e8-7dd7b4de33d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:42:03.844822 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6cd799-bc89-4973-93e8-7dd7b4de33d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:42:03.845265 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6cd799-bc89-4973-93e8-7dd7b4de33d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:42:03.845710 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6cd799-bc89-4973-93e8-7dd7b4de33d9 admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:42:03.846565 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6cd799-bc89-4973-93e8-7dd7b4de33d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:42:03.848998 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6cd799-bc89-4973-93e8-7dd7b4de33d9 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:42:03.875019 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1175/2342] 10.222.0.36 () {60 vars in 1143 bytes} [Fri Jun 24 22:42:03 2022] POST /identity/v3/users => generated 292 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:42:03.880164 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1fa63a-555b-4687-a28b-1ed025a20983 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:42:03.891319 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1fa63a-555b-4687-a28b-1ed025a20983 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:42:03.896899 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb431ece-bd77-4c8d-b1e7-d8ec5b2b9c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:42:03.897617 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb431ece-bd77-4c8d-b1e7-d8ec5b2b9c3b admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:42:03.897893 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb431ece-bd77-4c8d-b1e7-d8ec5b2b9c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:42:03.898299 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb431ece-bd77-4c8d-b1e7-d8ec5b2b9c3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:42:03.899426 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb431ece-bd77-4c8d-b1e7-d8ec5b2b9c3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:42:03.901122 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb431ece-bd77-4c8d-b1e7-d8ec5b2b9c3b admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:42:03.913112 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1168/2343] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:42:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 22:42:03.917154 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6cd799-bc89-4973-93e8-7dd7b4de33d9 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:42:03.930141 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6cd799-bc89-4973-93e8-7dd7b4de33d9 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:42:03.935982 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102c5cfe-4d09-4235-9547-525f91744963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:42:03.936662 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c5cfe-4d09-4235-9547-525f91744963 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:42:03.936942 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c5cfe-4d09-4235-9547-525f91744963 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:42:03.937209 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c5cfe-4d09-4235-9547-525f91744963 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:42:03.937973 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102c5cfe-4d09-4235-9547-525f91744963 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:42:03.939813 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102c5cfe-4d09-4235-9547-525f91744963 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:42:03.957484 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1176/2344] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:42:03 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:42:03.959726 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb431ece-bd77-4c8d-b1e7-d8ec5b2b9c3b admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:42:03.976828 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb431ece-bd77-4c8d-b1e7-d8ec5b2b9c3b admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:42:03.983774 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57dda8f-c285-4ab8-bc37-66b4574a04a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:42:03.985425 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57dda8f-c285-4ab8-bc37-66b4574a04a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:42:03.985765 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57dda8f-c285-4ab8-bc37-66b4574a04a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:42:03.986043 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57dda8f-c285-4ab8-bc37-66b4574a04a8 admin admin] PATH_INFO: `/v3/projects/bc10e8eab96e44daa0f2f3f71ef658f7/users/2fae81647c0e444caaee81e81675381b/roles/1928787bfcc745419829cd315900ac44` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:42:03.990277 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:42:04.005063 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57dda8f-c285-4ab8-bc37-66b4574a04a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc10e8eab96e44daa0f2f3f71ef658f7, user_id=2fae81647c0e444caaee81e81675381b, role_id=1928787bfcc745419829cd315900ac44)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:42:04.008748 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57dda8f-c285-4ab8-bc37-66b4574a04a8 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:42:04.026128 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1169/2345] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 22:42:03 2022] PUT /identity/v3/projects/bc10e8eab96e44daa0f2f3f71ef658f7/users/2fae81647c0e444caaee81e81675381b/roles/1928787bfcc745419829cd315900ac44 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:42:04.031728 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc3ac6c-49a9-40e3-945b-a6a3dbf798f1 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:42:04.032037 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc3ac6c-49a9-40e3-945b-a6a3dbf798f1 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:42:04.032325 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc3ac6c-49a9-40e3-945b-a6a3dbf798f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:42:04.052321 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-4dc3ac6c-49a9-40e3-945b-a6a3dbf798f1 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:42:04.053589 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-4dc3ac6c-49a9-40e3-945b-a6a3dbf798f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:42:04.143149 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1177/2346] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:42:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:42:04.153116 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57dda8f-c285-4ab8-bc37-66b4574a04a8 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:42:04.155078 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-d57dda8f-c285-4ab8-bc37-66b4574a04a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:42:04.227585 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57dda8f-c285-4ab8-bc37-66b4574a04a8 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:42:04.231276 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41f73ab-978d-4c62-b751-31ad1654d53f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:42:04.231947 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41f73ab-978d-4c62-b751-31ad1654d53f service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:42:04.232209 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41f73ab-978d-4c62-b751-31ad1654d53f service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:42:04.232477 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41f73ab-978d-4c62-b751-31ad1654d53f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:42:04.242410 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41f73ab-978d-4c62-b751-31ad1654d53f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:42:04.244059 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41f73ab-978d-4c62-b751-31ad1654d53f service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:42:04.254964 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1170/2347] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:42:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:42:05.055037 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e604bd-bd86-4a1b-ab50-c14eb9248701 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:42:05.055755 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e604bd-bd86-4a1b-ab50-c14eb9248701 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:42:05.055755 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e604bd-bd86-4a1b-ab50-c14eb9248701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:42:05.089506 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-07e604bd-bd86-4a1b-ab50-c14eb9248701 None None] MFA Rules not processed for user `2fae81647c0e444caaee81e81675381b`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:42:05.090801 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-07e604bd-bd86-4a1b-ab50-c14eb9248701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:42:05.175875 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1178/2348] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:42:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:42:05.188565 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41f73ab-978d-4c62-b751-31ad1654d53f service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:42:05.190066 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-d41f73ab-978d-4c62-b751-31ad1654d53f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:42:05.284049 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41f73ab-978d-4c62-b751-31ad1654d53f service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:42:05.287788 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75a8545-e59d-442a-a2d5-d26994ef8c70 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a747e2a5684843a6ee9e3480badac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:42:05.288479 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75a8545-e59d-442a-a2d5-d26994ef8c70 service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:42:05.288792 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75a8545-e59d-442a-a2d5-d26994ef8c70 service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:42:05.289073 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75a8545-e59d-442a-a2d5-d26994ef8c70 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:42:05.298098 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75a8545-e59d-442a-a2d5-d26994ef8c70 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:42:05.299859 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75a8545-e59d-442a-a2d5-d26994ef8c70 service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:42:05.309722 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1171/2349] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:42:05 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:42:07.804545 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5cf881-74ea-49a9-92ac-392967d8e4c5 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:42:07.805081 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5cf881-74ea-49a9-92ac-392967d8e4c5 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:42:07.805176 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5cf881-74ea-49a9-92ac-392967d8e4c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:42:07.823419 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-4c5cf881-74ea-49a9-92ac-392967d8e4c5 None None] MFA Rules not processed for user `2fae81647c0e444caaee81e81675381b`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:42:07.824647 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-4c5cf881-74ea-49a9-92ac-392967d8e4c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:42:07.831477 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1179/2350] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:42:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:42:08.965495 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75a8545-e59d-442a-a2d5-d26994ef8c70 service cinder] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:42:08.967083 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-d75a8545-e59d-442a-a2d5-d26994ef8c70 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:42:09.061285 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:42:09.078931 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75a8545-e59d-442a-a2d5-d26994ef8c70 service cinder] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:42:09.084501 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7492c895-1c1a-4db5-b648-42c32052371e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0233b357708643be94c0ade17ac1fb3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:42:09.085154 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7492c895-1c1a-4db5-b648-42c32052371e service placement] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:42:09.085436 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7492c895-1c1a-4db5-b648-42c32052371e service placement] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:42:09.085709 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7492c895-1c1a-4db5-b648-42c32052371e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:42:09.087939 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-7492c895-1c1a-4db5-b648-42c32052371e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:42:09.099945 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7492c895-1c1a-4db5-b648-42c32052371e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:42:09.101568 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7492c895-1c1a-4db5-b648-42c32052371e service placement] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:42:09.111974 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1172/2351] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:42:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:42:12.310908 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5cf881-74ea-49a9-92ac-392967d8e4c5 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:42:12.312410 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-4c5cf881-74ea-49a9-92ac-392967d8e4c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:42:12.327299 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5cf881-74ea-49a9-92ac-392967d8e4c5 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:42:12.332123 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b67aba-b3ae-464a-b6e2-b1537da56936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:42:12.333031 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b67aba-b3ae-464a-b6e2-b1537da56936 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:42:12.333313 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b67aba-b3ae-464a-b6e2-b1537da56936 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:42:12.333592 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b67aba-b3ae-464a-b6e2-b1537da56936 admin admin] PATH_INFO: `/v3/users/e8b5ca58c9a5435bb188c67eb593b191` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:42:12.334848 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b67aba-b3ae-464a-b6e2-b1537da56936 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8b5ca58c9a5435bb188c67eb593b191)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:42:12.337103 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b67aba-b3ae-464a-b6e2-b1537da56936 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:42:12.389090 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:42:12.395795 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-14b67aba-b3ae-464a-b6e2-b1537da56936 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8b5ca58c9a5435bb188c67eb593b191'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:42:12.414041 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-14b67aba-b3ae-464a-b6e2-b1537da56936 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8b5ca58c9a5435bb188c67eb593b191'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:42:12.415042 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-14b67aba-b3ae-464a-b6e2-b1537da56936 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8b5ca58c9a5435bb188c67eb593b191'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:42:12.415889 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-14b67aba-b3ae-464a-b6e2-b1537da56936 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8b5ca58c9a5435bb188c67eb593b191'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:42:12.435040 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-14b67aba-b3ae-464a-b6e2-b1537da56936 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8b5ca58c9a5435bb188c67eb593b191'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:42:12.455007 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1180/2352] 10.222.0.36 () {58 vars in 1223 bytes} [Fri Jun 24 22:42:12 2022] DELETE /identity/v3/users/e8b5ca58c9a5435bb188c67eb593b191 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:42:12.459714 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853c0082-d6cc-4f0f-95ff-efc52bbbc302 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:42:12.460229 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853c0082-d6cc-4f0f-95ff-efc52bbbc302 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:42:12.460399 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853c0082-d6cc-4f0f-95ff-efc52bbbc302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:42:12.478967 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-853c0082-d6cc-4f0f-95ff-efc52bbbc302 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:42:12.481491 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-853c0082-d6cc-4f0f-95ff-efc52bbbc302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:42:12.577807 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1173/2353] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:42:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 22:42:12.588389 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b67aba-b3ae-464a-b6e2-b1537da56936 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:42:12.590084 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-14b67aba-b3ae-464a-b6e2-b1537da56936 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:42:12.661913 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b67aba-b3ae-464a-b6e2-b1537da56936 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:42:12.665981 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eae117-8778-4ead-9e0c-b09ac15ed8fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:42:12.667514 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eae117-8778-4ead-9e0c-b09ac15ed8fe service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:42:12.667514 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eae117-8778-4ead-9e0c-b09ac15ed8fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:42:12.667514 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eae117-8778-4ead-9e0c-b09ac15ed8fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:42:12.684496 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eae117-8778-4ead-9e0c-b09ac15ed8fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:42:12.686018 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eae117-8778-4ead-9e0c-b09ac15ed8fe service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:42:12.697473 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1181/2354] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:42:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:42:13.111953 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853c0082-d6cc-4f0f-95ff-efc52bbbc302 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:42:13.113455 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-853c0082-d6cc-4f0f-95ff-efc52bbbc302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:42:13.126329 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853c0082-d6cc-4f0f-95ff-efc52bbbc302 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:42:13.133588 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98236035-eda6-4a45-a553-274a3ef954e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:42:13.135038 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98236035-eda6-4a45-a553-274a3ef954e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:42:13.135605 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98236035-eda6-4a45-a553-274a3ef954e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:42:13.135891 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98236035-eda6-4a45-a553-274a3ef954e2 admin admin] PATH_INFO: `/v3/projects/0c5d4da13772457d88e53c7c37f2987b` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:42:13.138503 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98236035-eda6-4a45-a553-274a3ef954e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c5d4da13772457d88e53c7c37f2987b)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:42:13.140457 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98236035-eda6-4a45-a553-274a3ef954e2 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:42:13.197787 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-98236035-eda6-4a45-a553-274a3ef954e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c5d4da13772457d88e53c7c37f2987b', 'request_id': 'req-98236035-eda6-4a45-a553-274a3ef954e2'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:42:13.206096 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-98236035-eda6-4a45-a553-274a3ef954e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c5d4da13772457d88e53c7c37f2987b', 'request_id': 'req-98236035-eda6-4a45-a553-274a3ef954e2'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:42:13.218723 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-98236035-eda6-4a45-a553-274a3ef954e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c5d4da13772457d88e53c7c37f2987b', 'request_id': 'req-98236035-eda6-4a45-a553-274a3ef954e2'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:42:13.231235 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-98236035-eda6-4a45-a553-274a3ef954e2 admin admin] The token cache is being invalidate because project 0c5d4da13772457d88e53c7c37f2987b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 22:42:13.231555 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-98236035-eda6-4a45-a553-274a3ef954e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:42:13.232218 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-98236035-eda6-4a45-a553-274a3ef954e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:42:13.233833 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1174/2355] 10.222.0.36 () {58 vars in 1232 bytes} [Fri Jun 24 22:42:13 2022] DELETE /identity/v3/projects/0c5d4da13772457d88e53c7c37f2987b => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:42:13.238964 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9d500c-31b7-4a43-9928-1434e289650a None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:42:13.239356 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9d500c-31b7-4a43-9928-1434e289650a None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:42:13.239714 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9d500c-31b7-4a43-9928-1434e289650a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:42:13.259802 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-9a9d500c-31b7-4a43-9928-1434e289650a None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:42:13.261098 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-9a9d500c-31b7-4a43-9928-1434e289650a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:42:13.328321 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1182/2356] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:42:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:42:13.338331 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31f2e9c-6c69-41e0-94ab-f6ce8af47ae0 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:42:13.338619 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31f2e9c-6c69-41e0-94ab-f6ce8af47ae0 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:42:13.338898 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31f2e9c-6c69-41e0-94ab-f6ce8af47ae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:42:13.358542 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-f31f2e9c-6c69-41e0-94ab-f6ce8af47ae0 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:42:13.359784 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-f31f2e9c-6c69-41e0-94ab-f6ce8af47ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:42:13.368864 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1175/2357] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:42:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:42:13.373089 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9d500c-31b7-4a43-9928-1434e289650a None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:42:13.384465 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9d500c-31b7-4a43-9928-1434e289650a None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:42:13.389691 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cb7877-db68-43b2-8093-61f568b16564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:42:13.390396 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb7877-db68-43b2-8093-61f568b16564 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:42:13.390878 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb7877-db68-43b2-8093-61f568b16564 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:42:13.391266 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb7877-db68-43b2-8093-61f568b16564 admin admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:42:13.392012 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cb7877-db68-43b2-8093-61f568b16564 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:42:13.392314 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cb7877-db68-43b2-8093-61f568b16564 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:42:13.394848 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cb7877-db68-43b2-8093-61f568b16564 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:42:13.408158 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1183/2358] 10.222.0.36 () {58 vars in 1152 bytes} [Fri Jun 24 22:42:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 22:42:13.412723 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31f2e9c-6c69-41e0-94ab-f6ce8af47ae0 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:42:13.422233 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31f2e9c-6c69-41e0-94ab-f6ce8af47ae0 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:42:13.427784 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b15917-1b8f-42ae-9095-1204cbba286d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:42:13.428471 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b15917-1b8f-42ae-9095-1204cbba286d admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:42:13.428755 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b15917-1b8f-42ae-9095-1204cbba286d admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:42:13.429024 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b15917-1b8f-42ae-9095-1204cbba286d admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:42:13.429721 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b15917-1b8f-42ae-9095-1204cbba286d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:42:13.431825 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b15917-1b8f-42ae-9095-1204cbba286d admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:42:13.462546 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1176/2359] 10.222.0.36 () {60 vars in 1152 bytes} [Fri Jun 24 22:42:13 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:42:13.466847 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cb7877-db68-43b2-8093-61f568b16564 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:42:13.479134 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cb7877-db68-43b2-8093-61f568b16564 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:42:13.525721 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:42:13.540812 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940b0baa-3590-4c16-89ff-35e16dc74a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:42:13.541470 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940b0baa-3590-4c16-89ff-35e16dc74a3f admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:42:13.541758 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940b0baa-3590-4c16-89ff-35e16dc74a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:42:13.542032 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940b0baa-3590-4c16-89ff-35e16dc74a3f admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:42:13.542724 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940b0baa-3590-4c16-89ff-35e16dc74a3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:42:13.544767 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940b0baa-3590-4c16-89ff-35e16dc74a3f admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:42:13.567643 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1184/2360] 10.222.0.36 () {60 vars in 1143 bytes} [Fri Jun 24 22:42:13 2022] POST /identity/v3/users => generated 292 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:42:13.572105 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b15917-1b8f-42ae-9095-1204cbba286d admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:42:13.584686 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b15917-1b8f-42ae-9095-1204cbba286d admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:42:13.591678 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b54d8e9-e561-41ef-bc32-b677ab54f46b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:42:13.592675 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b54d8e9-e561-41ef-bc32-b677ab54f46b admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:42:13.592961 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b54d8e9-e561-41ef-bc32-b677ab54f46b admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:42:13.593241 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b54d8e9-e561-41ef-bc32-b677ab54f46b admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:42:13.594434 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b54d8e9-e561-41ef-bc32-b677ab54f46b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:42:13.596517 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b54d8e9-e561-41ef-bc32-b677ab54f46b admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:42:13.607930 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1177/2361] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:42:13 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:42:13.612179 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940b0baa-3590-4c16-89ff-35e16dc74a3f admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:42:13.622936 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940b0baa-3590-4c16-89ff-35e16dc74a3f admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:42:13.628675 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a9468f-d1ee-4ab4-8ada-bdbd35e158d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:42:13.629337 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a9468f-d1ee-4ab4-8ada-bdbd35e158d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:42:13.629623 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a9468f-d1ee-4ab4-8ada-bdbd35e158d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:42:13.629897 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a9468f-d1ee-4ab4-8ada-bdbd35e158d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:42:13.630628 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a9468f-d1ee-4ab4-8ada-bdbd35e158d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:42:13.632280 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a9468f-d1ee-4ab4-8ada-bdbd35e158d1 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:42:13.642527 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1185/2362] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:42:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:42:13.646798 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b54d8e9-e561-41ef-bc32-b677ab54f46b admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:42:13.657237 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b54d8e9-e561-41ef-bc32-b677ab54f46b admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:42:13.663561 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad857e4-cc7d-4757-8524-5a8d0aa3fe63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:42:13.664447 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad857e4-cc7d-4757-8524-5a8d0aa3fe63 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:42:13.664725 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad857e4-cc7d-4757-8524-5a8d0aa3fe63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:42:13.665000 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad857e4-cc7d-4757-8524-5a8d0aa3fe63 admin admin] PATH_INFO: `/v3/projects/6025b412b7974c3089a40d3503ba4a16/users/13a9fae5a3044e91a8f35f8c751a73f8/roles/1928787bfcc745419829cd315900ac44` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:42:13.680683 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad857e4-cc7d-4757-8524-5a8d0aa3fe63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6025b412b7974c3089a40d3503ba4a16, user_id=13a9fae5a3044e91a8f35f8c751a73f8, role_id=1928787bfcc745419829cd315900ac44)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:42:13.683377 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad857e4-cc7d-4757-8524-5a8d0aa3fe63 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:42:13.694950 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:42:13.703294 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1178/2363] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 22:42:13 2022] PUT /identity/v3/projects/6025b412b7974c3089a40d3503ba4a16/users/13a9fae5a3044e91a8f35f8c751a73f8/roles/1928787bfcc745419829cd315900ac44 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 22:42:13.709431 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36171489-8cf0-4809-a55b-9528e5eecdff None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:42:13.709728 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36171489-8cf0-4809-a55b-9528e5eecdff None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:42:13.709992 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36171489-8cf0-4809-a55b-9528e5eecdff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:42:13.730438 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-36171489-8cf0-4809-a55b-9528e5eecdff None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:42:13.731718 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-36171489-8cf0-4809-a55b-9528e5eecdff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:42:13.796070 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1186/2364] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:42:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:42:13.806545 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad857e4-cc7d-4757-8524-5a8d0aa3fe63 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:42:13.808596 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-9ad857e4-cc7d-4757-8524-5a8d0aa3fe63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:42:13.876117 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad857e4-cc7d-4757-8524-5a8d0aa3fe63 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:42:13.879962 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79090748-9cb9-4cb3-8b09-a14c5a932293 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:42:13.880609 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79090748-9cb9-4cb3-8b09-a14c5a932293 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:42:13.880887 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79090748-9cb9-4cb3-8b09-a14c5a932293 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:42:13.881162 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79090748-9cb9-4cb3-8b09-a14c5a932293 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:42:13.890907 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79090748-9cb9-4cb3-8b09-a14c5a932293 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:42:13.892346 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79090748-9cb9-4cb3-8b09-a14c5a932293 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:42:13.902177 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1179/2365] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:42:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:42:17.962609 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc5061d-7560-41f2-a040-becde59d22ab None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:42:17.963120 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc5061d-7560-41f2-a040-becde59d22ab None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:42:17.964352 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc5061d-7560-41f2-a040-becde59d22ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:42:17.991945 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-8cc5061d-7560-41f2-a040-becde59d22ab None None] MFA Rules not processed for user `13a9fae5a3044e91a8f35f8c751a73f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:42:17.993176 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-8cc5061d-7560-41f2-a040-becde59d22ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:42:18.068387 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1187/2366] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:42:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:42:18.069233 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79090748-9cb9-4cb3-8b09-a14c5a932293 service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:42:18.082129 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79090748-9cb9-4cb3-8b09-a14c5a932293 service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:42:18.099891 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9938130-f648-4b60-87ab-c9d314cd8827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:42:18.100752 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9938130-f648-4b60-87ab-c9d314cd8827 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:42:18.100995 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9938130-f648-4b60-87ab-c9d314cd8827 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:42:18.102290 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9938130-f648-4b60-87ab-c9d314cd8827 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:42:18.103238 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9938130-f648-4b60-87ab-c9d314cd8827 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:42:18.105902 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9938130-f648-4b60-87ab-c9d314cd8827 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:42:18.143446 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1180/2367] 10.222.0.36 () {60 vars in 1152 bytes} [Fri Jun 24 22:42:18 2022] POST /identity/v3/projects => generated 385 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 22:42:18.144562 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc5061d-7560-41f2-a040-becde59d22ab None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:42:18.156283 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc5061d-7560-41f2-a040-becde59d22ab None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:42:18.213157 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:42:18.220237 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f537ce-53bb-4915-b482-8a735f6b30f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:42:18.221007 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f537ce-53bb-4915-b482-8a735f6b30f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:42:18.221295 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f537ce-53bb-4915-b482-8a735f6b30f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:42:18.221581 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f537ce-53bb-4915-b482-8a735f6b30f7 admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:42:18.222282 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f537ce-53bb-4915-b482-8a735f6b30f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:42:18.227347 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f537ce-53bb-4915-b482-8a735f6b30f7 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:42:18.250026 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1188/2368] 10.222.0.36 () {60 vars in 1143 bytes} [Fri Jun 24 22:42:18 2022] POST /identity/v3/users => generated 299 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:42:18.253808 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9938130-f648-4b60-87ab-c9d314cd8827 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:42:18.265309 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9938130-f648-4b60-87ab-c9d314cd8827 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:42:18.270015 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b817f358-7a5f-48fe-af08-ade52db9fb57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:42:18.270696 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b817f358-7a5f-48fe-af08-ade52db9fb57 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:42:18.271878 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b817f358-7a5f-48fe-af08-ade52db9fb57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:42:18.272125 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b817f358-7a5f-48fe-af08-ade52db9fb57 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:42:18.272649 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b817f358-7a5f-48fe-af08-ade52db9fb57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:42:18.281094 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b817f358-7a5f-48fe-af08-ade52db9fb57 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:42:18.298375 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1181/2369] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:42:18 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:42:18.299441 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f537ce-53bb-4915-b482-8a735f6b30f7 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:42:18.310973 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f537ce-53bb-4915-b482-8a735f6b30f7 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:42:18.321101 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f7f918-9f54-4ca8-bb5a-74b03668fda3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:42:18.321101 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f7f918-9f54-4ca8-bb5a-74b03668fda3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:42:18.321101 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f7f918-9f54-4ca8-bb5a-74b03668fda3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:42:18.321101 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f7f918-9f54-4ca8-bb5a-74b03668fda3 admin admin] PATH_INFO: `/v3/projects/14f06d18177b4950998fa4a102060c23/users/416b14c8ad694d5a99a9d0c9d94bf374/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:42:18.342346 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f7f918-9f54-4ca8-bb5a-74b03668fda3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14f06d18177b4950998fa4a102060c23, user_id=416b14c8ad694d5a99a9d0c9d94bf374, role_id=1a1c43cc97a0407eb7a7c7a1333a9d4a)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:42:18.346663 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f7f918-9f54-4ca8-bb5a-74b03668fda3 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:42:18.362552 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1189/2370] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 22:42:18 2022] PUT /identity/v3/projects/14f06d18177b4950998fa4a102060c23/users/416b14c8ad694d5a99a9d0c9d94bf374/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 22:42:18.366483 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b817f358-7a5f-48fe-af08-ade52db9fb57 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:42:18.380988 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b817f358-7a5f-48fe-af08-ade52db9fb57 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:42:18.446827 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fc841f-c5d5-42f1-9f70-5873ecb2fbed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:42:18.447536 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc841f-c5d5-42f1-9f70-5873ecb2fbed admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:42:18.447845 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc841f-c5d5-42f1-9f70-5873ecb2fbed admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:42:18.448124 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc841f-c5d5-42f1-9f70-5873ecb2fbed admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:42:18.448952 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fc841f-c5d5-42f1-9f70-5873ecb2fbed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:42:18.450866 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fc841f-c5d5-42f1-9f70-5873ecb2fbed admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:42:18.461873 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1182/2371] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:42:18 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:42:18.466757 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f7f918-9f54-4ca8-bb5a-74b03668fda3 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:42:18.486547 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f7f918-9f54-4ca8-bb5a-74b03668fda3 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:42:18.492057 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc71090-6980-45e1-bf55-fe58ac709134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:42:18.493156 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc71090-6980-45e1-bf55-fe58ac709134 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:42:18.493543 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc71090-6980-45e1-bf55-fe58ac709134 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:42:18.493924 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc71090-6980-45e1-bf55-fe58ac709134 admin admin] PATH_INFO: `/v3/projects/14f06d18177b4950998fa4a102060c23/users/416b14c8ad694d5a99a9d0c9d94bf374/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:42:18.497695 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc71090-6980-45e1-bf55-fe58ac709134 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14f06d18177b4950998fa4a102060c23, user_id=416b14c8ad694d5a99a9d0c9d94bf374, role_id=1a1c43cc97a0407eb7a7c7a1333a9d4a)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:42:18.500487 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc71090-6980-45e1-bf55-fe58ac709134 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:42:18.513338 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1190/2372] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 22:42:18 2022] PUT /identity/v3/projects/14f06d18177b4950998fa4a102060c23/users/416b14c8ad694d5a99a9d0c9d94bf374/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:42:23.268844 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2722e998-f1a9-450d-b573-f65df7a08db2 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:42:23.269370 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2722e998-f1a9-450d-b573-f65df7a08db2 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:42:23.269370 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2722e998-f1a9-450d-b573-f65df7a08db2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:42:23.306686 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-2722e998-f1a9-450d-b573-f65df7a08db2 None None] MFA Rules not processed for user `416b14c8ad694d5a99a9d0c9d94bf374`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:42:23.308659 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-2722e998-f1a9-450d-b573-f65df7a08db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:42:23.364854 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:42:23.386636 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1183/2373] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:42:23 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:42:23.402546 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc71090-6980-45e1-bf55-fe58ac709134 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:42:23.409963 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-fbc71090-6980-45e1-bf55-fe58ac709134 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:42:23.496318 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc71090-6980-45e1-bf55-fe58ac709134 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:42:23.500488 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c430f488-e311-4935-bd76-0dfeccdbd0f8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd156158fa06647569a8bb2d8d0019f28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:42:23.501181 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c430f488-e311-4935-bd76-0dfeccdbd0f8 service glance] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:42:23.501466 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c430f488-e311-4935-bd76-0dfeccdbd0f8 service glance] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:42:23.501739 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c430f488-e311-4935-bd76-0dfeccdbd0f8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:42:23.561076 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c430f488-e311-4935-bd76-0dfeccdbd0f8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:42:23.562758 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c430f488-e311-4935-bd76-0dfeccdbd0f8 service glance] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:42:23.575447 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1191/2374] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:42:23 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 22:42:23.699919 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3c87a8-b064-48e4-a406-e489e36804fc None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:42:23.700583 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3c87a8-b064-48e4-a406-e489e36804fc None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:42:23.701017 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3c87a8-b064-48e4-a406-e489e36804fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:42:23.769045 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-3e3c87a8-b064-48e4-a406-e489e36804fc None None] MFA Rules not processed for user `542ea2e5a8114792836d0cdfd36b4c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:42:23.770390 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-3e3c87a8-b064-48e4-a406-e489e36804fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:42:23.861361 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1184/2375] 10.222.0.36 () {58 vars in 1009 bytes} [Fri Jun 24 22:42:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:42:23.876194 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c430f488-e311-4935-bd76-0dfeccdbd0f8 service glance] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:42:23.887206 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-c430f488-e311-4935-bd76-0dfeccdbd0f8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:42:23.975794 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:42:24.044856 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c430f488-e311-4935-bd76-0dfeccdbd0f8 service glance] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:42:24.050560 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec541de4-5926-4f96-bb93-f9306a51201b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b95846f7f2a453f85ddb41a5d3327f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:42:24.051598 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec541de4-5926-4f96-bb93-f9306a51201b service swift] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:42:24.052051 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec541de4-5926-4f96-bb93-f9306a51201b service swift] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:42:24.052467 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec541de4-5926-4f96-bb93-f9306a51201b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:42:24.062372 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec541de4-5926-4f96-bb93-f9306a51201b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:42:24.064385 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec541de4-5926-4f96-bb93-f9306a51201b service swift] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:42:24.088277 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1192/2376] 10.222.0.36 () {60 vars in 1384 bytes} [Fri Jun 24 22:42:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 22:42:33.365163 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7be4f2b-011c-4f36-8f76-8cc75741c764 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:42:33.365831 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7be4f2b-011c-4f36-8f76-8cc75741c764 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:42:33.366020 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7be4f2b-011c-4f36-8f76-8cc75741c764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:42:33.384977 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-f7be4f2b-011c-4f36-8f76-8cc75741c764 None None] MFA Rules not processed for user `13a9fae5a3044e91a8f35f8c751a73f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:42:33.386329 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-f7be4f2b-011c-4f36-8f76-8cc75741c764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:42:33.394038 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1185/2377] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:42:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:42:34.081460 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=21 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:42:36.096942 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc591da-dd5b-420d-a1d4-48644fa747bf None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:42:36.097645 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc591da-dd5b-420d-a1d4-48644fa747bf None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:42:36.097645 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc591da-dd5b-420d-a1d4-48644fa747bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:42:36.115557 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-5bc591da-dd5b-420d-a1d4-48644fa747bf None None] MFA Rules not processed for user `542ea2e5a8114792836d0cdfd36b4c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:42:36.116800 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-5bc591da-dd5b-420d-a1d4-48644fa747bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:42:36.125359 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1193/2378] 10.222.0.36 () {58 vars in 1009 bytes} [Fri Jun 24 22:42:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:42:36.139045 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7be4f2b-011c-4f36-8f76-8cc75741c764 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:42:36.150867 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7be4f2b-011c-4f36-8f76-8cc75741c764 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:42:36.156032 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1423e64-7ab6-4d53-a514-eb39fe8da006 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b95846f7f2a453f85ddb41a5d3327f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:42:36.156695 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1423e64-7ab6-4d53-a514-eb39fe8da006 service swift] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:42:36.157106 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1423e64-7ab6-4d53-a514-eb39fe8da006 service swift] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:42:36.157396 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1423e64-7ab6-4d53-a514-eb39fe8da006 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:42:36.166214 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1423e64-7ab6-4d53-a514-eb39fe8da006 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:42:36.168119 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1423e64-7ab6-4d53-a514-eb39fe8da006 service swift] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:42:36.178073 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1186/2379] 10.222.0.36 () {60 vars in 1384 bytes} [Fri Jun 24 22:42:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 22:42:46.111285 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=3 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:42:46.173759 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=53 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:43:02.111827 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc591da-dd5b-420d-a1d4-48644fa747bf None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:43:02.114114 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-5bc591da-dd5b-420d-a1d4-48644fa747bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:43:02.186552 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc591da-dd5b-420d-a1d4-48644fa747bf None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:43:02.190993 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a561f348-1bb2-46f1-82e1-97e86367cd5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:43:02.191908 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a561f348-1bb2-46f1-82e1-97e86367cd5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:43:02.192182 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a561f348-1bb2-46f1-82e1-97e86367cd5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:43:02.192473 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a561f348-1bb2-46f1-82e1-97e86367cd5f admin admin] PATH_INFO: `/v3/users/e25bdfc813ab46f48f2bd4d51f53ce60` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:43:02.193671 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a561f348-1bb2-46f1-82e1-97e86367cd5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e25bdfc813ab46f48f2bd4d51f53ce60)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:43:02.195634 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a561f348-1bb2-46f1-82e1-97e86367cd5f admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:43:02.256264 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-a561f348-1bb2-46f1-82e1-97e86367cd5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e25bdfc813ab46f48f2bd4d51f53ce60'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:43:02.264119 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-a561f348-1bb2-46f1-82e1-97e86367cd5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e25bdfc813ab46f48f2bd4d51f53ce60'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:43:02.264972 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-a561f348-1bb2-46f1-82e1-97e86367cd5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e25bdfc813ab46f48f2bd4d51f53ce60'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:43:02.265704 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-a561f348-1bb2-46f1-82e1-97e86367cd5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e25bdfc813ab46f48f2bd4d51f53ce60'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:43:02.277873 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-a561f348-1bb2-46f1-82e1-97e86367cd5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e25bdfc813ab46f48f2bd4d51f53ce60'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:43:02.292543 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1194/2380] 10.222.0.36 () {58 vars in 1223 bytes} [Fri Jun 24 22:43:02 2022] DELETE /identity/v3/users/e25bdfc813ab46f48f2bd4d51f53ce60 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:43:02.297662 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea86d0b4-002b-421d-a6c3-26b8f79a58c2 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:43:02.298223 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea86d0b4-002b-421d-a6c3-26b8f79a58c2 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:43:02.298338 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea86d0b4-002b-421d-a6c3-26b8f79a58c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:43:02.317339 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-ea86d0b4-002b-421d-a6c3-26b8f79a58c2 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:43:02.318741 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-ea86d0b4-002b-421d-a6c3-26b8f79a58c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:43:02.381710 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1187/2381] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:43:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:43:02.391468 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a561f348-1bb2-46f1-82e1-97e86367cd5f admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:43:02.392874 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-a561f348-1bb2-46f1-82e1-97e86367cd5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:43:02.455557 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a561f348-1bb2-46f1-82e1-97e86367cd5f admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:43:02.459738 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f927c6a6-f337-4d0f-8084-9dc08dd93d30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:43:02.460389 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f927c6a6-f337-4d0f-8084-9dc08dd93d30 service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:43:02.460668 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f927c6a6-f337-4d0f-8084-9dc08dd93d30 service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:43:02.460942 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f927c6a6-f337-4d0f-8084-9dc08dd93d30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:43:02.470206 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f927c6a6-f337-4d0f-8084-9dc08dd93d30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:43:02.471673 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f927c6a6-f337-4d0f-8084-9dc08dd93d30 service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:43:02.480842 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1195/2382] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:43:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 22:43:02.771587 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea86d0b4-002b-421d-a6c3-26b8f79a58c2 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:43:02.773153 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-ea86d0b4-002b-421d-a6c3-26b8f79a58c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:43:02.786834 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea86d0b4-002b-421d-a6c3-26b8f79a58c2 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:43:02.792797 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65607de-1d88-4db8-99a2-3589a51a79c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:43:02.794605 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65607de-1d88-4db8-99a2-3589a51a79c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:43:02.794898 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65607de-1d88-4db8-99a2-3589a51a79c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:43:02.795196 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65607de-1d88-4db8-99a2-3589a51a79c0 admin admin] PATH_INFO: `/v3/projects/5f70d171d26c491da3cf9f49e6d12ef2` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:43:02.797202 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65607de-1d88-4db8-99a2-3589a51a79c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f70d171d26c491da3cf9f49e6d12ef2)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:43:02.798768 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65607de-1d88-4db8-99a2-3589a51a79c0 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:43:02.857189 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-f65607de-1d88-4db8-99a2-3589a51a79c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f70d171d26c491da3cf9f49e6d12ef2', 'request_id': 'req-f65607de-1d88-4db8-99a2-3589a51a79c0'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:43:02.864102 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-f65607de-1d88-4db8-99a2-3589a51a79c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f70d171d26c491da3cf9f49e6d12ef2', 'request_id': 'req-f65607de-1d88-4db8-99a2-3589a51a79c0'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:43:02.873221 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-f65607de-1d88-4db8-99a2-3589a51a79c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f70d171d26c491da3cf9f49e6d12ef2', 'request_id': 'req-f65607de-1d88-4db8-99a2-3589a51a79c0'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:43:02.885364 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-f65607de-1d88-4db8-99a2-3589a51a79c0 admin admin] The token cache is being invalidate because project 5f70d171d26c491da3cf9f49e6d12ef2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 22:43:02.885656 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-f65607de-1d88-4db8-99a2-3589a51a79c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:43:02.886285 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-f65607de-1d88-4db8-99a2-3589a51a79c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:43:02.887916 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1188/2383] 10.222.0.36 () {58 vars in 1232 bytes} [Fri Jun 24 22:43:02 2022] DELETE /identity/v3/projects/5f70d171d26c491da3cf9f49e6d12ef2 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:43:02.892771 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d18788-2673-46eb-b08d-133249afac11 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:43:02.893058 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d18788-2673-46eb-b08d-133249afac11 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:43:02.893366 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d18788-2673-46eb-b08d-133249afac11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:43:02.911431 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-f7d18788-2673-46eb-b08d-133249afac11 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:43:02.912761 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-f7d18788-2673-46eb-b08d-133249afac11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:43:02.931068 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:43:02.984498 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1196/2384] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:43:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 22:43:02.992336 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2470bc-6bc6-4210-bf6e-2f191fe5eb98 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:43:02.992633 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2470bc-6bc6-4210-bf6e-2f191fe5eb98 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:43:02.992917 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2470bc-6bc6-4210-bf6e-2f191fe5eb98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:43:03.020177 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-1e2470bc-6bc6-4210-bf6e-2f191fe5eb98 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:43:03.021390 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-1e2470bc-6bc6-4210-bf6e-2f191fe5eb98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:43:03.033365 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1189/2385] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:43:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:43:03.034349 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d18788-2673-46eb-b08d-133249afac11 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:43:03.044945 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d18788-2673-46eb-b08d-133249afac11 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:43:03.054325 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8886871-8110-4688-9c33-8e6ebcd074e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:43:03.055407 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8886871-8110-4688-9c33-8e6ebcd074e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:43:03.056488 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8886871-8110-4688-9c33-8e6ebcd074e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:43:03.056779 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8886871-8110-4688-9c33-8e6ebcd074e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:43:03.057534 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8886871-8110-4688-9c33-8e6ebcd074e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:43:03.057843 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8886871-8110-4688-9c33-8e6ebcd074e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:43:03.060195 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8886871-8110-4688-9c33-8e6ebcd074e8 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:43:03.078791 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1197/2386] 10.222.0.36 () {58 vars in 1152 bytes} [Fri Jun 24 22:43:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 22:43:03.081380 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2470bc-6bc6-4210-bf6e-2f191fe5eb98 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:43:03.092548 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2470bc-6bc6-4210-bf6e-2f191fe5eb98 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:43:03.110492 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cc4927-5a7e-4494-b800-0158fb2264b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:43:03.110492 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cc4927-5a7e-4494-b800-0158fb2264b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:43:03.110492 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cc4927-5a7e-4494-b800-0158fb2264b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:43:03.110879 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cc4927-5a7e-4494-b800-0158fb2264b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:43:03.111444 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cc4927-5a7e-4494-b800-0158fb2264b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:43:03.115332 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cc4927-5a7e-4494-b800-0158fb2264b9 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:43:03.150647 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1190/2387] 10.222.0.36 () {60 vars in 1152 bytes} [Fri Jun 24 22:43:03 2022] POST /identity/v3/projects => generated 371 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:43:03.152174 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8886871-8110-4688-9c33-8e6ebcd074e8 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:43:03.162341 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8886871-8110-4688-9c33-8e6ebcd074e8 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:43:03.218346 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd9ff18-762d-48e0-a670-dde9a88132bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:43:03.219021 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd9ff18-762d-48e0-a670-dde9a88132bd admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:43:03.219332 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd9ff18-762d-48e0-a670-dde9a88132bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:43:03.219613 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd9ff18-762d-48e0-a670-dde9a88132bd admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:43:03.220310 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd9ff18-762d-48e0-a670-dde9a88132bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:43:03.222261 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd9ff18-762d-48e0-a670-dde9a88132bd admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:43:03.244529 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1198/2388] 10.222.0.36 () {60 vars in 1143 bytes} [Fri Jun 24 22:43:03 2022] POST /identity/v3/users => generated 286 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:43:03.249770 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cc4927-5a7e-4494-b800-0158fb2264b9 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:43:03.260228 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cc4927-5a7e-4494-b800-0158fb2264b9 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:43:03.265726 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9404cf1c-cade-4040-8e6b-41e487fdb719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:43:03.266482 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9404cf1c-cade-4040-8e6b-41e487fdb719 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:43:03.266856 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9404cf1c-cade-4040-8e6b-41e487fdb719 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:43:03.267142 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9404cf1c-cade-4040-8e6b-41e487fdb719 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:43:03.267921 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9404cf1c-cade-4040-8e6b-41e487fdb719 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:43:03.269766 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9404cf1c-cade-4040-8e6b-41e487fdb719 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:43:03.281917 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1191/2389] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:43:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:43:03.286543 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd9ff18-762d-48e0-a670-dde9a88132bd admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:43:03.296829 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd9ff18-762d-48e0-a670-dde9a88132bd admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:43:03.301179 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dfddfd-d433-4af0-88f6-8d812dc9358f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:43:03.301837 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dfddfd-d433-4af0-88f6-8d812dc9358f admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:43:03.302119 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dfddfd-d433-4af0-88f6-8d812dc9358f admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:43:03.302393 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dfddfd-d433-4af0-88f6-8d812dc9358f admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:43:03.303114 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dfddfd-d433-4af0-88f6-8d812dc9358f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:43:03.304752 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dfddfd-d433-4af0-88f6-8d812dc9358f admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:43:03.321436 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1199/2390] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:43:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:43:03.322690 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9404cf1c-cade-4040-8e6b-41e487fdb719 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:43:03.333108 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9404cf1c-cade-4040-8e6b-41e487fdb719 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:43:03.338373 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9cfd5d-46cf-42b3-b21f-a234fad7fd25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:43:03.339289 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9cfd5d-46cf-42b3-b21f-a234fad7fd25 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:43:03.339573 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9cfd5d-46cf-42b3-b21f-a234fad7fd25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:43:03.339901 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9cfd5d-46cf-42b3-b21f-a234fad7fd25 admin admin] PATH_INFO: `/v3/projects/a3a7f1d0bf2c40d38cd8c896f05ecd4d/users/e8a515e668994caf8813e83acb4f959a/roles/1928787bfcc745419829cd315900ac44` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:43:03.355428 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9cfd5d-46cf-42b3-b21f-a234fad7fd25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3a7f1d0bf2c40d38cd8c896f05ecd4d, user_id=e8a515e668994caf8813e83acb4f959a, role_id=1928787bfcc745419829cd315900ac44)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:43:03.358831 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9cfd5d-46cf-42b3-b21f-a234fad7fd25 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:43:03.373307 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1192/2391] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 22:43:03 2022] PUT /identity/v3/projects/a3a7f1d0bf2c40d38cd8c896f05ecd4d/users/e8a515e668994caf8813e83acb4f959a/roles/1928787bfcc745419829cd315900ac44 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:43:03.384320 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66102c14-be4f-4aee-ab95-c2ca9e453710 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:43:03.384607 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66102c14-be4f-4aee-ab95-c2ca9e453710 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:43:03.384880 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66102c14-be4f-4aee-ab95-c2ca9e453710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:43:03.413182 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-66102c14-be4f-4aee-ab95-c2ca9e453710 None None] MFA Rules not processed for user `e8a515e668994caf8813e83acb4f959a`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:43:03.414508 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-66102c14-be4f-4aee-ab95-c2ca9e453710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:43:03.486705 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1200/2392] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:43:03 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:43:03.499434 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9cfd5d-46cf-42b3-b21f-a234fad7fd25 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:43:03.501451 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-fe9cfd5d-46cf-42b3-b21f-a234fad7fd25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:43:03.534163 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:43:03.584653 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9cfd5d-46cf-42b3-b21f-a234fad7fd25 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:43:03.589711 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134c9f86-ce26-40c6-a3df-be2ad3878c57 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd156158fa06647569a8bb2d8d0019f28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:43:03.590421 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134c9f86-ce26-40c6-a3df-be2ad3878c57 service glance] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:43:03.590670 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134c9f86-ce26-40c6-a3df-be2ad3878c57 service glance] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:43:03.590942 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134c9f86-ce26-40c6-a3df-be2ad3878c57 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:43:03.603806 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134c9f86-ce26-40c6-a3df-be2ad3878c57 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:43:03.605723 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134c9f86-ce26-40c6-a3df-be2ad3878c57 service glance] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:43:03.619813 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1193/2393] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:43:03 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:43:05.905020 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57575a8-317b-4375-b595-fe2efbf42e2c None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:43:05.905565 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57575a8-317b-4375-b595-fe2efbf42e2c None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:43:05.905565 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57575a8-317b-4375-b595-fe2efbf42e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:43:05.923169 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-f57575a8-317b-4375-b595-fe2efbf42e2c None None] MFA Rules not processed for user `d38e573b57c147afa87ba5aceb21f73b`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:43:05.924584 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-f57575a8-317b-4375-b595-fe2efbf42e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:43:05.938129 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:43:05.985574 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1201/2394] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:43:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:43:13.615128 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=17 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:43:15.977956 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=17 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:43:54.437750 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134c9f86-ce26-40c6-a3df-be2ad3878c57 service glance] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:43:54.439579 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-134c9f86-ce26-40c6-a3df-be2ad3878c57 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:43:54.500125 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134c9f86-ce26-40c6-a3df-be2ad3878c57 service glance] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:43:54.504621 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e37cfaa-43e5-4526-994b-b77d397012be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:43:54.505268 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e37cfaa-43e5-4526-994b-b77d397012be service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:43:54.505553 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e37cfaa-43e5-4526-994b-b77d397012be service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:43:54.505826 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e37cfaa-43e5-4526-994b-b77d397012be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:43:54.508107 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-1e37cfaa-43e5-4526-994b-b77d397012be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:43:54.600711 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e37cfaa-43e5-4526-994b-b77d397012be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:43:54.602948 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e37cfaa-43e5-4526-994b-b77d397012be service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:43:54.626359 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1194/2395] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:43:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:43:54.948703 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57575a8-317b-4375-b595-fe2efbf42e2c None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:43:54.960190 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57575a8-317b-4375-b595-fe2efbf42e2c None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:43:54.965113 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fda333b-46fc-4101-be85-0d8d6fe7724b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:43:54.965768 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fda333b-46fc-4101-be85-0d8d6fe7724b service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:43:54.966106 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fda333b-46fc-4101-be85-0d8d6fe7724b service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:43:54.966375 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fda333b-46fc-4101-be85-0d8d6fe7724b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:43:54.968652 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-4fda333b-46fc-4101-be85-0d8d6fe7724b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:43:54.983190 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fda333b-46fc-4101-be85-0d8d6fe7724b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:43:54.984689 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fda333b-46fc-4101-be85-0d8d6fe7724b service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:43:54.995806 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1202/2396] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:43:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:44:04.622765 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=63 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:44:04.644853 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e37cfaa-43e5-4526-994b-b77d397012be service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:44:04.647378 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-1e37cfaa-43e5-4526-994b-b77d397012be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:44:04.669401 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e37cfaa-43e5-4526-994b-b77d397012be service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:44:04.676826 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95465bd-f0be-4f34-89ea-88a09bca566d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214d9071042c4bad886bf060a079b6e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:44:04.677482 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95465bd-f0be-4f34-89ea-88a09bca566d service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:44:04.677738 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95465bd-f0be-4f34-89ea-88a09bca566d service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:44:04.678040 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95465bd-f0be-4f34-89ea-88a09bca566d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:44:04.680223 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-b95465bd-f0be-4f34-89ea-88a09bca566d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:44:04.695026 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95465bd-f0be-4f34-89ea-88a09bca566d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:44:04.696678 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95465bd-f0be-4f34-89ea-88a09bca566d service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:44:04.707818 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1195/2397] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:44:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:44:04.990720 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=6 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:44:09.792570 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fda333b-46fc-4101-be85-0d8d6fe7724b service neutron] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:44:09.794076 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-4fda333b-46fc-4101-be85-0d8d6fe7724b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:44:09.862314 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fda333b-46fc-4101-be85-0d8d6fe7724b service neutron] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:44:09.866236 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370a9892-393b-4f7b-8a7e-5cdb7fff0f89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a747e2a5684843a6ee9e3480badac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:44:09.867044 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370a9892-393b-4f7b-8a7e-5cdb7fff0f89 service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:44:09.867171 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370a9892-393b-4f7b-8a7e-5cdb7fff0f89 service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:44:09.867588 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370a9892-393b-4f7b-8a7e-5cdb7fff0f89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:44:09.869626 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-370a9892-393b-4f7b-8a7e-5cdb7fff0f89 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:44:09.931916 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370a9892-393b-4f7b-8a7e-5cdb7fff0f89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:44:09.933355 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370a9892-393b-4f7b-8a7e-5cdb7fff0f89 service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:44:09.943027 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1203/2398] 10.222.0.36 () {60 vars in 1396 bytes} [Fri Jun 24 22:44:09 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3260 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:44:10.910739 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95465bd-f0be-4f34-89ea-88a09bca566d service nova] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:44:10.923953 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95465bd-f0be-4f34-89ea-88a09bca566d service nova] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:44:10.928429 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc922668-8b0a-4c38-88de-4a479a819385 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:44:10.929066 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc922668-8b0a-4c38-88de-4a479a819385 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:44:10.929347 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc922668-8b0a-4c38-88de-4a479a819385 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:44:10.929616 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc922668-8b0a-4c38-88de-4a479a819385 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:44:10.931564 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-fc922668-8b0a-4c38-88de-4a479a819385 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:44:11.001897 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc922668-8b0a-4c38-88de-4a479a819385 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:44:11.003377 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc922668-8b0a-4c38-88de-4a479a819385 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:44:11.013196 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1196/2399] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:44:10 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:44:11.134194 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370a9892-393b-4f7b-8a7e-5cdb7fff0f89 service cinder] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:44:11.136153 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-370a9892-393b-4f7b-8a7e-5cdb7fff0f89 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:44:11.156165 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370a9892-393b-4f7b-8a7e-5cdb7fff0f89 service cinder] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:44:11.162885 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9649789-9a51-4d47-a497-556c74f747e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214d9071042c4bad886bf060a079b6e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:44:11.163600 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9649789-9a51-4d47-a497-556c74f747e2 service nova] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:44:11.163883 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9649789-9a51-4d47-a497-556c74f747e2 service nova] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:44:11.164153 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9649789-9a51-4d47-a497-556c74f747e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:44:11.166627 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-d9649789-9a51-4d47-a497-556c74f747e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:44:11.231929 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9649789-9a51-4d47-a497-556c74f747e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:44:11.233615 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9649789-9a51-4d47-a497-556c74f747e2 service nova] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:44:11.243192 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1204/2400] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:44:11 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:44:12.725057 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f464b301-d280-48c1-b06b-75a72f7e5872 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:44:12.725861 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f464b301-d280-48c1-b06b-75a72f7e5872 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:44:12.725861 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f464b301-d280-48c1-b06b-75a72f7e5872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:44:12.744348 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-f464b301-d280-48c1-b06b-75a72f7e5872 None None] MFA Rules not processed for user `542ea2e5a8114792836d0cdfd36b4c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:44:12.745557 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-f464b301-d280-48c1-b06b-75a72f7e5872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:44:12.808244 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1197/2401] 10.222.0.36 () {58 vars in 1009 bytes} [Fri Jun 24 22:44:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 22:44:12.855927 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9649789-9a51-4d47-a497-556c74f747e2 service nova] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:44:12.857648 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-d9649789-9a51-4d47-a497-556c74f747e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:44:12.931885 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:44:12.950146 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9649789-9a51-4d47-a497-556c74f747e2 service nova] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:44:12.955048 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e83a26-5e0b-4b69-8280-aa36e6d9121c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b95846f7f2a453f85ddb41a5d3327f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:44:12.955770 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e83a26-5e0b-4b69-8280-aa36e6d9121c service swift] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:44:12.956066 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e83a26-5e0b-4b69-8280-aa36e6d9121c service swift] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:44:12.956330 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e83a26-5e0b-4b69-8280-aa36e6d9121c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:44:12.965883 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e83a26-5e0b-4b69-8280-aa36e6d9121c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:44:12.967852 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e83a26-5e0b-4b69-8280-aa36e6d9121c service swift] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:44:12.976484 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1205/2402] 10.222.0.36 () {60 vars in 1384 bytes} [Fri Jun 24 22:44:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 22:44:22.800741 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=61 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:44:22.973070 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=8 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:44:26.521552 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f464b301-d280-48c1-b06b-75a72f7e5872 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:44:26.531838 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f464b301-d280-48c1-b06b-75a72f7e5872 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:44:26.536613 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0a9b60-641e-41a4-ac78-c4d85fc03a24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:44:26.537315 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a9b60-641e-41a4-ac78-c4d85fc03a24 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:44:26.537599 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a9b60-641e-41a4-ac78-c4d85fc03a24 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:44:26.537879 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a9b60-641e-41a4-ac78-c4d85fc03a24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:44:26.540071 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-db0a9b60-641e-41a4-ac78-c4d85fc03a24 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:44:26.551098 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0a9b60-641e-41a4-ac78-c4d85fc03a24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:44:26.552576 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0a9b60-641e-41a4-ac78-c4d85fc03a24 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:44:26.561092 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1198/2403] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:44:26 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:44:30.912920 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e83a26-5e0b-4b69-8280-aa36e6d9121c service swift] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:44:30.926165 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e83a26-5e0b-4b69-8280-aa36e6d9121c service swift] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:44:30.930546 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547ad3d8-6ac8-46e2-83f3-f5c8f50540f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:44:30.931180 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547ad3d8-6ac8-46e2-83f3-f5c8f50540f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:44:30.931488 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547ad3d8-6ac8-46e2-83f3-f5c8f50540f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:44:30.931765 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547ad3d8-6ac8-46e2-83f3-f5c8f50540f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:44:30.933791 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-547ad3d8-6ac8-46e2-83f3-f5c8f50540f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:44:30.943870 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547ad3d8-6ac8-46e2-83f3-f5c8f50540f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:44:30.945301 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547ad3d8-6ac8-46e2-83f3-f5c8f50540f2 service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:44:30.953576 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1206/2404] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:44:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:44:31.061358 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d91f75-042b-4994-99fe-6ec8f560beaa None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:44:31.061942 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d91f75-042b-4994-99fe-6ec8f560beaa None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:44:31.061942 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d91f75-042b-4994-99fe-6ec8f560beaa None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:44:31.063470 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1199/2405] 10.222.0.36 () {54 vars in 921 bytes} [Fri Jun 24 22:44:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:44:31.069925 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea90db6-16f2-4395-a307-0510f1269e95 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:44:31.070301 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea90db6-16f2-4395-a307-0510f1269e95 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:44:31.070648 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea90db6-16f2-4395-a307-0510f1269e95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:44:31.108787 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-9ea90db6-16f2-4395-a307-0510f1269e95 None None] MFA Rules not processed for user `214d9071042c4bad886bf060a079b6e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:44:31.110049 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-9ea90db6-16f2-4395-a307-0510f1269e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:44:31.119816 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1207/2406] 10.222.0.36 () {58 vars in 1018 bytes} [Fri Jun 24 22:44:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:44:31.131769 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d91f75-042b-4994-99fe-6ec8f560beaa None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:44:31.142618 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d91f75-042b-4994-99fe-6ec8f560beaa None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:44:31.146332 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4d4ab0-1b33-40e0-91f6-183a932e9248 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd156158fa06647569a8bb2d8d0019f28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:44:31.146974 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4d4ab0-1b33-40e0-91f6-183a932e9248 service glance] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:44:31.147286 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4d4ab0-1b33-40e0-91f6-183a932e9248 service glance] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:44:31.147567 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4d4ab0-1b33-40e0-91f6-183a932e9248 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:44:31.157741 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4d4ab0-1b33-40e0-91f6-183a932e9248 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:44:31.159224 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4d4ab0-1b33-40e0-91f6-183a932e9248 service glance] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:44:31.169909 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1200/2407] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:44:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:44:31.242208 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccfbf90-dd7a-43b4-bc9d-390d83c64936 None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:44:31.242500 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccfbf90-dd7a-43b4-bc9d-390d83c64936 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:44:31.242785 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccfbf90-dd7a-43b4-bc9d-390d83c64936 None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:44:31.244242 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1208/2408] 10.222.0.36 () {54 vars in 921 bytes} [Fri Jun 24 22:44:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:44:31.250410 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693958d1-d4cf-4635-b488-4557149ef63e None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:44:31.250980 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693958d1-d4cf-4635-b488-4557149ef63e None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:44:31.251320 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693958d1-d4cf-4635-b488-4557149ef63e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:44:31.270398 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-693958d1-d4cf-4635-b488-4557149ef63e None None] MFA Rules not processed for user `b78f1fcce4174d1a931453d930d306f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:44:31.271612 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-693958d1-d4cf-4635-b488-4557149ef63e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:44:31.278686 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1201/2409] 10.222.0.36 () {58 vars in 1018 bytes} [Fri Jun 24 22:44:31 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:44:31.292387 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccfbf90-dd7a-43b4-bc9d-390d83c64936 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:44:31.294401 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-2ccfbf90-dd7a-43b4-bc9d-390d83c64936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:44:31.312877 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccfbf90-dd7a-43b4-bc9d-390d83c64936 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:44:31.317196 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e000d6d4-a148-4a4d-b9df-418680c49a01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:44:31.317850 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e000d6d4-a148-4a4d-b9df-418680c49a01 service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:44:31.318162 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e000d6d4-a148-4a4d-b9df-418680c49a01 service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:44:31.318440 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e000d6d4-a148-4a4d-b9df-418680c49a01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:44:31.326070 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e000d6d4-a148-4a4d-b9df-418680c49a01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:44:31.327574 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e000d6d4-a148-4a4d-b9df-418680c49a01 service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:44:31.336117 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1209/2410] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:44:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:44:31.456110 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d330a07-4fdf-47b3-a5db-c118ec1ff056 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:44:31.456398 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d330a07-4fdf-47b3-a5db-c118ec1ff056 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:44:31.456676 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d330a07-4fdf-47b3-a5db-c118ec1ff056 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:44:31.458175 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1202/2411] 10.222.0.36 () {54 vars in 921 bytes} [Fri Jun 24 22:44:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:44:31.464278 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046a3454-4e25-4182-bf06-c5a29fc62d20 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:44:31.464601 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046a3454-4e25-4182-bf06-c5a29fc62d20 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:44:31.464874 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046a3454-4e25-4182-bf06-c5a29fc62d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:44:31.484235 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-046a3454-4e25-4182-bf06-c5a29fc62d20 None None] MFA Rules not processed for user `214d9071042c4bad886bf060a079b6e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:44:31.485686 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-046a3454-4e25-4182-bf06-c5a29fc62d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:44:31.495199 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1210/2412] 10.222.0.36 () {58 vars in 1018 bytes} [Fri Jun 24 22:44:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:44:31.506585 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d330a07-4fdf-47b3-a5db-c118ec1ff056 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:44:31.518034 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d330a07-4fdf-47b3-a5db-c118ec1ff056 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:44:31.521589 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3eea92-e580-484f-a8b4-f29e69bde7c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:44:31.522226 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3eea92-e580-484f-a8b4-f29e69bde7c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:44:31.522505 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3eea92-e580-484f-a8b4-f29e69bde7c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:44:31.522779 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3eea92-e580-484f-a8b4-f29e69bde7c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:44:31.532880 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3eea92-e580-484f-a8b4-f29e69bde7c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:44:31.534266 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3eea92-e580-484f-a8b4-f29e69bde7c6 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:44:31.544765 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1203/2413] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:44:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:44:31.615864 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046a3454-4e25-4182-bf06-c5a29fc62d20 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:44:31.617374 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-046a3454-4e25-4182-bf06-c5a29fc62d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:44:31.689626 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046a3454-4e25-4182-bf06-c5a29fc62d20 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:44:31.695445 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07fe9ba-cf44-446e-ac37-f7c5602f66d1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0233b357708643be94c0ade17ac1fb3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:44:31.696137 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07fe9ba-cf44-446e-ac37-f7c5602f66d1 service placement] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:44:31.696422 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07fe9ba-cf44-446e-ac37-f7c5602f66d1 service placement] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:44:31.696700 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07fe9ba-cf44-446e-ac37-f7c5602f66d1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:44:31.698720 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-e07fe9ba-cf44-446e-ac37-f7c5602f66d1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:44:31.711396 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07fe9ba-cf44-446e-ac37-f7c5602f66d1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:44:31.713012 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07fe9ba-cf44-446e-ac37-f7c5602f66d1 service placement] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:44:31.724775 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1211/2414] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:44:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:44:41.540342 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=21 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:44:41.719123 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=56 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:45:38.874291 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3eea92-e580-484f-a8b4-f29e69bde7c6 service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:45:38.885822 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3eea92-e580-484f-a8b4-f29e69bde7c6 service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:45:38.893338 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da611fc-5e6d-450a-a924-f8ae6e87b8dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214d9071042c4bad886bf060a079b6e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:45:38.894029 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da611fc-5e6d-450a-a924-f8ae6e87b8dc service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:45:38.894393 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da611fc-5e6d-450a-a924-f8ae6e87b8dc service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:45:38.894829 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da611fc-5e6d-450a-a924-f8ae6e87b8dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:45:38.896687 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-2da611fc-5e6d-450a-a924-f8ae6e87b8dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:45:38.911314 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da611fc-5e6d-450a-a924-f8ae6e87b8dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:45:38.913007 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da611fc-5e6d-450a-a924-f8ae6e87b8dc service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:45:38.924448 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1204/2415] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:45:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:45:48.919987 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=6 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:46:10.677764 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07fe9ba-cf44-446e-ac37-f7c5602f66d1 service placement] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:46:10.690371 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07fe9ba-cf44-446e-ac37-f7c5602f66d1 service placement] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:46:10.696365 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3508d53c-0299-421e-b109-e4bfd9ddb4e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214d9071042c4bad886bf060a079b6e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:46:10.697056 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3508d53c-0299-421e-b109-e4bfd9ddb4e3 service nova] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:46:10.697292 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3508d53c-0299-421e-b109-e4bfd9ddb4e3 service nova] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:46:10.697583 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3508d53c-0299-421e-b109-e4bfd9ddb4e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:46:10.699495 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-3508d53c-0299-421e-b109-e4bfd9ddb4e3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:46:10.712161 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3508d53c-0299-421e-b109-e4bfd9ddb4e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:46:10.716369 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3508d53c-0299-421e-b109-e4bfd9ddb4e3 service nova] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:46:10.728163 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1212/2416] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:46:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:46:20.723941 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=6 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:47:05.126257 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da611fc-5e6d-450a-a924-f8ae6e87b8dc service nova] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:47:05.127939 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-2da611fc-5e6d-450a-a924-f8ae6e87b8dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:47:05.140405 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da611fc-5e6d-450a-a924-f8ae6e87b8dc service nova] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:47:05.145016 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da53f51-26db-41a7-bfa7-b24c118e0f13 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a747e2a5684843a6ee9e3480badac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:47:05.145665 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da53f51-26db-41a7-bfa7-b24c118e0f13 service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:47:05.145945 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da53f51-26db-41a7-bfa7-b24c118e0f13 service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:47:05.146249 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da53f51-26db-41a7-bfa7-b24c118e0f13 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:47:05.148371 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-7da53f51-26db-41a7-bfa7-b24c118e0f13 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:47:05.208333 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da53f51-26db-41a7-bfa7-b24c118e0f13 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:47:05.209788 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da53f51-26db-41a7-bfa7-b24c118e0f13 service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:47:05.218721 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1205/2417] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:47:05 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:47:09.930496 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3508d53c-0299-421e-b109-e4bfd9ddb4e3 service nova] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:47:09.944456 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3508d53c-0299-421e-b109-e4bfd9ddb4e3 service nova] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:47:09.950920 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e53d39-a2d1-4674-b55b-5b0a32e538b5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0233b357708643be94c0ade17ac1fb3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:47:09.951700 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e53d39-a2d1-4674-b55b-5b0a32e538b5 service placement] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:47:09.951941 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e53d39-a2d1-4674-b55b-5b0a32e538b5 service placement] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:47:09.952227 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e53d39-a2d1-4674-b55b-5b0a32e538b5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:47:09.954120 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-55e53d39-a2d1-4674-b55b-5b0a32e538b5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:47:09.973270 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e53d39-a2d1-4674-b55b-5b0a32e538b5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:47:09.974890 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e53d39-a2d1-4674-b55b-5b0a32e538b5 service placement] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:47:09.989211 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1213/2418] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:47:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:47:15.214645 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=28 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:47:19.982404 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=6 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:47:23.787840 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da53f51-26db-41a7-bfa7-b24c118e0f13 service cinder] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:47:23.801459 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da53f51-26db-41a7-bfa7-b24c118e0f13 service cinder] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:47:23.807982 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daa57dd-8ebe-4e6b-a36d-44529ad085bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214d9071042c4bad886bf060a079b6e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:47:23.808638 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa57dd-8ebe-4e6b-a36d-44529ad085bf service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:47:23.808920 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa57dd-8ebe-4e6b-a36d-44529ad085bf service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:47:23.809192 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa57dd-8ebe-4e6b-a36d-44529ad085bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:47:23.811147 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-8daa57dd-8ebe-4e6b-a36d-44529ad085bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:47:23.873931 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daa57dd-8ebe-4e6b-a36d-44529ad085bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:47:23.875570 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daa57dd-8ebe-4e6b-a36d-44529ad085bf service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:47:23.886153 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1206/2419] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:47:23 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:47:33.881473 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=28 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:48:03.379191 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e53d39-a2d1-4674-b55b-5b0a32e538b5 service placement] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:48:03.393462 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e53d39-a2d1-4674-b55b-5b0a32e538b5 service placement] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:48:03.398114 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b02c85a-7dc9-42e4-846d-320c886c2285 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a747e2a5684843a6ee9e3480badac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:48:03.398762 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b02c85a-7dc9-42e4-846d-320c886c2285 service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:48:03.399046 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b02c85a-7dc9-42e4-846d-320c886c2285 service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:48:03.399339 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b02c85a-7dc9-42e4-846d-320c886c2285 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:48:03.409219 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b02c85a-7dc9-42e4-846d-320c886c2285 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:48:03.410651 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b02c85a-7dc9-42e4-846d-320c886c2285 service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:48:03.419902 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1214/2420] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:48:03 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:48:13.415659 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=6 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:48:55.376151 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daa57dd-8ebe-4e6b-a36d-44529ad085bf service nova] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:48:55.385978 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daa57dd-8ebe-4e6b-a36d-44529ad085bf service nova] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:48:55.390152 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e791114-3a9e-47c7-a66c-434a8d6b5d65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:48:55.390792 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e791114-3a9e-47c7-a66c-434a8d6b5d65 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:48:55.391075 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e791114-3a9e-47c7-a66c-434a8d6b5d65 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:48:55.391370 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e791114-3a9e-47c7-a66c-434a8d6b5d65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:48:55.402067 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e791114-3a9e-47c7-a66c-434a8d6b5d65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:48:55.403545 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e791114-3a9e-47c7-a66c-434a8d6b5d65 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:48:55.414682 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1207/2421] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:48:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:48:56.609921 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b02c85a-7dc9-42e4-846d-320c886c2285 service cinder] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:48:56.620670 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b02c85a-7dc9-42e4-846d-320c886c2285 service cinder] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:48:56.625924 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f0d74f-f4b4-42ea-b44e-4f5159303b9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:48:56.626569 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f0d74f-f4b4-42ea-b44e-4f5159303b9a service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:48:56.626856 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f0d74f-f4b4-42ea-b44e-4f5159303b9a service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:48:56.627138 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f0d74f-f4b4-42ea-b44e-4f5159303b9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:48:56.638435 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f0d74f-f4b4-42ea-b44e-4f5159303b9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:48:56.640384 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f0d74f-f4b4-42ea-b44e-4f5159303b9a service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:48:56.651634 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1215/2422] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:48:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:49:05.216814 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e791114-3a9e-47c7-a66c-434a8d6b5d65 service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:49:05.229453 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e791114-3a9e-47c7-a66c-434a8d6b5d65 service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:49:05.237122 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1236fe7-39ae-4f93-be16-1a68aaea9bd8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214d9071042c4bad886bf060a079b6e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:49:05.237779 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1236fe7-39ae-4f93-be16-1a68aaea9bd8 service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:49:05.238064 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1236fe7-39ae-4f93-be16-1a68aaea9bd8 service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:49:05.238343 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1236fe7-39ae-4f93-be16-1a68aaea9bd8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:49:05.247978 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1236fe7-39ae-4f93-be16-1a68aaea9bd8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:49:05.249644 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1236fe7-39ae-4f93-be16-1a68aaea9bd8 service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:49:05.279010 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1208/2423] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:49:05 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:49:06.646601 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=6 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:49:09.713267 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f0d74f-f4b4-42ea-b44e-4f5159303b9a service neutron] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:49:09.724101 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f0d74f-f4b4-42ea-b44e-4f5159303b9a service neutron] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:49:09.728751 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bae4b3-1f49-4cc2-b635-9aa68cfb101d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a747e2a5684843a6ee9e3480badac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:49:09.729895 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bae4b3-1f49-4cc2-b635-9aa68cfb101d service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:49:09.729895 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bae4b3-1f49-4cc2-b635-9aa68cfb101d service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:49:09.730106 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bae4b3-1f49-4cc2-b635-9aa68cfb101d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:49:09.739864 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bae4b3-1f49-4cc2-b635-9aa68cfb101d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:49:09.741425 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bae4b3-1f49-4cc2-b635-9aa68cfb101d service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:49:09.771588 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1216/2424] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:49:09 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:49:10.837783 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1236fe7-39ae-4f93-be16-1a68aaea9bd8 service nova] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:49:10.850879 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1236fe7-39ae-4f93-be16-1a68aaea9bd8 service nova] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:49:10.857293 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bb6196-52b6-4d03-aa3a-b7b0e6010c14 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214d9071042c4bad886bf060a079b6e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:49:10.857756 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bb6196-52b6-4d03-aa3a-b7b0e6010c14 service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:49:10.858041 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bb6196-52b6-4d03-aa3a-b7b0e6010c14 service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:49:10.858421 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bb6196-52b6-4d03-aa3a-b7b0e6010c14 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:49:10.870224 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bb6196-52b6-4d03-aa3a-b7b0e6010c14 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:49:10.870224 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bb6196-52b6-4d03-aa3a-b7b0e6010c14 service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:49:10.903591 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1209/2425] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:49:10 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 22:49:19.768499 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=13 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:49:20.900674 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=32 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:50:10.611735 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bae4b3-1f49-4cc2-b635-9aa68cfb101d service cinder] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:50:10.621476 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bae4b3-1f49-4cc2-b635-9aa68cfb101d service cinder] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:50:10.625535 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e75415-3d88-4648-b78f-d01742b2691c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:50:10.626251 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e75415-3d88-4648-b78f-d01742b2691c service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:50:10.626591 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e75415-3d88-4648-b78f-d01742b2691c service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:50:10.626930 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e75415-3d88-4648-b78f-d01742b2691c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:50:10.634474 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e75415-3d88-4648-b78f-d01742b2691c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:50:10.636172 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e75415-3d88-4648-b78f-d01742b2691c service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:50:10.644510 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1217/2426] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:50:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:50:20.641106 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=6 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:50:32.591998 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ecddd-7d75-4320-85a9-4e02f58376d2 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:50:32.592533 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ecddd-7d75-4320-85a9-4e02f58376d2 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:50:32.592533 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ecddd-7d75-4320-85a9-4e02f58376d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:50:32.611022 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-727ecddd-7d75-4320-85a9-4e02f58376d2 None None] MFA Rules not processed for user `542ea2e5a8114792836d0cdfd36b4c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:50:32.612268 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-727ecddd-7d75-4320-85a9-4e02f58376d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:50:32.621050 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1210/2427] 10.222.0.36 () {58 vars in 967 bytes} [Fri Jun 24 22:50:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:50:32.688140 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e75415-3d88-4648-b78f-d01742b2691c service neutron] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:50:32.701254 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e75415-3d88-4648-b78f-d01742b2691c service neutron] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:50:32.706754 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139666a0-c6db-414c-a04e-dce9021ccfcc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b95846f7f2a453f85ddb41a5d3327f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:50:32.707426 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139666a0-c6db-414c-a04e-dce9021ccfcc service swift] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:50:32.707709 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139666a0-c6db-414c-a04e-dce9021ccfcc service swift] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:50:32.707981 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139666a0-c6db-414c-a04e-dce9021ccfcc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:50:32.716377 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139666a0-c6db-414c-a04e-dce9021ccfcc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:50:32.717980 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139666a0-c6db-414c-a04e-dce9021ccfcc service swift] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:50:32.726388 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1218/2428] 10.222.0.36 () {60 vars in 1384 bytes} [Fri Jun 24 22:50:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 22:50:35.022833 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb0161c-4589-4586-b3e2-0b11ff406fe5 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:50:35.023458 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb0161c-4589-4586-b3e2-0b11ff406fe5 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:50:35.023458 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb0161c-4589-4586-b3e2-0b11ff406fe5 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:50:35.024935 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1211/2429] 10.222.0.36 () {54 vars in 912 bytes} [Fri Jun 24 22:50:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 22:50:35.030826 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f3d984-6923-44c0-a5f6-d102cb06ab65 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:50:35.032011 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f3d984-6923-44c0-a5f6-d102cb06ab65 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:50:35.032458 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f3d984-6923-44c0-a5f6-d102cb06ab65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:50:35.075544 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-95f3d984-6923-44c0-a5f6-d102cb06ab65 None None] MFA Rules not processed for user `0233b357708643be94c0ade17ac1fb3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:50:35.076853 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-95f3d984-6923-44c0-a5f6-d102cb06ab65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:50:35.087342 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1219/2430] 10.222.0.36 () {58 vars in 1009 bytes} [Fri Jun 24 22:50:35 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 22:50:35.118507 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb0161c-4589-4586-b3e2-0b11ff406fe5 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:50:35.132849 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb0161c-4589-4586-b3e2-0b11ff406fe5 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:50:35.138322 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b511172d-0b64-4f25-ac8d-6b5e42062bab service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0233b357708643be94c0ade17ac1fb3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:50:35.139047 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b511172d-0b64-4f25-ac8d-6b5e42062bab service placement] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:50:35.139535 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b511172d-0b64-4f25-ac8d-6b5e42062bab service placement] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:50:35.140022 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b511172d-0b64-4f25-ac8d-6b5e42062bab service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:50:35.149594 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b511172d-0b64-4f25-ac8d-6b5e42062bab service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:50:35.151460 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b511172d-0b64-4f25-ac8d-6b5e42062bab service placement] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:50:35.166810 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1212/2431] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:50:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:50:37.473058 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e41cd0-7ce3-412e-b93c-46851a036ad8 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:50:37.473577 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e41cd0-7ce3-412e-b93c-46851a036ad8 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:50:37.473577 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e41cd0-7ce3-412e-b93c-46851a036ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:50:37.518568 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-10e41cd0-7ce3-412e-b93c-46851a036ad8 None None] MFA Rules not processed for user `a3b0839709774ee6854a51acc7fd79f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:50:37.519796 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-10e41cd0-7ce3-412e-b93c-46851a036ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:50:37.527194 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1220/2432] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:50:37 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:50:37.838953 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b511172d-0b64-4f25-ac8d-6b5e42062bab service placement] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:50:37.848972 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b511172d-0b64-4f25-ac8d-6b5e42062bab service placement] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:50:37.853461 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e12601-052b-4e94-bf0f-797a29d25cad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:50:37.854085 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e12601-052b-4e94-bf0f-797a29d25cad service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:50:37.854421 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e12601-052b-4e94-bf0f-797a29d25cad service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:50:37.854697 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e12601-052b-4e94-bf0f-797a29d25cad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:50:37.862586 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e12601-052b-4e94-bf0f-797a29d25cad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:50:37.864050 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e12601-052b-4e94-bf0f-797a29d25cad service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:50:37.873015 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1213/2433] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:50:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:50:39.232825 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e41cd0-7ce3-412e-b93c-46851a036ad8 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:50:39.234398 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-10e41cd0-7ce3-412e-b93c-46851a036ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:50:39.253938 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e41cd0-7ce3-412e-b93c-46851a036ad8 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:50:39.260874 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4781e46a-6e5e-44e7-8840-b9edc0e7d320 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0233b357708643be94c0ade17ac1fb3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:50:39.261544 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4781e46a-6e5e-44e7-8840-b9edc0e7d320 service placement] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:50:39.261828 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4781e46a-6e5e-44e7-8840-b9edc0e7d320 service placement] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:50:39.262201 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4781e46a-6e5e-44e7-8840-b9edc0e7d320 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:50:39.272942 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4781e46a-6e5e-44e7-8840-b9edc0e7d320 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:50:39.274666 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4781e46a-6e5e-44e7-8840-b9edc0e7d320 service placement] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:50:39.285111 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1221/2434] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:50:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:50:42.128484 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e12601-052b-4e94-bf0f-797a29d25cad service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:50:42.145111 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e12601-052b-4e94-bf0f-797a29d25cad service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:50:42.152509 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3564609c-11b3-4849-b28b-6b47b048f0b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214d9071042c4bad886bf060a079b6e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:50:42.153186 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3564609c-11b3-4849-b28b-6b47b048f0b4 service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:50:42.153473 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3564609c-11b3-4849-b28b-6b47b048f0b4 service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:50:42.153759 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3564609c-11b3-4849-b28b-6b47b048f0b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:50:42.173353 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3564609c-11b3-4849-b28b-6b47b048f0b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:50:42.175168 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3564609c-11b3-4849-b28b-6b47b048f0b4 service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:50:42.188046 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1214/2435] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:50:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:50:48.684678 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4781e46a-6e5e-44e7-8840-b9edc0e7d320 service placement] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:50:48.699344 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4781e46a-6e5e-44e7-8840-b9edc0e7d320 service placement] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:50:48.708809 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7f975a-03b1-4889-9dc7-677657380a33 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214d9071042c4bad886bf060a079b6e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:50:48.708809 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7f975a-03b1-4889-9dc7-677657380a33 service nova] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:50:48.708809 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7f975a-03b1-4889-9dc7-677657380a33 service nova] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:50:48.708809 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7f975a-03b1-4889-9dc7-677657380a33 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:50:48.712809 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-1e7f975a-03b1-4889-9dc7-677657380a33 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:50:48.726747 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7f975a-03b1-4889-9dc7-677657380a33 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:50:48.728640 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7f975a-03b1-4889-9dc7-677657380a33 service nova] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:50:48.741375 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1222/2436] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:50:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:50:52.182226 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=21 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:50:58.736060 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=38 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:52:05.254137 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3564609c-11b3-4849-b28b-6b47b048f0b4 service nova] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:52:05.274172 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3564609c-11b3-4849-b28b-6b47b048f0b4 service nova] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:52:05.278320 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c974c7c-d2ba-4341-b700-ebc801ab2228 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a747e2a5684843a6ee9e3480badac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:52:05.278953 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c974c7c-d2ba-4341-b700-ebc801ab2228 service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:52:05.279263 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c974c7c-d2ba-4341-b700-ebc801ab2228 service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:52:05.279546 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c974c7c-d2ba-4341-b700-ebc801ab2228 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:52:05.304702 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c974c7c-d2ba-4341-b700-ebc801ab2228 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:52:05.307349 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c974c7c-d2ba-4341-b700-ebc801ab2228 service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:52:05.340889 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1215/2437] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:52:05 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:52:13.944754 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7f975a-03b1-4889-9dc7-677657380a33 service nova] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:52:14.009569 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7f975a-03b1-4889-9dc7-677657380a33 service nova] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:52:14.015612 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a149dee9-dfcc-40f4-874a-f9740b9fd07d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0233b357708643be94c0ade17ac1fb3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:52:14.016255 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a149dee9-dfcc-40f4-874a-f9740b9fd07d service placement] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:52:14.016539 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a149dee9-dfcc-40f4-874a-f9740b9fd07d service placement] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:52:14.016816 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a149dee9-dfcc-40f4-874a-f9740b9fd07d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:52:14.026119 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a149dee9-dfcc-40f4-874a-f9740b9fd07d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:52:14.027755 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a149dee9-dfcc-40f4-874a-f9740b9fd07d service placement] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:52:14.038236 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1223/2438] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:52:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:52:15.337798 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=24 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:52:23.754352 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c974c7c-d2ba-4341-b700-ebc801ab2228 service cinder] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:52:23.776172 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c974c7c-d2ba-4341-b700-ebc801ab2228 service cinder] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:52:23.780500 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647ebcc9-fc0d-456e-8608-92c2e97bf251 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a747e2a5684843a6ee9e3480badac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:52:23.781150 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ebcc9-fc0d-456e-8608-92c2e97bf251 service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:52:23.781437 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ebcc9-fc0d-456e-8608-92c2e97bf251 service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:52:23.781711 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ebcc9-fc0d-456e-8608-92c2e97bf251 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:52:23.791511 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647ebcc9-fc0d-456e-8608-92c2e97bf251 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:52:23.792957 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647ebcc9-fc0d-456e-8608-92c2e97bf251 service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:52:23.821092 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1216/2439] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:52:23 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:52:24.033689 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=27 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:52:33.818542 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=17 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:53:03.941809 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a149dee9-dfcc-40f4-874a-f9740b9fd07d service placement] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:53:03.952086 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a149dee9-dfcc-40f4-874a-f9740b9fd07d service placement] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:53:03.956382 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b64894-6e8a-4bde-99fe-798a45ef10f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a747e2a5684843a6ee9e3480badac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:53:03.957056 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b64894-6e8a-4bde-99fe-798a45ef10f2 service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:53:03.957329 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b64894-6e8a-4bde-99fe-798a45ef10f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:53:03.957601 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b64894-6e8a-4bde-99fe-798a45ef10f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:53:03.960818 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-74b64894-6e8a-4bde-99fe-798a45ef10f2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:53:04.068943 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b64894-6e8a-4bde-99fe-798a45ef10f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:53:04.070409 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b64894-6e8a-4bde-99fe-798a45ef10f2 service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:53:04.091279 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1224/2440] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:53:03 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:53:14.087718 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=45 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:54:04.658056 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647ebcc9-fc0d-456e-8608-92c2e97bf251 service cinder] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:54:04.667669 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647ebcc9-fc0d-456e-8608-92c2e97bf251 service cinder] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:54:04.672229 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c69d92-19fb-4c6c-b59b-25e6d587965e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a747e2a5684843a6ee9e3480badac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:54:04.672798 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c69d92-19fb-4c6c-b59b-25e6d587965e service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:54:04.673080 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c69d92-19fb-4c6c-b59b-25e6d587965e service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:54:04.673347 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c69d92-19fb-4c6c-b59b-25e6d587965e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:54:04.734277 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c69d92-19fb-4c6c-b59b-25e6d587965e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:54:04.735790 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c69d92-19fb-4c6c-b59b-25e6d587965e service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:54:04.736901 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-57c69d92-19fb-4c6c-b59b-25e6d587965e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:54:04.765120 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1217/2441] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:54:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:54:09.155775 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b64894-6e8a-4bde-99fe-798a45ef10f2 service cinder] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:54:09.167986 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b64894-6e8a-4bde-99fe-798a45ef10f2 service cinder] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:54:09.172988 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8285df4-a7c8-4574-a934-4ac007423714 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a747e2a5684843a6ee9e3480badac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:54:09.173638 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8285df4-a7c8-4574-a934-4ac007423714 service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:54:09.173917 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8285df4-a7c8-4574-a934-4ac007423714 service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:54:09.174192 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8285df4-a7c8-4574-a934-4ac007423714 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:54:09.184286 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8285df4-a7c8-4574-a934-4ac007423714 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:54:09.185745 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8285df4-a7c8-4574-a934-4ac007423714 service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:54:09.195088 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1225/2442] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:54:09 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:54:10.136175 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c69d92-19fb-4c6c-b59b-25e6d587965e service cinder] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:54:10.199704 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c69d92-19fb-4c6c-b59b-25e6d587965e service cinder] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:54:10.203988 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2891f3-cad3-4dc1-ad5d-9792e8becd00 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a747e2a5684843a6ee9e3480badac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:54:10.204646 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2891f3-cad3-4dc1-ad5d-9792e8becd00 service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:54:10.204930 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2891f3-cad3-4dc1-ad5d-9792e8becd00 service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:54:10.205197 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2891f3-cad3-4dc1-ad5d-9792e8becd00 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:54:10.215188 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2891f3-cad3-4dc1-ad5d-9792e8becd00 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:54:10.216684 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2891f3-cad3-4dc1-ad5d-9792e8becd00 service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:54:10.226475 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1218/2443] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:54:10 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:54:19.190853 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=6 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:54:20.221933 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=59 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:55:05.556365 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8285df4-a7c8-4574-a934-4ac007423714 service cinder] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:55:05.558135 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-e8285df4-a7c8-4574-a934-4ac007423714 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:55:05.656164 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8285df4-a7c8-4574-a934-4ac007423714 service cinder] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:55:05.661004 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fe6650-4a0f-4773-8a20-03c432004342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:55:05.661883 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fe6650-4a0f-4773-8a20-03c432004342 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:55:05.662165 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fe6650-4a0f-4773-8a20-03c432004342 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:55:05.662434 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fe6650-4a0f-4773-8a20-03c432004342 admin admin] PATH_INFO: `/v3/users/e8a515e668994caf8813e83acb4f959a` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:55:05.663688 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fe6650-4a0f-4773-8a20-03c432004342 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8a515e668994caf8813e83acb4f959a)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:55:05.665627 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fe6650-4a0f-4773-8a20-03c432004342 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:55:05.716854 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-08fe6650-4a0f-4773-8a20-03c432004342 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8a515e668994caf8813e83acb4f959a'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:55:05.724545 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-08fe6650-4a0f-4773-8a20-03c432004342 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8a515e668994caf8813e83acb4f959a'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:55:05.725252 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-08fe6650-4a0f-4773-8a20-03c432004342 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8a515e668994caf8813e83acb4f959a'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:55:05.725862 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-08fe6650-4a0f-4773-8a20-03c432004342 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8a515e668994caf8813e83acb4f959a'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:55:05.738426 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-08fe6650-4a0f-4773-8a20-03c432004342 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8a515e668994caf8813e83acb4f959a'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:55:05.754153 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1226/2444] 10.222.0.36 () {58 vars in 1223 bytes} [Fri Jun 24 22:55:05 2022] DELETE /identity/v3/users/e8a515e668994caf8813e83acb4f959a => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 22:55:05.758613 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c2a119-1ca6-43b9-b723-8bc734365fec None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:55:05.759122 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c2a119-1ca6-43b9-b723-8bc734365fec None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:55:05.759229 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c2a119-1ca6-43b9-b723-8bc734365fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:55:05.785362 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-c8c2a119-1ca6-43b9-b723-8bc734365fec None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:55:05.786559 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-c8c2a119-1ca6-43b9-b723-8bc734365fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:55:05.857329 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1219/2445] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:55:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:55:05.868582 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fe6650-4a0f-4773-8a20-03c432004342 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:55:05.870087 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-08fe6650-4a0f-4773-8a20-03c432004342 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:55:05.928691 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:55:05.956514 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fe6650-4a0f-4773-8a20-03c432004342 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:55:05.960442 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c2b0a0-b8b5-4b6f-a50f-2bb9329cd0b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:55:05.961096 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c2b0a0-b8b5-4b6f-a50f-2bb9329cd0b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:55:05.961376 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c2b0a0-b8b5-4b6f-a50f-2bb9329cd0b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:55:05.961648 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c2b0a0-b8b5-4b6f-a50f-2bb9329cd0b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:55:05.971195 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c2b0a0-b8b5-4b6f-a50f-2bb9329cd0b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:55:05.972692 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c2b0a0-b8b5-4b6f-a50f-2bb9329cd0b9 service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:55:05.982001 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1227/2446] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:55:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:55:06.283932 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c2a119-1ca6-43b9-b723-8bc734365fec None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:55:06.285502 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-c8c2a119-1ca6-43b9-b723-8bc734365fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:55:06.301115 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c2a119-1ca6-43b9-b723-8bc734365fec None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:55:06.312885 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf2fd49-b72f-4cdf-8d2a-26d6cf52d63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:55:06.314488 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf2fd49-b72f-4cdf-8d2a-26d6cf52d63f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:55:06.314772 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf2fd49-b72f-4cdf-8d2a-26d6cf52d63f admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:55:06.315053 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf2fd49-b72f-4cdf-8d2a-26d6cf52d63f admin admin] PATH_INFO: `/v3/projects/a3a7f1d0bf2c40d38cd8c896f05ecd4d` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:55:06.316424 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf2fd49-b72f-4cdf-8d2a-26d6cf52d63f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3a7f1d0bf2c40d38cd8c896f05ecd4d)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:55:06.318383 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf2fd49-b72f-4cdf-8d2a-26d6cf52d63f admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:55:06.370569 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-fcf2fd49-b72f-4cdf-8d2a-26d6cf52d63f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3a7f1d0bf2c40d38cd8c896f05ecd4d', 'request_id': 'req-fcf2fd49-b72f-4cdf-8d2a-26d6cf52d63f'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:55:06.378124 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-fcf2fd49-b72f-4cdf-8d2a-26d6cf52d63f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3a7f1d0bf2c40d38cd8c896f05ecd4d', 'request_id': 'req-fcf2fd49-b72f-4cdf-8d2a-26d6cf52d63f'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:55:06.386481 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-fcf2fd49-b72f-4cdf-8d2a-26d6cf52d63f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3a7f1d0bf2c40d38cd8c896f05ecd4d', 'request_id': 'req-fcf2fd49-b72f-4cdf-8d2a-26d6cf52d63f'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:55:06.397851 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-fcf2fd49-b72f-4cdf-8d2a-26d6cf52d63f admin admin] The token cache is being invalidate because project a3a7f1d0bf2c40d38cd8c896f05ecd4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 22:55:06.398183 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-fcf2fd49-b72f-4cdf-8d2a-26d6cf52d63f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:55:06.398825 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-fcf2fd49-b72f-4cdf-8d2a-26d6cf52d63f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 22:55:06.400518 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1220/2447] 10.222.0.36 () {58 vars in 1232 bytes} [Fri Jun 24 22:55:06 2022] DELETE /identity/v3/projects/a3a7f1d0bf2c40d38cd8c896f05ecd4d => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:55:06.406582 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8466fa4-8241-4267-8146-c530987df63a None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:55:06.406924 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8466fa4-8241-4267-8146-c530987df63a None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:55:06.407721 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8466fa4-8241-4267-8146-c530987df63a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:55:06.464582 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-b8466fa4-8241-4267-8146-c530987df63a None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:55:06.465785 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-b8466fa4-8241-4267-8146-c530987df63a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:55:06.539635 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1228/2448] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:55:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 22:55:06.543152 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e8c6cf-5e77-4e89-bcdb-0acaafe3843a None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:55:06.543480 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e8c6cf-5e77-4e89-bcdb-0acaafe3843a None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:55:06.543784 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e8c6cf-5e77-4e89-bcdb-0acaafe3843a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:55:06.563520 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-d3e8c6cf-5e77-4e89-bcdb-0acaafe3843a None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:55:06.564747 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-d3e8c6cf-5e77-4e89-bcdb-0acaafe3843a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:55:06.579470 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1221/2449] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:55:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:55:06.579606 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8466fa4-8241-4267-8146-c530987df63a None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:55:06.588514 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8466fa4-8241-4267-8146-c530987df63a None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:55:06.593933 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8912cbd6-8c61-4854-8c8a-612f93899c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:55:06.594591 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8912cbd6-8c61-4854-8c8a-612f93899c2f admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:55:06.594871 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8912cbd6-8c61-4854-8c8a-612f93899c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:55:06.595201 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8912cbd6-8c61-4854-8c8a-612f93899c2f admin admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:55:06.595964 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8912cbd6-8c61-4854-8c8a-612f93899c2f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 22:55:06.596268 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8912cbd6-8c61-4854-8c8a-612f93899c2f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:55:06.597915 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8912cbd6-8c61-4854-8c8a-612f93899c2f admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:55:06.609846 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1229/2450] 10.222.0.36 () {58 vars in 1152 bytes} [Fri Jun 24 22:55:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 22:55:06.614991 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e8c6cf-5e77-4e89-bcdb-0acaafe3843a None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:55:06.629854 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e8c6cf-5e77-4e89-bcdb-0acaafe3843a None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:55:06.638856 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3694b6-5985-4fce-b1a7-4ffad5bf1256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:55:06.639943 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3694b6-5985-4fce-b1a7-4ffad5bf1256 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:55:06.640420 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3694b6-5985-4fce-b1a7-4ffad5bf1256 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:55:06.640777 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3694b6-5985-4fce-b1a7-4ffad5bf1256 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:55:06.642273 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3694b6-5985-4fce-b1a7-4ffad5bf1256 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:55:06.644291 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3694b6-5985-4fce-b1a7-4ffad5bf1256 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:55:06.685060 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1222/2451] 10.222.0.36 () {60 vars in 1152 bytes} [Fri Jun 24 22:55:06 2022] POST /identity/v3/projects => generated 377 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:55:06.690550 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8912cbd6-8c61-4854-8c8a-612f93899c2f admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:55:06.701537 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8912cbd6-8c61-4854-8c8a-612f93899c2f admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:55:06.775979 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160b4d7d-4880-43ab-8ad4-e6a0f8178424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:55:06.777012 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160b4d7d-4880-43ab-8ad4-e6a0f8178424 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:55:06.777472 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160b4d7d-4880-43ab-8ad4-e6a0f8178424 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:55:06.777888 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160b4d7d-4880-43ab-8ad4-e6a0f8178424 admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:55:06.778950 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160b4d7d-4880-43ab-8ad4-e6a0f8178424 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:55:06.782062 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160b4d7d-4880-43ab-8ad4-e6a0f8178424 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:55:06.804311 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1230/2452] 10.222.0.36 () {60 vars in 1143 bytes} [Fri Jun 24 22:55:06 2022] POST /identity/v3/users => generated 289 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:55:06.808549 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3694b6-5985-4fce-b1a7-4ffad5bf1256 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:55:06.819194 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3694b6-5985-4fce-b1a7-4ffad5bf1256 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:55:06.824191 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4a7c5f-614f-4b07-9194-ed68ddec6ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:55:06.824877 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4a7c5f-614f-4b07-9194-ed68ddec6ea8 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:55:06.825135 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4a7c5f-614f-4b07-9194-ed68ddec6ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:55:06.825384 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4a7c5f-614f-4b07-9194-ed68ddec6ea8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:55:06.826142 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4a7c5f-614f-4b07-9194-ed68ddec6ea8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:55:06.827806 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4a7c5f-614f-4b07-9194-ed68ddec6ea8 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:55:06.837982 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1223/2453] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:55:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:55:06.842069 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160b4d7d-4880-43ab-8ad4-e6a0f8178424 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:55:06.852785 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160b4d7d-4880-43ab-8ad4-e6a0f8178424 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:55:06.858005 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158038ea-2c33-4b43-9981-5ea7730337af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:55:06.858697 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158038ea-2c33-4b43-9981-5ea7730337af admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:55:06.858981 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158038ea-2c33-4b43-9981-5ea7730337af admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:55:06.859268 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158038ea-2c33-4b43-9981-5ea7730337af admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:55:06.860070 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158038ea-2c33-4b43-9981-5ea7730337af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:55:06.861698 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158038ea-2c33-4b43-9981-5ea7730337af admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:55:06.873987 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1231/2454] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:55:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 22:55:06.878352 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4a7c5f-614f-4b07-9194-ed68ddec6ea8 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:55:06.888691 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4a7c5f-614f-4b07-9194-ed68ddec6ea8 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:55:06.894236 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8950b0bf-a338-457a-94e7-8650babaefc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:55:06.895126 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8950b0bf-a338-457a-94e7-8650babaefc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:55:06.895431 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8950b0bf-a338-457a-94e7-8650babaefc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:55:06.895740 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8950b0bf-a338-457a-94e7-8650babaefc6 admin admin] PATH_INFO: `/v3/projects/b2504fe6b85c4a0b810bddb0e6e9b05f/users/daaf3a9a0ca54d048633192dda71384f/roles/1928787bfcc745419829cd315900ac44` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:55:06.911924 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8950b0bf-a338-457a-94e7-8650babaefc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2504fe6b85c4a0b810bddb0e6e9b05f, user_id=daaf3a9a0ca54d048633192dda71384f, role_id=1928787bfcc745419829cd315900ac44)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:55:06.914620 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8950b0bf-a338-457a-94e7-8650babaefc6 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:55:06.935702 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1224/2455] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 22:55:06 2022] PUT /identity/v3/projects/b2504fe6b85c4a0b810bddb0e6e9b05f/users/daaf3a9a0ca54d048633192dda71384f/roles/1928787bfcc745419829cd315900ac44 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 22:55:06.942487 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4781fd-8be6-4f40-aa73-4d8430cd3c81 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:55:06.942819 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4781fd-8be6-4f40-aa73-4d8430cd3c81 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:55:06.943135 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4781fd-8be6-4f40-aa73-4d8430cd3c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:55:06.961687 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-5f4781fd-8be6-4f40-aa73-4d8430cd3c81 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:55:06.962896 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-5f4781fd-8be6-4f40-aa73-4d8430cd3c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:55:06.973842 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:55:07.036089 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1232/2456] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:55:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:55:07.046878 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8950b0bf-a338-457a-94e7-8650babaefc6 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:55:07.048842 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-8950b0bf-a338-457a-94e7-8650babaefc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:55:07.055521 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:55:07.107984 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8950b0bf-a338-457a-94e7-8650babaefc6 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:55:07.111951 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18c7d44-16da-442c-b494-fedba2cf51e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:55:07.112589 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18c7d44-16da-442c-b494-fedba2cf51e1 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:55:07.112893 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18c7d44-16da-442c-b494-fedba2cf51e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:55:07.113168 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18c7d44-16da-442c-b494-fedba2cf51e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:55:07.123474 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18c7d44-16da-442c-b494-fedba2cf51e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:55:07.124983 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18c7d44-16da-442c-b494-fedba2cf51e1 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:55:07.134630 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1225/2457] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:55:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 22:55:11.211754 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad45f307-1a73-43a1-9761-23e9a4cd85e9 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:55:11.212329 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad45f307-1a73-43a1-9761-23e9a4cd85e9 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:55:11.212329 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad45f307-1a73-43a1-9761-23e9a4cd85e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:55:11.250338 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-ad45f307-1a73-43a1-9761-23e9a4cd85e9 None None] MFA Rules not processed for user `daaf3a9a0ca54d048633192dda71384f`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:55:11.255961 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-ad45f307-1a73-43a1-9761-23e9a4cd85e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:55:11.348612 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1233/2458] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:55:11 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:55:11.356061 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18c7d44-16da-442c-b494-fedba2cf51e1 service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:55:11.366508 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18c7d44-16da-442c-b494-fedba2cf51e1 service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:55:11.371861 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78d9c41-8f0f-4fd4-a912-4d7dc9104620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:55:11.372553 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78d9c41-8f0f-4fd4-a912-4d7dc9104620 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:55:11.372850 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78d9c41-8f0f-4fd4-a912-4d7dc9104620 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:55:11.373100 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78d9c41-8f0f-4fd4-a912-4d7dc9104620 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:55:11.373836 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78d9c41-8f0f-4fd4-a912-4d7dc9104620 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:55:11.381697 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78d9c41-8f0f-4fd4-a912-4d7dc9104620 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:55:11.415388 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1226/2459] 10.222.0.36 () {60 vars in 1152 bytes} [Fri Jun 24 22:55:11 2022] POST /identity/v3/projects => generated 379 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:55:11.416589 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad45f307-1a73-43a1-9761-23e9a4cd85e9 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:55:11.434186 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad45f307-1a73-43a1-9761-23e9a4cd85e9 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:55:11.507773 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d93e8a-4156-4739-ac4d-4c1340b5d218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:55:11.508460 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d93e8a-4156-4739-ac4d-4c1340b5d218 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:55:11.508736 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d93e8a-4156-4739-ac4d-4c1340b5d218 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:55:11.509010 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d93e8a-4156-4739-ac4d-4c1340b5d218 admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:55:11.509699 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d93e8a-4156-4739-ac4d-4c1340b5d218 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:55:11.511673 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d93e8a-4156-4739-ac4d-4c1340b5d218 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:55:11.535291 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1234/2460] 10.222.0.36 () {60 vars in 1143 bytes} [Fri Jun 24 22:55:11 2022] POST /identity/v3/users => generated 296 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 22:55:11.538954 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78d9c41-8f0f-4fd4-a912-4d7dc9104620 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:55:11.549994 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78d9c41-8f0f-4fd4-a912-4d7dc9104620 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:55:11.555319 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffdd792-9f60-41d3-9d33-8a1f9f83701b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:55:11.556038 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffdd792-9f60-41d3-9d33-8a1f9f83701b admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:55:11.556334 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffdd792-9f60-41d3-9d33-8a1f9f83701b admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:55:11.556691 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffdd792-9f60-41d3-9d33-8a1f9f83701b admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:55:11.557553 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffdd792-9f60-41d3-9d33-8a1f9f83701b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:55:11.559103 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffdd792-9f60-41d3-9d33-8a1f9f83701b admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:55:11.573939 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1227/2461] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:55:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 22:55:11.575357 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d93e8a-4156-4739-ac4d-4c1340b5d218 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:55:11.586392 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d93e8a-4156-4739-ac4d-4c1340b5d218 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:55:11.591771 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35d60b6-39e8-48ef-89f5-693bf1cc5979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:55:11.592748 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35d60b6-39e8-48ef-89f5-693bf1cc5979 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:55:11.593037 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35d60b6-39e8-48ef-89f5-693bf1cc5979 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:55:11.593310 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35d60b6-39e8-48ef-89f5-693bf1cc5979 admin admin] PATH_INFO: `/v3/projects/f343c18f5b094e41a0035b6af2c9d0b4/users/e439990adb0e479baaa89bb61880f2b1/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:55:11.613109 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35d60b6-39e8-48ef-89f5-693bf1cc5979 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f343c18f5b094e41a0035b6af2c9d0b4, user_id=e439990adb0e479baaa89bb61880f2b1, role_id=1a1c43cc97a0407eb7a7c7a1333a9d4a)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:55:11.615972 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35d60b6-39e8-48ef-89f5-693bf1cc5979 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:55:11.631765 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1235/2462] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 22:55:11 2022] PUT /identity/v3/projects/f343c18f5b094e41a0035b6af2c9d0b4/users/e439990adb0e479baaa89bb61880f2b1/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 22:55:11.635926 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffdd792-9f60-41d3-9d33-8a1f9f83701b admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:55:11.647192 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffdd792-9f60-41d3-9d33-8a1f9f83701b admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:55:11.725885 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86bffef-ded2-4461-b05e-a015bdccf699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:55:11.726575 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86bffef-ded2-4461-b05e-a015bdccf699 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:55:11.726856 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86bffef-ded2-4461-b05e-a015bdccf699 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:55:11.727132 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86bffef-ded2-4461-b05e-a015bdccf699 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:55:11.727910 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86bffef-ded2-4461-b05e-a015bdccf699 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:55:11.729737 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86bffef-ded2-4461-b05e-a015bdccf699 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:55:11.745845 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1228/2463] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 22:55:11 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 22:55:11.749172 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35d60b6-39e8-48ef-89f5-693bf1cc5979 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:55:11.785358 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35d60b6-39e8-48ef-89f5-693bf1cc5979 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:55:11.790214 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05b3628-15e4-4ab4-aa3e-e4917d0d1b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:55:11.791134 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05b3628-15e4-4ab4-aa3e-e4917d0d1b05 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:55:11.791457 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05b3628-15e4-4ab4-aa3e-e4917d0d1b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:55:11.791732 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05b3628-15e4-4ab4-aa3e-e4917d0d1b05 admin admin] PATH_INFO: `/v3/projects/f343c18f5b094e41a0035b6af2c9d0b4/users/e439990adb0e479baaa89bb61880f2b1/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:55:11.793692 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05b3628-15e4-4ab4-aa3e-e4917d0d1b05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f343c18f5b094e41a0035b6af2c9d0b4, user_id=e439990adb0e479baaa89bb61880f2b1, role_id=1a1c43cc97a0407eb7a7c7a1333a9d4a)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:55:11.796401 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05b3628-15e4-4ab4-aa3e-e4917d0d1b05 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:55:11.803244 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:55:11.810449 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1236/2464] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 22:55:11 2022] PUT /identity/v3/projects/f343c18f5b094e41a0035b6af2c9d0b4/users/e439990adb0e479baaa89bb61880f2b1/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 22:55:14.144482 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86bffef-ded2-4461-b05e-a015bdccf699 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:55:14.146651 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-a86bffef-ded2-4461-b05e-a015bdccf699 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:55:14.248852 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86bffef-ded2-4461-b05e-a015bdccf699 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:55:14.294793 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:55:14.358844 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb1258e-eaa6-4c49-b886-88a0a17d0255 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:55:14.360032 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb1258e-eaa6-4c49-b886-88a0a17d0255 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:55:14.360539 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb1258e-eaa6-4c49-b886-88a0a17d0255 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:55:14.361291 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb1258e-eaa6-4c49-b886-88a0a17d0255 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:55:14.390012 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-1eb1258e-eaa6-4c49-b886-88a0a17d0255 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:55:14.565068 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb1258e-eaa6-4c49-b886-88a0a17d0255 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:55:14.566569 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb1258e-eaa6-4c49-b886-88a0a17d0255 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:55:14.602633 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1229/2465] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:55:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:55:15.990723 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05b3628-15e4-4ab4-aa3e-e4917d0d1b05 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:55:16.004814 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05b3628-15e4-4ab4-aa3e-e4917d0d1b05 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:55:16.009080 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7778b90d-64e4-43cb-a253-4bed9452e28c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:55:16.010023 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7778b90d-64e4-43cb-a253-4bed9452e28c service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:55:16.010505 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7778b90d-64e4-43cb-a253-4bed9452e28c service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:55:16.011129 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7778b90d-64e4-43cb-a253-4bed9452e28c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:55:16.013335 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-7778b90d-64e4-43cb-a253-4bed9452e28c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:55:16.031817 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7778b90d-64e4-43cb-a253-4bed9452e28c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:55:16.034624 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7778b90d-64e4-43cb-a253-4bed9452e28c service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:55:16.049047 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1237/2466] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:55:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:55:16.766546 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4454486-fbd4-4eff-953a-225fe833fb9a None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:55:16.767112 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4454486-fbd4-4eff-953a-225fe833fb9a None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:55:16.767112 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4454486-fbd4-4eff-953a-225fe833fb9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:55:16.793665 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-f4454486-fbd4-4eff-953a-225fe833fb9a None None] MFA Rules not processed for user `e439990adb0e479baaa89bb61880f2b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 22:55:16.794809 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-f4454486-fbd4-4eff-953a-225fe833fb9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:55:16.869186 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1230/2467] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 22:55:16 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 22:55:16.886160 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7778b90d-64e4-43cb-a253-4bed9452e28c service neutron] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:55:16.887584 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-7778b90d-64e4-43cb-a253-4bed9452e28c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:55:16.907128 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7778b90d-64e4-43cb-a253-4bed9452e28c service neutron] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:55:16.913525 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe863f5-0c7f-4cf0-a75b-b1ec4c3f2bdf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214d9071042c4bad886bf060a079b6e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:55:16.914187 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe863f5-0c7f-4cf0-a75b-b1ec4c3f2bdf service nova] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:55:16.914470 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe863f5-0c7f-4cf0-a75b-b1ec4c3f2bdf service nova] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:55:16.914744 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe863f5-0c7f-4cf0-a75b-b1ec4c3f2bdf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:55:16.982641 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe863f5-0c7f-4cf0-a75b-b1ec4c3f2bdf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:55:16.984332 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe863f5-0c7f-4cf0-a75b-b1ec4c3f2bdf service nova] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:55:16.993988 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1238/2468] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:55:16 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:55:20.677358 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4454486-fbd4-4eff-953a-225fe833fb9a None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:55:20.689858 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4454486-fbd4-4eff-953a-225fe833fb9a None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:55:20.693536 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aca4e0-d445-4215-bf22-db2322a37cd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:55:20.694193 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aca4e0-d445-4215-bf22-db2322a37cd7 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:55:20.694507 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aca4e0-d445-4215-bf22-db2322a37cd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:55:20.694777 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aca4e0-d445-4215-bf22-db2322a37cd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:55:20.696617 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-33aca4e0-d445-4215-bf22-db2322a37cd7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:55:20.715714 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33aca4e0-d445-4215-bf22-db2322a37cd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:55:20.717262 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33aca4e0-d445-4215-bf22-db2322a37cd7 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:55:20.739610 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1231/2469] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:55:20 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:55:26.989840 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=35 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:55:30.723553 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=94 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:57:05.672386 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe863f5-0c7f-4cf0-a75b-b1ec4c3f2bdf service nova] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:57:05.674125 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-cbe863f5-0c7f-4cf0-a75b-b1ec4c3f2bdf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:57:05.691421 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe863f5-0c7f-4cf0-a75b-b1ec4c3f2bdf service nova] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:57:05.699259 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e781b8-b0e8-4615-a859-8dbfe49fc978 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214d9071042c4bad886bf060a079b6e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:57:05.700002 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e781b8-b0e8-4615-a859-8dbfe49fc978 service nova] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:57:05.700441 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e781b8-b0e8-4615-a859-8dbfe49fc978 service nova] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:57:05.700715 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e781b8-b0e8-4615-a859-8dbfe49fc978 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:57:05.702836 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-69e781b8-b0e8-4615-a859-8dbfe49fc978 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:57:05.778884 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e781b8-b0e8-4615-a859-8dbfe49fc978 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:57:05.780535 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e781b8-b0e8-4615-a859-8dbfe49fc978 service nova] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:57:05.790277 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1239/2470] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:57:05 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:57:15.786066 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=33 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:57:15.975403 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aca4e0-d445-4215-bf22-db2322a37cd7 service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:57:15.977022 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-33aca4e0-d445-4215-bf22-db2322a37cd7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:57:16.063507 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aca4e0-d445-4215-bf22-db2322a37cd7 service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:57:16.068451 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cb5422-9eee-46ff-aa36-919a0dea51ec service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0233b357708643be94c0ade17ac1fb3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:57:16.069137 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb5422-9eee-46ff-aa36-919a0dea51ec service placement] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:57:16.069413 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb5422-9eee-46ff-aa36-919a0dea51ec service placement] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:57:16.069683 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb5422-9eee-46ff-aa36-919a0dea51ec service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:57:16.071494 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-79cb5422-9eee-46ff-aa36-919a0dea51ec service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:57:16.083588 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cb5422-9eee-46ff-aa36-919a0dea51ec service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:57:16.085202 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cb5422-9eee-46ff-aa36-919a0dea51ec service placement] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:57:16.095620 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1232/2471] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:57:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:57:23.863079 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e781b8-b0e8-4615-a859-8dbfe49fc978 service nova] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:57:23.865819 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-69e781b8-b0e8-4615-a859-8dbfe49fc978 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:57:23.951048 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e781b8-b0e8-4615-a859-8dbfe49fc978 service nova] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:57:23.955446 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22fe542-bada-4ba7-b6cf-e8c354ecf12d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a747e2a5684843a6ee9e3480badac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:57:23.956111 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22fe542-bada-4ba7-b6cf-e8c354ecf12d service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:57:23.956395 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22fe542-bada-4ba7-b6cf-e8c354ecf12d service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:57:23.956671 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22fe542-bada-4ba7-b6cf-e8c354ecf12d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:57:23.958825 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-d22fe542-bada-4ba7-b6cf-e8c354ecf12d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:57:24.033066 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22fe542-bada-4ba7-b6cf-e8c354ecf12d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:57:24.034526 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22fe542-bada-4ba7-b6cf-e8c354ecf12d service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:57:24.043786 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1240/2472] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:57:23 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:57:26.091002 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=37 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:57:34.040056 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=58 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:57:59.820088 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cb5422-9eee-46ff-aa36-919a0dea51ec service placement] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:57:59.833032 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cb5422-9eee-46ff-aa36-919a0dea51ec service placement] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:57:59.838593 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d267d9-d4ae-49d5-a068-eff998087a44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214d9071042c4bad886bf060a079b6e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:57:59.839274 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d267d9-d4ae-49d5-a068-eff998087a44 service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:57:59.839567 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d267d9-d4ae-49d5-a068-eff998087a44 service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:57:59.839902 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d267d9-d4ae-49d5-a068-eff998087a44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:57:59.841800 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-c2d267d9-d4ae-49d5-a068-eff998087a44 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:57:59.856377 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d267d9-d4ae-49d5-a068-eff998087a44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:57:59.858050 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d267d9-d4ae-49d5-a068-eff998087a44 service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:57:59.869631 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1233/2473] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:57:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:58:09.864791 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=6 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 22:59:05.452758 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22fe542-bada-4ba7-b6cf-e8c354ecf12d service cinder] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 22:59:05.467704 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22fe542-bada-4ba7-b6cf-e8c354ecf12d service cinder] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 22:59:05.476433 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b609a3e-7e82-49fe-895d-a5453dec4863 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214d9071042c4bad886bf060a079b6e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 22:59:05.477119 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b609a3e-7e82-49fe-895d-a5453dec4863 service nova] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 22:59:05.477426 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b609a3e-7e82-49fe-895d-a5453dec4863 service nova] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 22:59:05.477701 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b609a3e-7e82-49fe-895d-a5453dec4863 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 22:59:05.479696 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-1b609a3e-7e82-49fe-895d-a5453dec4863 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 22:59:05.551648 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b609a3e-7e82-49fe-895d-a5453dec4863 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 22:59:05.553165 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b609a3e-7e82-49fe-895d-a5453dec4863 service nova] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 22:59:05.573036 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1241/2474] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 22:59:05 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 22:59:15.570462 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=36 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:00:13.586653 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d267d9-d4ae-49d5-a068-eff998087a44 service nova] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:00:13.602735 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d267d9-d4ae-49d5-a068-eff998087a44 service nova] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:00:13.608323 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d546d485-a819-4d33-bf0e-f690ca6129ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a747e2a5684843a6ee9e3480badac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:00:13.608967 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d546d485-a819-4d33-bf0e-f690ca6129ab service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:00:13.609247 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d546d485-a819-4d33-bf0e-f690ca6129ab service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:00:13.609519 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d546d485-a819-4d33-bf0e-f690ca6129ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:00:13.611722 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-d546d485-a819-4d33-bf0e-f690ca6129ab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:00:13.685377 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d546d485-a819-4d33-bf0e-f690ca6129ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:00:13.686822 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d546d485-a819-4d33-bf0e-f690ca6129ab service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:00:13.708456 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1234/2475] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:00:13 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:00:13.799070 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b609a3e-7e82-49fe-895d-a5453dec4863 service nova] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:00:13.809683 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b609a3e-7e82-49fe-895d-a5453dec4863 service nova] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:00:13.813648 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2973abb-d68c-4a8a-98a3-f1e2e597ca9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a747e2a5684843a6ee9e3480badac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:00:13.814284 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2973abb-d68c-4a8a-98a3-f1e2e597ca9c service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:00:13.814564 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2973abb-d68c-4a8a-98a3-f1e2e597ca9c service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:00:13.814839 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2973abb-d68c-4a8a-98a3-f1e2e597ca9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:00:13.816752 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-b2973abb-d68c-4a8a-98a3-f1e2e597ca9c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:00:13.906743 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2973abb-d68c-4a8a-98a3-f1e2e597ca9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:00:13.908251 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2973abb-d68c-4a8a-98a3-f1e2e597ca9c service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:00:13.929539 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1242/2476] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:00:13 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:00:15.243014 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d546d485-a819-4d33-bf0e-f690ca6129ab service cinder] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:00:15.253352 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d546d485-a819-4d33-bf0e-f690ca6129ab service cinder] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:00:15.257552 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810ee8dd-31e4-491e-8bae-00f9f3a636dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:00:15.258479 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810ee8dd-31e4-491e-8bae-00f9f3a636dd service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:00:15.258746 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810ee8dd-31e4-491e-8bae-00f9f3a636dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:00:15.259015 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810ee8dd-31e4-491e-8bae-00f9f3a636dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:00:15.270308 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810ee8dd-31e4-491e-8bae-00f9f3a636dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:00:15.272004 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810ee8dd-31e4-491e-8bae-00f9f3a636dd service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:00:15.283832 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1235/2477] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:00:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:00:16.503672 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2973abb-d68c-4a8a-98a3-f1e2e597ca9c service cinder] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:00:16.513584 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2973abb-d68c-4a8a-98a3-f1e2e597ca9c service cinder] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:00:16.517110 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f06f66d-527f-4e6a-99b2-c54d1a7fd888 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:00:16.517764 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f06f66d-527f-4e6a-99b2-c54d1a7fd888 service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:00:16.518080 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f06f66d-527f-4e6a-99b2-c54d1a7fd888 service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:00:16.518302 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f06f66d-527f-4e6a-99b2-c54d1a7fd888 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:00:16.529366 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f06f66d-527f-4e6a-99b2-c54d1a7fd888 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:00:16.530821 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f06f66d-527f-4e6a-99b2-c54d1a7fd888 service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:00:16.542600 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1243/2478] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:00:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:00:25.278989 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=42 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:00:26.538184 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=47 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:01:25.626293 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810ee8dd-31e4-491e-8bae-00f9f3a636dd service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:01:25.636856 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810ee8dd-31e4-491e-8bae-00f9f3a636dd service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:01:25.641121 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9229663f-707c-49c1-b3ae-1f0ab3fb3884 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:01:25.641779 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9229663f-707c-49c1-b3ae-1f0ab3fb3884 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:01:25.642080 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9229663f-707c-49c1-b3ae-1f0ab3fb3884 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:01:25.642352 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9229663f-707c-49c1-b3ae-1f0ab3fb3884 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:01:25.650954 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9229663f-707c-49c1-b3ae-1f0ab3fb3884 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:01:25.653381 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9229663f-707c-49c1-b3ae-1f0ab3fb3884 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:01:25.662820 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1236/2479] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:01:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:01:35.658438 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=6 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:02:14.162821 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f06f66d-527f-4e6a-99b2-c54d1a7fd888 service neutron] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:02:14.184355 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f06f66d-527f-4e6a-99b2-c54d1a7fd888 service neutron] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:02:14.188414 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31337ac9-0aac-4911-8a9e-a8f60a6289c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a747e2a5684843a6ee9e3480badac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:02:14.189090 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31337ac9-0aac-4911-8a9e-a8f60a6289c1 service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:02:14.189366 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31337ac9-0aac-4911-8a9e-a8f60a6289c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:02:14.189675 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31337ac9-0aac-4911-8a9e-a8f60a6289c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:02:14.218340 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31337ac9-0aac-4911-8a9e-a8f60a6289c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:02:14.220741 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31337ac9-0aac-4911-8a9e-a8f60a6289c1 service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:02:14.233616 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1244/2480] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:02:14 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:02:14.312255 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9229663f-707c-49c1-b3ae-1f0ab3fb3884 service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:02:14.332672 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9229663f-707c-49c1-b3ae-1f0ab3fb3884 service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:02:14.336894 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58b5e2d-354e-46ea-932f-e7035951ca85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a747e2a5684843a6ee9e3480badac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:02:14.337538 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58b5e2d-354e-46ea-932f-e7035951ca85 service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:02:14.337832 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58b5e2d-354e-46ea-932f-e7035951ca85 service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:02:14.338104 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58b5e2d-354e-46ea-932f-e7035951ca85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:02:14.347203 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58b5e2d-354e-46ea-932f-e7035951ca85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:02:14.348716 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58b5e2d-354e-46ea-932f-e7035951ca85 service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:02:14.377847 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1237/2481] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:02:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:02:20.854119 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31337ac9-0aac-4911-8a9e-a8f60a6289c1 service cinder] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:02:20.893594 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31337ac9-0aac-4911-8a9e-a8f60a6289c1 service cinder] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:02:20.899228 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b0ea0e-77c4-44c3-9895-083938fa5c66 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0233b357708643be94c0ade17ac1fb3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:02:20.899897 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b0ea0e-77c4-44c3-9895-083938fa5c66 service placement] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:02:20.900185 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b0ea0e-77c4-44c3-9895-083938fa5c66 service placement] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:02:20.900466 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b0ea0e-77c4-44c3-9895-083938fa5c66 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:02:20.909525 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b0ea0e-77c4-44c3-9895-083938fa5c66 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:02:20.911141 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b0ea0e-77c4-44c3-9895-083938fa5c66 service placement] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:02:20.921321 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1245/2482] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:02:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:02:23.341686 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58b5e2d-354e-46ea-932f-e7035951ca85 service cinder] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:02:23.362070 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58b5e2d-354e-46ea-932f-e7035951ca85 service cinder] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:02:23.369243 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e06d7b6-6ab3-49d1-93bf-c6d96571c9c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214d9071042c4bad886bf060a079b6e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:02:23.369884 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e06d7b6-6ab3-49d1-93bf-c6d96571c9c7 service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:02:23.370165 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e06d7b6-6ab3-49d1-93bf-c6d96571c9c7 service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:02:23.370770 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e06d7b6-6ab3-49d1-93bf-c6d96571c9c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:02:23.379235 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e06d7b6-6ab3-49d1-93bf-c6d96571c9c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:02:23.380869 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e06d7b6-6ab3-49d1-93bf-c6d96571c9c7 service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:02:23.390170 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1238/2483] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:02:23 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:02:30.917116 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=33 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:02:33.385953 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=24 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:03:45.899464 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ef6209-2b4e-431d-9d83-cdf90c65964f None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:03:45.900036 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ef6209-2b4e-431d-9d83-cdf90c65964f None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:03:45.900284 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ef6209-2b4e-431d-9d83-cdf90c65964f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:03:45.937440 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-25ef6209-2b4e-431d-9d83-cdf90c65964f None None] MFA Rules not processed for user `d38e573b57c147afa87ba5aceb21f73b`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 23:03:45.938635 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-25ef6209-2b4e-431d-9d83-cdf90c65964f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:03:45.946130 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1246/2484] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 23:03:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 23:03:46.517075 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e06d7b6-6ab3-49d1-93bf-c6d96571c9c7 service nova] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:03:46.527506 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e06d7b6-6ab3-49d1-93bf-c6d96571c9c7 service nova] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:03:46.532080 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7069ea91-0db7-43ed-890f-ca8608b1d932 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:03:46.532718 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7069ea91-0db7-43ed-890f-ca8608b1d932 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:03:46.532999 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7069ea91-0db7-43ed-890f-ca8608b1d932 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:03:46.533272 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7069ea91-0db7-43ed-890f-ca8608b1d932 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:03:46.535577 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-7069ea91-0db7-43ed-890f-ca8608b1d932 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:03:46.545736 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7069ea91-0db7-43ed-890f-ca8608b1d932 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:03:46.547170 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7069ea91-0db7-43ed-890f-ca8608b1d932 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:03:46.555392 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1239/2485] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:03:46 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:03:46.908543 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ef6209-2b4e-431d-9d83-cdf90c65964f None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:03:46.921436 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ef6209-2b4e-431d-9d83-cdf90c65964f None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:03:46.926411 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7a4a1b-8ecb-48b0-ae32-aaa3aeda410b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0233b357708643be94c0ade17ac1fb3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:03:46.927189 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a4a1b-8ecb-48b0-ae32-aaa3aeda410b service placement] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:03:46.927498 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a4a1b-8ecb-48b0-ae32-aaa3aeda410b service placement] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:03:46.927791 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a4a1b-8ecb-48b0-ae32-aaa3aeda410b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:03:46.929720 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-0a7a4a1b-8ecb-48b0-ae32-aaa3aeda410b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:03:46.943357 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7a4a1b-8ecb-48b0-ae32-aaa3aeda410b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:03:46.945650 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7a4a1b-8ecb-48b0-ae32-aaa3aeda410b service placement] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:03:46.959739 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1247/2486] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:03:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:03:49.728573 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7069ea91-0db7-43ed-890f-ca8608b1d932 service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:03:49.745561 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7069ea91-0db7-43ed-890f-ca8608b1d932 service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:03:49.758410 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7294ffc9-6f7b-4d69-9e5d-8076cca73e63 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214d9071042c4bad886bf060a079b6e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:03:49.759107 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7294ffc9-6f7b-4d69-9e5d-8076cca73e63 service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:03:49.759488 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7294ffc9-6f7b-4d69-9e5d-8076cca73e63 service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:03:49.759790 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7294ffc9-6f7b-4d69-9e5d-8076cca73e63 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:03:49.771946 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7294ffc9-6f7b-4d69-9e5d-8076cca73e63 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:03:49.774756 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7294ffc9-6f7b-4d69-9e5d-8076cca73e63 service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:03:49.787627 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1240/2487] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:03:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:03:56.494908 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7a4a1b-8ecb-48b0-ae32-aaa3aeda410b service placement] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:03:56.509195 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7a4a1b-8ecb-48b0-ae32-aaa3aeda410b service placement] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:03:56.514557 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6018811f-50b5-460e-acef-94fccb48e542 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214d9071042c4bad886bf060a079b6e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:03:56.515201 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6018811f-50b5-460e-acef-94fccb48e542 service nova] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:03:56.515524 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6018811f-50b5-460e-acef-94fccb48e542 service nova] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:03:56.515800 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6018811f-50b5-460e-acef-94fccb48e542 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:03:56.517579 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-6018811f-50b5-460e-acef-94fccb48e542 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:03:56.530241 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6018811f-50b5-460e-acef-94fccb48e542 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:03:56.531946 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6018811f-50b5-460e-acef-94fccb48e542 service nova] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:03:56.544651 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1248/2488] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:03:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:03:59.782240 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=12 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:04:00.303217 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7294ffc9-6f7b-4d69-9e5d-8076cca73e63 service nova] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:04:00.315499 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7294ffc9-6f7b-4d69-9e5d-8076cca73e63 service nova] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:04:00.321127 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5789549f-75b8-4ae5-869b-3c7bb3859f7d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214d9071042c4bad886bf060a079b6e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:04:00.321996 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5789549f-75b8-4ae5-869b-3c7bb3859f7d service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:04:00.322278 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5789549f-75b8-4ae5-869b-3c7bb3859f7d service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:04:00.322568 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5789549f-75b8-4ae5-869b-3c7bb3859f7d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:04:00.324455 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-5789549f-75b8-4ae5-869b-3c7bb3859f7d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:04:00.339131 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5789549f-75b8-4ae5-869b-3c7bb3859f7d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:04:00.340969 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5789549f-75b8-4ae5-869b-3c7bb3859f7d service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:04:00.358405 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1241/2489] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:04:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:04:06.538631 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=22 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:04:10.351580 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=6 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:04:11.145170 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857fbdfe-b54d-4ae5-a6a3-3e38d8e11aa8 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:04:11.145666 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857fbdfe-b54d-4ae5-a6a3-3e38d8e11aa8 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:04:11.145666 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857fbdfe-b54d-4ae5-a6a3-3e38d8e11aa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:04:11.206750 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-857fbdfe-b54d-4ae5-a6a3-3e38d8e11aa8 None None] MFA Rules not processed for user `542ea2e5a8114792836d0cdfd36b4c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 23:04:11.207989 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-857fbdfe-b54d-4ae5-a6a3-3e38d8e11aa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:04:11.273117 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1249/2490] 10.222.0.36 () {58 vars in 967 bytes} [Fri Jun 24 23:04:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 23:04:11.325893 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5789549f-75b8-4ae5-869b-3c7bb3859f7d service nova] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:04:11.327624 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-5789549f-75b8-4ae5-869b-3c7bb3859f7d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:04:11.426874 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5789549f-75b8-4ae5-869b-3c7bb3859f7d service nova] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:04:11.433201 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfbeafa-9fca-4ae2-b9bf-1c4b5eadf8e0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b95846f7f2a453f85ddb41a5d3327f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:04:11.433854 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfbeafa-9fca-4ae2-b9bf-1c4b5eadf8e0 service swift] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:04:11.434136 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfbeafa-9fca-4ae2-b9bf-1c4b5eadf8e0 service swift] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:04:11.434779 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfbeafa-9fca-4ae2-b9bf-1c4b5eadf8e0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:04:11.444046 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfbeafa-9fca-4ae2-b9bf-1c4b5eadf8e0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:04:11.445659 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfbeafa-9fca-4ae2-b9bf-1c4b5eadf8e0 service swift] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:04:11.454209 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1242/2491] 10.222.0.36 () {60 vars in 1384 bytes} [Fri Jun 24 23:04:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 23:04:12.041494 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857fbdfe-b54d-4ae5-a6a3-3e38d8e11aa8 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:04:12.052062 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857fbdfe-b54d-4ae5-a6a3-3e38d8e11aa8 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:04:12.056995 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e02426-0aa5-46c5-88be-5d757b65076e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:04:12.057735 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e02426-0aa5-46c5-88be-5d757b65076e service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:04:12.058007 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e02426-0aa5-46c5-88be-5d757b65076e service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:04:12.058291 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e02426-0aa5-46c5-88be-5d757b65076e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:04:12.060395 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-f7e02426-0aa5-46c5-88be-5d757b65076e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:04:12.127233 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e02426-0aa5-46c5-88be-5d757b65076e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:04:12.128935 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e02426-0aa5-46c5-88be-5d757b65076e service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:04:12.139387 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1250/2492] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:04:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:04:16.056680 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfbeafa-9fca-4ae2-b9bf-1c4b5eadf8e0 service swift] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:04:16.058138 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-0dfbeafa-9fca-4ae2-b9bf-1c4b5eadf8e0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:04:16.081731 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfbeafa-9fca-4ae2-b9bf-1c4b5eadf8e0 service swift] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:04:16.086299 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661b2d8d-e2a3-4972-87c6-b759503ab304 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a747e2a5684843a6ee9e3480badac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:04:16.086967 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b2d8d-e2a3-4972-87c6-b759503ab304 service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:04:16.087269 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b2d8d-e2a3-4972-87c6-b759503ab304 service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:04:16.087550 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b2d8d-e2a3-4972-87c6-b759503ab304 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:04:16.098167 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661b2d8d-e2a3-4972-87c6-b759503ab304 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:04:16.099680 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661b2d8d-e2a3-4972-87c6-b759503ab304 service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:04:16.109957 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1243/2493] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:04:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:04:20.190149 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e02426-0aa5-46c5-88be-5d757b65076e service neutron] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:04:20.199530 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e02426-0aa5-46c5-88be-5d757b65076e service neutron] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:04:20.204097 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5204d6e9-f6a3-45f3-a7dc-66d967127d02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:04:20.204746 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5204d6e9-f6a3-45f3-a7dc-66d967127d02 service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:04:20.205027 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5204d6e9-f6a3-45f3-a7dc-66d967127d02 service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:04:20.205305 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5204d6e9-f6a3-45f3-a7dc-66d967127d02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:04:20.207505 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-5204d6e9-f6a3-45f3-a7dc-66d967127d02 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:04:20.220875 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5204d6e9-f6a3-45f3-a7dc-66d967127d02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:04:20.222324 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5204d6e9-f6a3-45f3-a7dc-66d967127d02 service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:04:20.232842 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1251/2494] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:04:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:04:23.446120 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661b2d8d-e2a3-4972-87c6-b759503ab304 service cinder] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:04:23.447640 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-661b2d8d-e2a3-4972-87c6-b759503ab304 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:04:23.463131 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661b2d8d-e2a3-4972-87c6-b759503ab304 service cinder] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:04:23.468506 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fad4df-efdf-4b8e-a188-235adbfeb45e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0233b357708643be94c0ade17ac1fb3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:04:23.469147 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fad4df-efdf-4b8e-a188-235adbfeb45e service placement] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:04:23.469426 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fad4df-efdf-4b8e-a188-235adbfeb45e service placement] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:04:23.469695 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fad4df-efdf-4b8e-a188-235adbfeb45e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:04:23.471570 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-77fad4df-efdf-4b8e-a188-235adbfeb45e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:04:23.484436 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fad4df-efdf-4b8e-a188-235adbfeb45e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:04:23.486155 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fad4df-efdf-4b8e-a188-235adbfeb45e service placement] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:04:23.500536 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1244/2495] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:04:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:04:23.502203 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5204d6e9-f6a3-45f3-a7dc-66d967127d02 service neutron] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:04:23.504731 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-5204d6e9-f6a3-45f3-a7dc-66d967127d02 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:04:23.517888 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5204d6e9-f6a3-45f3-a7dc-66d967127d02 service neutron] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:04:23.522856 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4f1350-0128-4b09-ace1-873d346db518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:04:23.523744 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4f1350-0128-4b09-ace1-873d346db518 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:04:23.524253 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4f1350-0128-4b09-ace1-873d346db518 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:04:23.524870 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4f1350-0128-4b09-ace1-873d346db518 admin admin] PATH_INFO: `/v3/users/5ef9341f6c60435fa653581ebaa05cbc` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:04:23.526015 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4f1350-0128-4b09-ace1-873d346db518 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ef9341f6c60435fa653581ebaa05cbc)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:04:23.528300 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4f1350-0128-4b09-ace1-873d346db518 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:04:23.573166 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:04:23.579628 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-ca4f1350-0128-4b09-ace1-873d346db518 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ef9341f6c60435fa653581ebaa05cbc'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:04:23.587574 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-ca4f1350-0128-4b09-ace1-873d346db518 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ef9341f6c60435fa653581ebaa05cbc'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:04:23.588250 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-ca4f1350-0128-4b09-ace1-873d346db518 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ef9341f6c60435fa653581ebaa05cbc'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:04:23.588867 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-ca4f1350-0128-4b09-ace1-873d346db518 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ef9341f6c60435fa653581ebaa05cbc'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:04:23.601663 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-ca4f1350-0128-4b09-ace1-873d346db518 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ef9341f6c60435fa653581ebaa05cbc'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:04:23.618163 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1252/2496] 10.222.0.36 () {58 vars in 1223 bytes} [Fri Jun 24 23:04:23 2022] DELETE /identity/v3/users/5ef9341f6c60435fa653581ebaa05cbc => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 23:04:23.813694 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fad4df-efdf-4b8e-a188-235adbfeb45e service placement] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:04:23.825239 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fad4df-efdf-4b8e-a188-235adbfeb45e service placement] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:04:23.882922 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaac1e5-a1a9-4047-96c5-7fa1b7c2e0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:04:23.883772 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaac1e5-a1a9-4047-96c5-7fa1b7c2e0c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:04:23.884060 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaac1e5-a1a9-4047-96c5-7fa1b7c2e0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:04:23.884342 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaac1e5-a1a9-4047-96c5-7fa1b7c2e0c1 admin admin] PATH_INFO: `/v3/projects/d25315836739424093ce3bb14a3e96fb` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:04:23.885535 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaac1e5-a1a9-4047-96c5-7fa1b7c2e0c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d25315836739424093ce3bb14a3e96fb)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:04:23.887640 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaac1e5-a1a9-4047-96c5-7fa1b7c2e0c1 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:04:23.927883 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:04:23.937985 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-beaac1e5-a1a9-4047-96c5-7fa1b7c2e0c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd25315836739424093ce3bb14a3e96fb', 'request_id': 'req-beaac1e5-a1a9-4047-96c5-7fa1b7c2e0c1'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:04:23.944506 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-beaac1e5-a1a9-4047-96c5-7fa1b7c2e0c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd25315836739424093ce3bb14a3e96fb', 'request_id': 'req-beaac1e5-a1a9-4047-96c5-7fa1b7c2e0c1'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:04:23.953864 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-beaac1e5-a1a9-4047-96c5-7fa1b7c2e0c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd25315836739424093ce3bb14a3e96fb', 'request_id': 'req-beaac1e5-a1a9-4047-96c5-7fa1b7c2e0c1'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:04:23.964855 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-beaac1e5-a1a9-4047-96c5-7fa1b7c2e0c1 admin admin] The token cache is being invalidate because project d25315836739424093ce3bb14a3e96fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 23:04:23.965140 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-beaac1e5-a1a9-4047-96c5-7fa1b7c2e0c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:04:23.965751 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-beaac1e5-a1a9-4047-96c5-7fa1b7c2e0c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:04:23.968023 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1245/2497] 10.222.0.36 () {58 vars in 1232 bytes} [Fri Jun 24 23:04:23 2022] DELETE /identity/v3/projects/d25315836739424093ce3bb14a3e96fb => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 23:04:23.973491 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c4c726-53ae-49fd-b56b-6871b40969fe None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:04:23.973816 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c4c726-53ae-49fd-b56b-6871b40969fe None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:04:23.974105 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c4c726-53ae-49fd-b56b-6871b40969fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:04:23.992548 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-31c4c726-53ae-49fd-b56b-6871b40969fe None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 23:04:23.993805 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-31c4c726-53ae-49fd-b56b-6871b40969fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:04:24.056961 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1253/2498] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 23:04:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 23:04:24.065079 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33bd139-7d79-4db1-9f91-f93cbfa37cc2 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:04:24.065367 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33bd139-7d79-4db1-9f91-f93cbfa37cc2 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:04:24.065646 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33bd139-7d79-4db1-9f91-f93cbfa37cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:04:24.084146 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-a33bd139-7d79-4db1-9f91-f93cbfa37cc2 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 23:04:24.085328 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-a33bd139-7d79-4db1-9f91-f93cbfa37cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:04:24.094007 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1246/2499] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 23:04:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 23:04:24.098582 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c4c726-53ae-49fd-b56b-6871b40969fe None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:04:24.109326 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c4c726-53ae-49fd-b56b-6871b40969fe None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:04:24.114347 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9effcc35-d54f-467e-9013-6d9a54224d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:04:24.115000 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9effcc35-d54f-467e-9013-6d9a54224d8f admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:04:24.115296 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9effcc35-d54f-467e-9013-6d9a54224d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:04:24.115592 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9effcc35-d54f-467e-9013-6d9a54224d8f admin admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:04:24.116322 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9effcc35-d54f-467e-9013-6d9a54224d8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 23:04:24.116629 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9effcc35-d54f-467e-9013-6d9a54224d8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:04:24.118270 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9effcc35-d54f-467e-9013-6d9a54224d8f admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:04:24.130291 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1254/2500] 10.222.0.36 () {58 vars in 1152 bytes} [Fri Jun 24 23:04:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 23:04:24.134818 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33bd139-7d79-4db1-9f91-f93cbfa37cc2 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:04:24.144278 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33bd139-7d79-4db1-9f91-f93cbfa37cc2 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:04:24.149414 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3acc59d-1efc-4f6c-bd1c-5b66484e1009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:04:24.150065 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3acc59d-1efc-4f6c-bd1c-5b66484e1009 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:04:24.150349 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3acc59d-1efc-4f6c-bd1c-5b66484e1009 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:04:24.150623 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3acc59d-1efc-4f6c-bd1c-5b66484e1009 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:04:24.151346 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3acc59d-1efc-4f6c-bd1c-5b66484e1009 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:04:24.153295 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3acc59d-1efc-4f6c-bd1c-5b66484e1009 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:04:24.180908 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1247/2501] 10.222.0.36 () {60 vars in 1152 bytes} [Fri Jun 24 23:04:24 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 23:04:24.185220 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9effcc35-d54f-467e-9013-6d9a54224d8f admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:04:24.196640 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9effcc35-d54f-467e-9013-6d9a54224d8f admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:04:24.260324 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcb9b8d-1f05-4974-bcf1-ac5b72d5d4df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:04:24.260993 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcb9b8d-1f05-4974-bcf1-ac5b72d5d4df admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:04:24.261274 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcb9b8d-1f05-4974-bcf1-ac5b72d5d4df admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:04:24.261547 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcb9b8d-1f05-4974-bcf1-ac5b72d5d4df admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:04:24.262354 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcb9b8d-1f05-4974-bcf1-ac5b72d5d4df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:04:24.264362 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcb9b8d-1f05-4974-bcf1-ac5b72d5d4df admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:04:24.287395 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1255/2502] 10.222.0.36 () {60 vars in 1143 bytes} [Fri Jun 24 23:04:24 2022] POST /identity/v3/users => generated 287 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 23:04:24.293883 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3acc59d-1efc-4f6c-bd1c-5b66484e1009 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:04:24.305537 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3acc59d-1efc-4f6c-bd1c-5b66484e1009 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:04:24.312255 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7e8b10-1085-4523-b0d2-76f3c2f40ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:04:24.313441 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7e8b10-1085-4523-b0d2-76f3c2f40ad4 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:04:24.313793 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7e8b10-1085-4523-b0d2-76f3c2f40ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:04:24.314180 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7e8b10-1085-4523-b0d2-76f3c2f40ad4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:04:24.315105 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7e8b10-1085-4523-b0d2-76f3c2f40ad4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:04:24.316900 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7e8b10-1085-4523-b0d2-76f3c2f40ad4 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:04:24.328346 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1248/2503] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 23:04:24 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 23:04:24.333138 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcb9b8d-1f05-4974-bcf1-ac5b72d5d4df admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:04:24.348677 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcb9b8d-1f05-4974-bcf1-ac5b72d5d4df admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:04:24.354696 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841233a9-d6e4-462c-b427-a6eb95c1dcbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:04:24.355714 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841233a9-d6e4-462c-b427-a6eb95c1dcbd admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:04:24.356083 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841233a9-d6e4-462c-b427-a6eb95c1dcbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:04:24.356445 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841233a9-d6e4-462c-b427-a6eb95c1dcbd admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:04:24.357510 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841233a9-d6e4-462c-b427-a6eb95c1dcbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:04:24.359846 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841233a9-d6e4-462c-b427-a6eb95c1dcbd admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:04:24.373339 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1256/2504] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 23:04:24 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 23:04:24.379800 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7e8b10-1085-4523-b0d2-76f3c2f40ad4 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:04:24.394166 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7e8b10-1085-4523-b0d2-76f3c2f40ad4 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:04:24.400099 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e4685e-4902-4930-8721-866a30616097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:04:24.400990 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e4685e-4902-4930-8721-866a30616097 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:04:24.401272 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e4685e-4902-4930-8721-866a30616097 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:04:24.401547 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e4685e-4902-4930-8721-866a30616097 admin admin] PATH_INFO: `/v3/projects/91642d18cdda4c00bdacadfb8c98571e/users/1d992bc090ea439ea2b5f0a299035e9e/roles/1928787bfcc745419829cd315900ac44` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:04:24.417818 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e4685e-4902-4930-8721-866a30616097 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91642d18cdda4c00bdacadfb8c98571e, user_id=1d992bc090ea439ea2b5f0a299035e9e, role_id=1928787bfcc745419829cd315900ac44)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:04:24.420538 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e4685e-4902-4930-8721-866a30616097 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:04:24.437265 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1249/2505] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 23:04:24 2022] PUT /identity/v3/projects/91642d18cdda4c00bdacadfb8c98571e/users/1d992bc090ea439ea2b5f0a299035e9e/roles/1928787bfcc745419829cd315900ac44 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 23:04:24.448170 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d94c2ee-4877-4590-bcee-ab6cd2117edc None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:04:24.448871 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d94c2ee-4877-4590-bcee-ab6cd2117edc None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:04:24.449170 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d94c2ee-4877-4590-bcee-ab6cd2117edc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:04:24.475741 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-5d94c2ee-4877-4590-bcee-ab6cd2117edc None None] MFA Rules not processed for user `1d992bc090ea439ea2b5f0a299035e9e`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 23:04:24.476959 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-5d94c2ee-4877-4590-bcee-ab6cd2117edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:04:24.489190 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:04:24.550492 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1257/2506] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 23:04:24 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 23:04:24.562156 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e4685e-4902-4930-8721-866a30616097 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:04:24.564240 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-40e4685e-4902-4930-8721-866a30616097 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:04:24.642621 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e4685e-4902-4930-8721-866a30616097 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:04:24.650126 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a59ee4-9c12-420e-af05-9f8508ffe288 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214d9071042c4bad886bf060a079b6e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:04:24.650695 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a59ee4-9c12-420e-af05-9f8508ffe288 service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:04:24.650971 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a59ee4-9c12-420e-af05-9f8508ffe288 service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:04:24.651268 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a59ee4-9c12-420e-af05-9f8508ffe288 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:04:24.660323 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a59ee4-9c12-420e-af05-9f8508ffe288 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:04:24.661959 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a59ee4-9c12-420e-af05-9f8508ffe288 service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:04:24.671723 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1250/2507] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:04:24 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:04:34.547497 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=22 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:04:34.667316 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=72,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:05:24.644693 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d94c2ee-4877-4590-bcee-ab6cd2117edc None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:05:24.741051 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d94c2ee-4877-4590-bcee-ab6cd2117edc None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:05:24.746703 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a2b5a3-7d61-4c9e-94db-90292ee5f1d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:05:24.747651 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a2b5a3-7d61-4c9e-94db-90292ee5f1d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:05:24.747930 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a2b5a3-7d61-4c9e-94db-90292ee5f1d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:05:24.748200 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a2b5a3-7d61-4c9e-94db-90292ee5f1d1 admin admin] PATH_INFO: `/v3/users/1d992bc090ea439ea2b5f0a299035e9e` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:05:24.749493 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a2b5a3-7d61-4c9e-94db-90292ee5f1d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d992bc090ea439ea2b5f0a299035e9e)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:05:24.751642 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a2b5a3-7d61-4c9e-94db-90292ee5f1d1 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:05:24.801499 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-72a2b5a3-7d61-4c9e-94db-90292ee5f1d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d992bc090ea439ea2b5f0a299035e9e'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:05:24.808645 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-72a2b5a3-7d61-4c9e-94db-90292ee5f1d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d992bc090ea439ea2b5f0a299035e9e'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:05:24.809295 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-72a2b5a3-7d61-4c9e-94db-90292ee5f1d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d992bc090ea439ea2b5f0a299035e9e'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:05:24.809895 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-72a2b5a3-7d61-4c9e-94db-90292ee5f1d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d992bc090ea439ea2b5f0a299035e9e'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:05:24.822588 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-72a2b5a3-7d61-4c9e-94db-90292ee5f1d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d992bc090ea439ea2b5f0a299035e9e'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:05:24.838405 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1258/2508] 10.222.0.36 () {58 vars in 1223 bytes} [Fri Jun 24 23:05:24 2022] DELETE /identity/v3/users/1d992bc090ea439ea2b5f0a299035e9e => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 23:05:24.843087 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e068f3b9-950d-4675-b883-f6b47d0bd380 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:05:24.843661 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e068f3b9-950d-4675-b883-f6b47d0bd380 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:05:24.843661 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e068f3b9-950d-4675-b883-f6b47d0bd380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:05:24.883295 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-e068f3b9-950d-4675-b883-f6b47d0bd380 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 23:05:24.884503 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-e068f3b9-950d-4675-b883-f6b47d0bd380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:05:24.953850 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1251/2509] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 23:05:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 23:05:24.964456 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a2b5a3-7d61-4c9e-94db-90292ee5f1d1 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:05:24.965952 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-72a2b5a3-7d61-4c9e-94db-90292ee5f1d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:05:25.039068 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:05:25.049338 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a2b5a3-7d61-4c9e-94db-90292ee5f1d1 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:05:25.053789 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7835d6f0-8548-45af-9e1d-d76c58a1d6e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:05:25.054450 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7835d6f0-8548-45af-9e1d-d76c58a1d6e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:05:25.054737 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7835d6f0-8548-45af-9e1d-d76c58a1d6e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:05:25.055016 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7835d6f0-8548-45af-9e1d-d76c58a1d6e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:05:25.064632 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7835d6f0-8548-45af-9e1d-d76c58a1d6e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:05:25.066107 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7835d6f0-8548-45af-9e1d-d76c58a1d6e5 service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:05:25.075750 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1259/2510] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:05:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:05:25.361907 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e068f3b9-950d-4675-b883-f6b47d0bd380 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:05:25.363471 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-e068f3b9-950d-4675-b883-f6b47d0bd380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:05:25.376808 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e068f3b9-950d-4675-b883-f6b47d0bd380 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:05:25.381622 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f3639f-1b5d-4629-81dd-102bf5accdbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:05:25.382606 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f3639f-1b5d-4629-81dd-102bf5accdbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:05:25.382901 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f3639f-1b5d-4629-81dd-102bf5accdbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:05:25.383164 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f3639f-1b5d-4629-81dd-102bf5accdbd admin admin] PATH_INFO: `/v3/projects/91642d18cdda4c00bdacadfb8c98571e` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:05:25.384392 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f3639f-1b5d-4629-81dd-102bf5accdbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=91642d18cdda4c00bdacadfb8c98571e)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:05:25.386365 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f3639f-1b5d-4629-81dd-102bf5accdbd admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:05:25.437457 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-f5f3639f-1b5d-4629-81dd-102bf5accdbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91642d18cdda4c00bdacadfb8c98571e', 'request_id': 'req-f5f3639f-1b5d-4629-81dd-102bf5accdbd'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:05:25.444066 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-f5f3639f-1b5d-4629-81dd-102bf5accdbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91642d18cdda4c00bdacadfb8c98571e', 'request_id': 'req-f5f3639f-1b5d-4629-81dd-102bf5accdbd'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:05:25.453238 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-f5f3639f-1b5d-4629-81dd-102bf5accdbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91642d18cdda4c00bdacadfb8c98571e', 'request_id': 'req-f5f3639f-1b5d-4629-81dd-102bf5accdbd'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:05:25.463622 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-f5f3639f-1b5d-4629-81dd-102bf5accdbd admin admin] The token cache is being invalidate because project 91642d18cdda4c00bdacadfb8c98571e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 23:05:25.463915 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-f5f3639f-1b5d-4629-81dd-102bf5accdbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:05:25.464539 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-f5f3639f-1b5d-4629-81dd-102bf5accdbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:05:25.466110 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1252/2511] 10.222.0.36 () {58 vars in 1232 bytes} [Fri Jun 24 23:05:25 2022] DELETE /identity/v3/projects/91642d18cdda4c00bdacadfb8c98571e => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 23:05:25.471415 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c5336-eafd-44fd-8fd9-b18634106c97 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:05:25.471729 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c5336-eafd-44fd-8fd9-b18634106c97 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:05:25.472003 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c5336-eafd-44fd-8fd9-b18634106c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:05:25.520425 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-607c5336-eafd-44fd-8fd9-b18634106c97 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 23:05:25.521615 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-607c5336-eafd-44fd-8fd9-b18634106c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:05:25.582931 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1260/2512] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 23:05:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 23:05:25.592199 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0dcf4e-51dc-406a-a6c5-4d5497e2a0e6 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:05:25.592490 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0dcf4e-51dc-406a-a6c5-4d5497e2a0e6 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:05:25.592775 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0dcf4e-51dc-406a-a6c5-4d5497e2a0e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:05:25.611918 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-3d0dcf4e-51dc-406a-a6c5-4d5497e2a0e6 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 23:05:25.613129 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-3d0dcf4e-51dc-406a-a6c5-4d5497e2a0e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:05:25.622188 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1253/2513] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 23:05:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 23:05:25.626788 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607c5336-eafd-44fd-8fd9-b18634106c97 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:05:25.638210 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607c5336-eafd-44fd-8fd9-b18634106c97 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:05:25.645036 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082c62a3-9c71-4462-9132-ce8867b53968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:05:25.645697 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082c62a3-9c71-4462-9132-ce8867b53968 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:05:25.645980 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082c62a3-9c71-4462-9132-ce8867b53968 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:05:25.646252 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082c62a3-9c71-4462-9132-ce8867b53968 admin admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:05:25.646977 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082c62a3-9c71-4462-9132-ce8867b53968 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 23:05:25.647301 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082c62a3-9c71-4462-9132-ce8867b53968 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:05:25.648952 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082c62a3-9c71-4462-9132-ce8867b53968 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:05:25.661192 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1261/2514] 10.222.0.36 () {58 vars in 1152 bytes} [Fri Jun 24 23:05:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 23:05:25.666189 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0dcf4e-51dc-406a-a6c5-4d5497e2a0e6 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:05:25.680591 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0dcf4e-51dc-406a-a6c5-4d5497e2a0e6 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:05:25.687829 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d138a40-2865-40d9-9171-0bd8ec00e5f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:05:25.688477 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d138a40-2865-40d9-9171-0bd8ec00e5f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:05:25.688766 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d138a40-2865-40d9-9171-0bd8ec00e5f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:05:25.689041 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d138a40-2865-40d9-9171-0bd8ec00e5f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:05:25.689745 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d138a40-2865-40d9-9171-0bd8ec00e5f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:05:25.691715 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d138a40-2865-40d9-9171-0bd8ec00e5f9 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:05:25.734893 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1254/2515] 10.222.0.36 () {60 vars in 1152 bytes} [Fri Jun 24 23:05:25 2022] POST /identity/v3/projects => generated 405 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 23:05:25.737556 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082c62a3-9c71-4462-9132-ce8867b53968 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:05:25.748572 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082c62a3-9c71-4462-9132-ce8867b53968 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:05:25.810569 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc81ab2e-329b-486d-94d8-345f7a7d62f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:05:25.811233 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc81ab2e-329b-486d-94d8-345f7a7d62f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:05:25.811575 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc81ab2e-329b-486d-94d8-345f7a7d62f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:05:25.811852 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc81ab2e-329b-486d-94d8-345f7a7d62f4 admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:05:25.812706 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc81ab2e-329b-486d-94d8-345f7a7d62f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:05:25.814655 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc81ab2e-329b-486d-94d8-345f7a7d62f4 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:05:25.834911 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1262/2516] 10.222.0.36 () {60 vars in 1143 bytes} [Fri Jun 24 23:05:25 2022] POST /identity/v3/users => generated 303 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 23:05:25.839164 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d138a40-2865-40d9-9171-0bd8ec00e5f9 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:05:25.850158 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d138a40-2865-40d9-9171-0bd8ec00e5f9 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:05:25.855212 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffcbed2-9b2e-4378-8439-b0d36d1bd191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:05:25.855902 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffcbed2-9b2e-4378-8439-b0d36d1bd191 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:05:25.856181 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffcbed2-9b2e-4378-8439-b0d36d1bd191 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:05:25.856455 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffcbed2-9b2e-4378-8439-b0d36d1bd191 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:05:25.857203 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffcbed2-9b2e-4378-8439-b0d36d1bd191 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:05:25.858844 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffcbed2-9b2e-4378-8439-b0d36d1bd191 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:05:25.869499 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1255/2517] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 23:05:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 23:05:25.873523 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc81ab2e-329b-486d-94d8-345f7a7d62f4 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:05:25.884135 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc81ab2e-329b-486d-94d8-345f7a7d62f4 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:05:25.889470 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d670cf-e7e4-40d7-814f-3d624647aa16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:05:25.890220 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d670cf-e7e4-40d7-814f-3d624647aa16 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:05:25.890493 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d670cf-e7e4-40d7-814f-3d624647aa16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:05:25.890766 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d670cf-e7e4-40d7-814f-3d624647aa16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:05:25.891557 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d670cf-e7e4-40d7-814f-3d624647aa16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:05:25.893218 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d670cf-e7e4-40d7-814f-3d624647aa16 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:05:25.904127 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1263/2518] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 23:05:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 23:05:25.908756 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffcbed2-9b2e-4378-8439-b0d36d1bd191 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:05:25.919220 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffcbed2-9b2e-4378-8439-b0d36d1bd191 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:05:25.924582 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1055a34-1391-45e7-966d-efba13f7a2bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:05:25.925484 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1055a34-1391-45e7-966d-efba13f7a2bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:05:25.925769 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1055a34-1391-45e7-966d-efba13f7a2bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:05:25.926049 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1055a34-1391-45e7-966d-efba13f7a2bc admin admin] PATH_INFO: `/v3/projects/4a60f6bc56ca4e8db61f37a335dde09b/users/30905d3616024a34adb8c8d2a55a64ad/roles/1928787bfcc745419829cd315900ac44` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:05:25.941382 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1055a34-1391-45e7-966d-efba13f7a2bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a60f6bc56ca4e8db61f37a335dde09b, user_id=30905d3616024a34adb8c8d2a55a64ad, role_id=1928787bfcc745419829cd315900ac44)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:05:25.944085 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1055a34-1391-45e7-966d-efba13f7a2bc admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:05:25.946385 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:05:25.961245 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1256/2519] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 23:05:25 2022] PUT /identity/v3/projects/4a60f6bc56ca4e8db61f37a335dde09b/users/30905d3616024a34adb8c8d2a55a64ad/roles/1928787bfcc745419829cd315900ac44 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 23:05:25.971993 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e6dc7e-bcd9-4ee7-90c2-d8ae6694c053 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:05:25.972282 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e6dc7e-bcd9-4ee7-90c2-d8ae6694c053 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:05:25.972573 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e6dc7e-bcd9-4ee7-90c2-d8ae6694c053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:05:26.000216 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-28e6dc7e-bcd9-4ee7-90c2-d8ae6694c053 None None] MFA Rules not processed for user `30905d3616024a34adb8c8d2a55a64ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 23:05:26.001422 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-28e6dc7e-bcd9-4ee7-90c2-d8ae6694c053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:05:26.014903 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:05:26.082262 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1264/2520] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 23:05:25 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 23:05:26.087343 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1055a34-1391-45e7-966d-efba13f7a2bc admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:05:26.156380 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1055a34-1391-45e7-966d-efba13f7a2bc admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:05:26.164674 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a8f46e-b1d3-4071-8646-ec2abcb3fe7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:05:26.165375 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a8f46e-b1d3-4071-8646-ec2abcb3fe7d admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:05:26.165662 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a8f46e-b1d3-4071-8646-ec2abcb3fe7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:05:26.165920 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a8f46e-b1d3-4071-8646-ec2abcb3fe7d admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:05:26.166608 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a8f46e-b1d3-4071-8646-ec2abcb3fe7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:05:26.168621 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a8f46e-b1d3-4071-8646-ec2abcb3fe7d admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:05:26.198748 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1257/2521] 10.222.0.36 () {60 vars in 1152 bytes} [Fri Jun 24 23:05:26 2022] POST /identity/v3/projects => generated 403 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 23:05:26.204141 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e6dc7e-bcd9-4ee7-90c2-d8ae6694c053 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:05:26.217384 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e6dc7e-bcd9-4ee7-90c2-d8ae6694c053 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:05:26.287494 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe74e998-5b3e-4be3-b3e6-7e6521248386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:05:26.288548 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe74e998-5b3e-4be3-b3e6-7e6521248386 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:05:26.288995 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe74e998-5b3e-4be3-b3e6-7e6521248386 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:05:26.289412 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe74e998-5b3e-4be3-b3e6-7e6521248386 admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:05:26.290455 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe74e998-5b3e-4be3-b3e6-7e6521248386 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:05:26.293575 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe74e998-5b3e-4be3-b3e6-7e6521248386 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:05:26.319583 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1265/2522] 10.222.0.36 () {60 vars in 1143 bytes} [Fri Jun 24 23:05:26 2022] POST /identity/v3/users => generated 308 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 23:05:26.323926 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a8f46e-b1d3-4071-8646-ec2abcb3fe7d admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:05:26.334516 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a8f46e-b1d3-4071-8646-ec2abcb3fe7d admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:05:26.339567 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfccb40-2e4d-48c7-9d3b-e7f081663564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:05:26.340188 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfccb40-2e4d-48c7-9d3b-e7f081663564 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:05:26.340467 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfccb40-2e4d-48c7-9d3b-e7f081663564 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:05:26.340739 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfccb40-2e4d-48c7-9d3b-e7f081663564 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:05:26.341461 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfccb40-2e4d-48c7-9d3b-e7f081663564 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:05:26.343073 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfccb40-2e4d-48c7-9d3b-e7f081663564 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:05:26.354646 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1258/2523] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 23:05:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 23:05:26.358659 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe74e998-5b3e-4be3-b3e6-7e6521248386 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:05:26.368706 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe74e998-5b3e-4be3-b3e6-7e6521248386 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:05:26.374056 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933b3199-5099-4ca4-a144-bbe4455c3da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:05:26.374950 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b3199-5099-4ca4-a144-bbe4455c3da8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:05:26.375213 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b3199-5099-4ca4-a144-bbe4455c3da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:05:26.375515 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b3199-5099-4ca4-a144-bbe4455c3da8 admin admin] PATH_INFO: `/v3/projects/3d46ed783fd540baade3720fd6c59031/users/842d3531c35e40b0a0b41ab362d9dace/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:05:26.390367 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933b3199-5099-4ca4-a144-bbe4455c3da8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d46ed783fd540baade3720fd6c59031, user_id=842d3531c35e40b0a0b41ab362d9dace, role_id=1a1c43cc97a0407eb7a7c7a1333a9d4a)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:05:26.393086 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933b3199-5099-4ca4-a144-bbe4455c3da8 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:05:26.409860 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1266/2524] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 23:05:26 2022] PUT /identity/v3/projects/3d46ed783fd540baade3720fd6c59031/users/842d3531c35e40b0a0b41ab362d9dace/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 23:05:26.413949 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfccb40-2e4d-48c7-9d3b-e7f081663564 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:05:26.424577 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfccb40-2e4d-48c7-9d3b-e7f081663564 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:05:26.484535 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffbe2e3-8181-4f18-bb0b-2b5a350a3839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:05:26.485205 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffbe2e3-8181-4f18-bb0b-2b5a350a3839 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:05:26.485488 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffbe2e3-8181-4f18-bb0b-2b5a350a3839 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:05:26.485763 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffbe2e3-8181-4f18-bb0b-2b5a350a3839 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:05:26.486484 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffbe2e3-8181-4f18-bb0b-2b5a350a3839 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:05:26.488137 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffbe2e3-8181-4f18-bb0b-2b5a350a3839 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:05:26.498874 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1259/2525] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 23:05:26 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 23:05:26.503690 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933b3199-5099-4ca4-a144-bbe4455c3da8 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:05:26.514413 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933b3199-5099-4ca4-a144-bbe4455c3da8 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:05:26.520061 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e669d91-dc0e-4c58-8cf2-ab30626507d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:05:26.520983 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e669d91-dc0e-4c58-8cf2-ab30626507d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:05:26.521265 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e669d91-dc0e-4c58-8cf2-ab30626507d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:05:26.521538 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e669d91-dc0e-4c58-8cf2-ab30626507d8 admin admin] PATH_INFO: `/v3/projects/3d46ed783fd540baade3720fd6c59031/users/842d3531c35e40b0a0b41ab362d9dace/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:05:26.523649 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e669d91-dc0e-4c58-8cf2-ab30626507d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d46ed783fd540baade3720fd6c59031, user_id=842d3531c35e40b0a0b41ab362d9dace, role_id=1a1c43cc97a0407eb7a7c7a1333a9d4a)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:05:26.526307 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e669d91-dc0e-4c58-8cf2-ab30626507d8 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:05:26.537442 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1267/2526] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 23:05:26 2022] PUT /identity/v3/projects/3d46ed783fd540baade3720fd6c59031/users/842d3531c35e40b0a0b41ab362d9dace/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 23:05:26.547584 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb78cd0-632f-4243-ac2b-2dd1c3742ab4 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:05:26.547877 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb78cd0-632f-4243-ac2b-2dd1c3742ab4 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:05:26.548158 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb78cd0-632f-4243-ac2b-2dd1c3742ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:05:26.575478 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-abb78cd0-632f-4243-ac2b-2dd1c3742ab4 None None] MFA Rules not processed for user `842d3531c35e40b0a0b41ab362d9dace`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 23:05:26.576684 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-abb78cd0-632f-4243-ac2b-2dd1c3742ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:05:26.626423 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:05:26.655668 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1260/2527] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 23:05:26 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 23:05:36.533547 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=64,keystone:INSERT=5 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:05:36.650848 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=5 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:06:15.088561 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e669d91-dc0e-4c58-8cf2-ab30626507d8 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:06:15.090635 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-8e669d91-dc0e-4c58-8cf2-ab30626507d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:06:15.154063 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e669d91-dc0e-4c58-8cf2-ab30626507d8 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:06:15.158516 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd5bc4d-d5d3-4f7d-ba47-515085dbebdc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a747e2a5684843a6ee9e3480badac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:06:15.159160 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd5bc4d-d5d3-4f7d-ba47-515085dbebdc service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:06:15.159467 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd5bc4d-d5d3-4f7d-ba47-515085dbebdc service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:06:15.159796 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd5bc4d-d5d3-4f7d-ba47-515085dbebdc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:06:15.161960 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-dcd5bc4d-d5d3-4f7d-ba47-515085dbebdc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:06:15.236161 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd5bc4d-d5d3-4f7d-ba47-515085dbebdc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:06:15.237665 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd5bc4d-d5d3-4f7d-ba47-515085dbebdc service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:06:15.247653 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1268/2528] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:06:15 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:06:15.291272 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb78cd0-632f-4243-ac2b-2dd1c3742ab4 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:06:15.301553 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb78cd0-632f-4243-ac2b-2dd1c3742ab4 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:06:15.306154 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f273603-3822-4b74-a29e-10526b58d491 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a747e2a5684843a6ee9e3480badac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:06:15.306802 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f273603-3822-4b74-a29e-10526b58d491 service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:06:15.307088 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f273603-3822-4b74-a29e-10526b58d491 service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:06:15.307396 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f273603-3822-4b74-a29e-10526b58d491 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:06:15.309456 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-1f273603-3822-4b74-a29e-10526b58d491 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:06:15.419721 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f273603-3822-4b74-a29e-10526b58d491 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:06:15.421174 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f273603-3822-4b74-a29e-10526b58d491 service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:06:15.443999 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1261/2529] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:06:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:06:15.585483 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd5bc4d-d5d3-4f7d-ba47-515085dbebdc service cinder] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:06:15.586884 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-dcd5bc4d-d5d3-4f7d-ba47-515085dbebdc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:06:15.646434 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd5bc4d-d5d3-4f7d-ba47-515085dbebdc service cinder] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:06:15.651087 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4b278f-e349-42ad-92ad-bba4f772ec3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:06:15.651828 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4b278f-e349-42ad-92ad-bba4f772ec3c service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:06:15.652116 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4b278f-e349-42ad-92ad-bba4f772ec3c service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:06:15.652549 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4b278f-e349-42ad-92ad-bba4f772ec3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:06:15.654373 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-9c4b278f-e349-42ad-92ad-bba4f772ec3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:06:15.669757 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4b278f-e349-42ad-92ad-bba4f772ec3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:06:15.671379 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4b278f-e349-42ad-92ad-bba4f772ec3c service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:06:15.685674 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1269/2530] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:06:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:06:16.008817 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f273603-3822-4b74-a29e-10526b58d491 service cinder] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:06:16.017564 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f273603-3822-4b74-a29e-10526b58d491 service cinder] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:06:16.021516 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6890c0-bc55-431f-9018-b81ec64915ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a747e2a5684843a6ee9e3480badac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:06:16.022266 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6890c0-bc55-431f-9018-b81ec64915ea service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:06:16.022549 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6890c0-bc55-431f-9018-b81ec64915ea service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:06:16.022825 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6890c0-bc55-431f-9018-b81ec64915ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:06:16.032138 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6890c0-bc55-431f-9018-b81ec64915ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:06:16.033583 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6890c0-bc55-431f-9018-b81ec64915ea service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:06:16.043292 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1262/2531] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:06:16 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:06:16.302152 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4b278f-e349-42ad-92ad-bba4f772ec3c service neutron] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:06:16.351815 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:06:16.367451 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4b278f-e349-42ad-92ad-bba4f772ec3c service neutron] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:06:16.375532 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55d2108-c24c-492f-b444-acf85860aa21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:06:16.376794 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55d2108-c24c-492f-b444-acf85860aa21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:06:16.377139 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55d2108-c24c-492f-b444-acf85860aa21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:06:16.377493 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55d2108-c24c-492f-b444-acf85860aa21 admin admin] PATH_INFO: `/v3/users/30905d3616024a34adb8c8d2a55a64ad` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:06:16.379427 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55d2108-c24c-492f-b444-acf85860aa21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30905d3616024a34adb8c8d2a55a64ad)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:06:16.382402 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55d2108-c24c-492f-b444-acf85860aa21 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:06:16.438459 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-f55d2108-c24c-492f-b444-acf85860aa21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30905d3616024a34adb8c8d2a55a64ad'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:06:16.446243 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-f55d2108-c24c-492f-b444-acf85860aa21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30905d3616024a34adb8c8d2a55a64ad'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:06:16.446954 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-f55d2108-c24c-492f-b444-acf85860aa21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30905d3616024a34adb8c8d2a55a64ad'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:06:16.447608 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-f55d2108-c24c-492f-b444-acf85860aa21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30905d3616024a34adb8c8d2a55a64ad'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:06:16.461037 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-f55d2108-c24c-492f-b444-acf85860aa21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30905d3616024a34adb8c8d2a55a64ad'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:06:16.476315 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1270/2532] 10.222.0.36 () {58 vars in 1223 bytes} [Fri Jun 24 23:06:16 2022] DELETE /identity/v3/users/30905d3616024a34adb8c8d2a55a64ad => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 23:06:16.483286 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caab7bcb-27bf-4fe2-87fb-2a90076b66c0 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:06:16.483849 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caab7bcb-27bf-4fe2-87fb-2a90076b66c0 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:06:16.483963 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caab7bcb-27bf-4fe2-87fb-2a90076b66c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:06:16.504638 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-caab7bcb-27bf-4fe2-87fb-2a90076b66c0 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 23:06:16.505982 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-caab7bcb-27bf-4fe2-87fb-2a90076b66c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:06:16.573599 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1263/2533] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 23:06:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 23:06:16.583810 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55d2108-c24c-492f-b444-acf85860aa21 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:06:16.585614 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-f55d2108-c24c-492f-b444-acf85860aa21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:06:16.645744 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55d2108-c24c-492f-b444-acf85860aa21 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:06:16.649471 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666dbba1-9379-47be-8907-c8959e26d3c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:06:16.650149 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666dbba1-9379-47be-8907-c8959e26d3c8 service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:06:16.650421 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666dbba1-9379-47be-8907-c8959e26d3c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:06:16.650688 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666dbba1-9379-47be-8907-c8959e26d3c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:06:16.660689 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666dbba1-9379-47be-8907-c8959e26d3c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:06:16.662182 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666dbba1-9379-47be-8907-c8959e26d3c8 service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:06:16.672298 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1271/2534] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:06:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:06:17.035274 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caab7bcb-27bf-4fe2-87fb-2a90076b66c0 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:06:17.035274 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-caab7bcb-27bf-4fe2-87fb-2a90076b66c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:06:17.055985 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caab7bcb-27bf-4fe2-87fb-2a90076b66c0 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:06:17.060444 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65df73ef-9865-4c95-b6a6-28c8d1e78ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:06:17.061318 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df73ef-9865-4c95-b6a6-28c8d1e78ed0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:06:17.061596 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df73ef-9865-4c95-b6a6-28c8d1e78ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:06:17.061870 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df73ef-9865-4c95-b6a6-28c8d1e78ed0 admin admin] PATH_INFO: `/v3/projects/4a60f6bc56ca4e8db61f37a335dde09b` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:06:17.063354 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65df73ef-9865-4c95-b6a6-28c8d1e78ed0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a60f6bc56ca4e8db61f37a335dde09b)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:06:17.065313 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65df73ef-9865-4c95-b6a6-28c8d1e78ed0 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:06:17.107165 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:06:17.115333 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-65df73ef-9865-4c95-b6a6-28c8d1e78ed0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a60f6bc56ca4e8db61f37a335dde09b', 'request_id': 'req-65df73ef-9865-4c95-b6a6-28c8d1e78ed0'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:06:17.122068 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-65df73ef-9865-4c95-b6a6-28c8d1e78ed0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a60f6bc56ca4e8db61f37a335dde09b', 'request_id': 'req-65df73ef-9865-4c95-b6a6-28c8d1e78ed0'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:06:17.130639 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-65df73ef-9865-4c95-b6a6-28c8d1e78ed0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a60f6bc56ca4e8db61f37a335dde09b', 'request_id': 'req-65df73ef-9865-4c95-b6a6-28c8d1e78ed0'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:06:17.141820 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-65df73ef-9865-4c95-b6a6-28c8d1e78ed0 admin admin] The token cache is being invalidate because project 4a60f6bc56ca4e8db61f37a335dde09b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 23:06:17.142130 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-65df73ef-9865-4c95-b6a6-28c8d1e78ed0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:06:17.142810 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-65df73ef-9865-4c95-b6a6-28c8d1e78ed0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:06:17.144424 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1264/2535] 10.222.0.36 () {58 vars in 1232 bytes} [Fri Jun 24 23:06:17 2022] DELETE /identity/v3/projects/4a60f6bc56ca4e8db61f37a335dde09b => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 23:06:17.148691 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666dbba1-9379-47be-8907-c8959e26d3c8 service neutron] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:06:17.158928 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666dbba1-9379-47be-8907-c8959e26d3c8 service neutron] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:06:17.218136 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94614eb1-2b83-400e-b5a6-56a05705f45c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:06:17.219041 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94614eb1-2b83-400e-b5a6-56a05705f45c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:06:17.219383 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94614eb1-2b83-400e-b5a6-56a05705f45c admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:06:17.219653 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94614eb1-2b83-400e-b5a6-56a05705f45c admin admin] PATH_INFO: `/v3/users/842d3531c35e40b0a0b41ab362d9dace` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:06:17.220886 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94614eb1-2b83-400e-b5a6-56a05705f45c admin admin] RBAC: Authorizing `identity:delete_user(user_id=842d3531c35e40b0a0b41ab362d9dace)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:06:17.222835 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94614eb1-2b83-400e-b5a6-56a05705f45c admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:06:17.233217 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:06:17.270672 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-94614eb1-2b83-400e-b5a6-56a05705f45c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '842d3531c35e40b0a0b41ab362d9dace'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:06:17.277441 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-94614eb1-2b83-400e-b5a6-56a05705f45c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '842d3531c35e40b0a0b41ab362d9dace'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:06:17.278144 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-94614eb1-2b83-400e-b5a6-56a05705f45c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '842d3531c35e40b0a0b41ab362d9dace'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:06:17.278792 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-94614eb1-2b83-400e-b5a6-56a05705f45c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '842d3531c35e40b0a0b41ab362d9dace'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:06:17.290609 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-94614eb1-2b83-400e-b5a6-56a05705f45c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '842d3531c35e40b0a0b41ab362d9dace'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:06:17.305751 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1272/2536] 10.222.0.36 () {58 vars in 1223 bytes} [Fri Jun 24 23:06:17 2022] DELETE /identity/v3/users/842d3531c35e40b0a0b41ab362d9dace => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 23:06:17.777295 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65df73ef-9865-4c95-b6a6-28c8d1e78ed0 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:06:17.778874 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-65df73ef-9865-4c95-b6a6-28c8d1e78ed0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:06:17.792253 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65df73ef-9865-4c95-b6a6-28c8d1e78ed0 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:06:17.864232 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280dee54-7453-4b3c-84ad-a52323cab86b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:06:17.865103 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280dee54-7453-4b3c-84ad-a52323cab86b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:06:17.865562 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280dee54-7453-4b3c-84ad-a52323cab86b admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:06:17.865776 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280dee54-7453-4b3c-84ad-a52323cab86b admin admin] PATH_INFO: `/v3/projects/3d46ed783fd540baade3720fd6c59031` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:06:17.867110 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280dee54-7453-4b3c-84ad-a52323cab86b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d46ed783fd540baade3720fd6c59031)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:06:17.869592 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280dee54-7453-4b3c-84ad-a52323cab86b admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:06:17.920876 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-280dee54-7453-4b3c-84ad-a52323cab86b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d46ed783fd540baade3720fd6c59031', 'request_id': 'req-280dee54-7453-4b3c-84ad-a52323cab86b'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:06:17.927097 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-280dee54-7453-4b3c-84ad-a52323cab86b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d46ed783fd540baade3720fd6c59031', 'request_id': 'req-280dee54-7453-4b3c-84ad-a52323cab86b'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:06:17.936608 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-280dee54-7453-4b3c-84ad-a52323cab86b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d46ed783fd540baade3720fd6c59031', 'request_id': 'req-280dee54-7453-4b3c-84ad-a52323cab86b'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:06:17.947306 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-280dee54-7453-4b3c-84ad-a52323cab86b admin admin] The token cache is being invalidate because project 3d46ed783fd540baade3720fd6c59031 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 23:06:17.947600 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-280dee54-7453-4b3c-84ad-a52323cab86b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:06:17.948370 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-280dee54-7453-4b3c-84ad-a52323cab86b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:06:17.950126 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1265/2537] 10.222.0.36 () {58 vars in 1232 bytes} [Fri Jun 24 23:06:17 2022] DELETE /identity/v3/projects/3d46ed783fd540baade3720fd6c59031 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 23:06:17.955747 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c1ea1d-2990-4b73-8844-2e5499efded9 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:06:17.956145 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c1ea1d-2990-4b73-8844-2e5499efded9 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:06:17.956523 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c1ea1d-2990-4b73-8844-2e5499efded9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:06:17.979386 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-28c1ea1d-2990-4b73-8844-2e5499efded9 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 23:06:17.981305 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-28c1ea1d-2990-4b73-8844-2e5499efded9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:06:18.045136 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1273/2538] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 23:06:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 23:06:18.054280 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f7926b-f8a3-4351-8cd6-0a3f6680dd36 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:06:18.054573 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f7926b-f8a3-4351-8cd6-0a3f6680dd36 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:06:18.054844 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f7926b-f8a3-4351-8cd6-0a3f6680dd36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:06:18.074687 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-83f7926b-f8a3-4351-8cd6-0a3f6680dd36 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 23:06:18.076002 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-83f7926b-f8a3-4351-8cd6-0a3f6680dd36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:06:18.087107 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1266/2539] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 23:06:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 23:06:18.091068 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c1ea1d-2990-4b73-8844-2e5499efded9 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:06:18.101870 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c1ea1d-2990-4b73-8844-2e5499efded9 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:06:18.106645 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b57126-0913-4573-b708-444761625ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:06:18.107446 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b57126-0913-4573-b708-444761625ac2 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:06:18.107797 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b57126-0913-4573-b708-444761625ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:06:18.109153 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b57126-0913-4573-b708-444761625ac2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:06:18.110206 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b57126-0913-4573-b708-444761625ac2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 23:06:18.110580 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b57126-0913-4573-b708-444761625ac2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:06:18.112292 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b57126-0913-4573-b708-444761625ac2 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:06:18.129108 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1274/2540] 10.222.0.36 () {58 vars in 1152 bytes} [Fri Jun 24 23:06:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 23:06:18.130325 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f7926b-f8a3-4351-8cd6-0a3f6680dd36 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:06:18.139910 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f7926b-f8a3-4351-8cd6-0a3f6680dd36 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:06:18.144510 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4a07d7-11a3-4419-b12c-654b08c564c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:06:18.145833 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a07d7-11a3-4419-b12c-654b08c564c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:06:18.146120 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a07d7-11a3-4419-b12c-654b08c564c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:06:18.146470 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a07d7-11a3-4419-b12c-654b08c564c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:06:18.147164 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4a07d7-11a3-4419-b12c-654b08c564c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:06:18.149245 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4a07d7-11a3-4419-b12c-654b08c564c3 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:06:18.182375 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1267/2541] 10.222.0.36 () {60 vars in 1152 bytes} [Fri Jun 24 23:06:18 2022] POST /identity/v3/projects => generated 357 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 23:06:18.183530 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b57126-0913-4573-b708-444761625ac2 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:06:18.194308 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b57126-0913-4573-b708-444761625ac2 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:06:18.258943 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6928e8e7-5b47-4029-bf21-d0df3ee8f3b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:06:18.260014 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6928e8e7-5b47-4029-bf21-d0df3ee8f3b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:06:18.260298 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6928e8e7-5b47-4029-bf21-d0df3ee8f3b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:06:18.260568 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6928e8e7-5b47-4029-bf21-d0df3ee8f3b0 admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:06:18.261273 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6928e8e7-5b47-4029-bf21-d0df3ee8f3b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:06:18.263444 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6928e8e7-5b47-4029-bf21-d0df3ee8f3b0 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:06:18.289115 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1275/2542] 10.222.0.36 () {60 vars in 1143 bytes} [Fri Jun 24 23:06:18 2022] POST /identity/v3/users => generated 279 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 23:06:18.294632 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4a07d7-11a3-4419-b12c-654b08c564c3 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:06:18.313274 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4a07d7-11a3-4419-b12c-654b08c564c3 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:06:18.328354 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f69858e-a52a-4234-90ff-daccce5a9860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:06:18.330700 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f69858e-a52a-4234-90ff-daccce5a9860 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:06:18.330700 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f69858e-a52a-4234-90ff-daccce5a9860 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:06:18.330700 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f69858e-a52a-4234-90ff-daccce5a9860 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:06:18.330700 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f69858e-a52a-4234-90ff-daccce5a9860 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:06:18.332310 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f69858e-a52a-4234-90ff-daccce5a9860 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:06:18.353467 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6928e8e7-5b47-4029-bf21-d0df3ee8f3b0 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:06:18.354040 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1268/2543] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 23:06:18 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 23:06:18.372693 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:06:18.376876 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6928e8e7-5b47-4029-bf21-d0df3ee8f3b0 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:06:18.383909 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789e9d7a-fb54-4ef4-9879-6073ec9a96c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:06:18.384923 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789e9d7a-fb54-4ef4-9879-6073ec9a96c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:06:18.385213 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789e9d7a-fb54-4ef4-9879-6073ec9a96c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:06:18.385529 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789e9d7a-fb54-4ef4-9879-6073ec9a96c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:06:18.386269 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789e9d7a-fb54-4ef4-9879-6073ec9a96c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:06:18.388766 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789e9d7a-fb54-4ef4-9879-6073ec9a96c6 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:06:18.403327 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1276/2544] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 23:06:18 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 23:06:18.406452 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f69858e-a52a-4234-90ff-daccce5a9860 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:06:18.420401 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f69858e-a52a-4234-90ff-daccce5a9860 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:06:18.425778 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bd4217-c616-4ad0-a05b-e59ff905d5a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:06:18.427896 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bd4217-c616-4ad0-a05b-e59ff905d5a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:06:18.429570 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bd4217-c616-4ad0-a05b-e59ff905d5a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:06:18.430227 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bd4217-c616-4ad0-a05b-e59ff905d5a8 admin admin] PATH_INFO: `/v3/projects/4707e9d23c704000a5afeb961f7ab4e3/users/9fe8572d95434ae9a040922743b08fa2/roles/1928787bfcc745419829cd315900ac44` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:06:18.457329 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bd4217-c616-4ad0-a05b-e59ff905d5a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4707e9d23c704000a5afeb961f7ab4e3, user_id=9fe8572d95434ae9a040922743b08fa2, role_id=1928787bfcc745419829cd315900ac44)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:06:18.460705 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bd4217-c616-4ad0-a05b-e59ff905d5a8 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:06:18.465370 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:06:18.484374 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1269/2545] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 23:06:18 2022] PUT /identity/v3/projects/4707e9d23c704000a5afeb961f7ab4e3/users/9fe8572d95434ae9a040922743b08fa2/roles/1928787bfcc745419829cd315900ac44 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 23:06:18.495015 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee634f10-1d5d-4a75-b34f-72afd11d3a6f None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:06:18.495475 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee634f10-1d5d-4a75-b34f-72afd11d3a6f None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:06:18.495758 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee634f10-1d5d-4a75-b34f-72afd11d3a6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:06:18.523319 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-ee634f10-1d5d-4a75-b34f-72afd11d3a6f None None] MFA Rules not processed for user `9fe8572d95434ae9a040922743b08fa2`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 23:06:18.524547 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-ee634f10-1d5d-4a75-b34f-72afd11d3a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:06:18.588061 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1277/2546] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 23:06:18 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 23:06:18.592676 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bd4217-c616-4ad0-a05b-e59ff905d5a8 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:06:18.661524 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bd4217-c616-4ad0-a05b-e59ff905d5a8 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:06:18.666443 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0195f14-ba9d-467b-ba76-b80d1fddfe85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:06:18.667118 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0195f14-ba9d-467b-ba76-b80d1fddfe85 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:06:18.667430 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0195f14-ba9d-467b-ba76-b80d1fddfe85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:06:18.667709 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0195f14-ba9d-467b-ba76-b80d1fddfe85 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:06:18.668401 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0195f14-ba9d-467b-ba76-b80d1fddfe85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:06:18.670329 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0195f14-ba9d-467b-ba76-b80d1fddfe85 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:06:18.697486 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1270/2547] 10.222.0.36 () {60 vars in 1152 bytes} [Fri Jun 24 23:06:18 2022] POST /identity/v3/projects => generated 357 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 23:06:18.701375 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee634f10-1d5d-4a75-b34f-72afd11d3a6f None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:06:18.714850 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee634f10-1d5d-4a75-b34f-72afd11d3a6f None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:06:18.781662 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fcd6a9-cda4-4a6b-ab45-49888837f3fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:06:18.782344 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fcd6a9-cda4-4a6b-ab45-49888837f3fb admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:06:18.782624 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fcd6a9-cda4-4a6b-ab45-49888837f3fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:06:18.782896 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fcd6a9-cda4-4a6b-ab45-49888837f3fb admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:06:18.783620 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fcd6a9-cda4-4a6b-ab45-49888837f3fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:06:18.785643 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fcd6a9-cda4-4a6b-ab45-49888837f3fb admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:06:18.808949 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1278/2548] 10.222.0.36 () {60 vars in 1143 bytes} [Fri Jun 24 23:06:18 2022] POST /identity/v3/users => generated 285 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 23:06:18.813133 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0195f14-ba9d-467b-ba76-b80d1fddfe85 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:06:18.827068 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0195f14-ba9d-467b-ba76-b80d1fddfe85 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:06:18.832166 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0651e686-98dd-4898-9695-93f28c42f238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:06:18.833361 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0651e686-98dd-4898-9695-93f28c42f238 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:06:18.833361 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0651e686-98dd-4898-9695-93f28c42f238 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:06:18.833607 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0651e686-98dd-4898-9695-93f28c42f238 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:06:18.834284 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0651e686-98dd-4898-9695-93f28c42f238 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:06:18.836007 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0651e686-98dd-4898-9695-93f28c42f238 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:06:18.848467 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1271/2549] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 23:06:18 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 23:06:18.853080 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fcd6a9-cda4-4a6b-ab45-49888837f3fb admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:06:18.864846 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fcd6a9-cda4-4a6b-ab45-49888837f3fb admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:06:18.870060 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d54c16-244e-4e26-83b2-517192a764fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:06:18.870990 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d54c16-244e-4e26-83b2-517192a764fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:06:18.871297 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d54c16-244e-4e26-83b2-517192a764fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:06:18.871574 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d54c16-244e-4e26-83b2-517192a764fe admin admin] PATH_INFO: `/v3/projects/ebf024fbd4ab404193d2ef1aa2b79084/users/948d98fb47c745d9b8d9615211952575/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:06:18.894104 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d54c16-244e-4e26-83b2-517192a764fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebf024fbd4ab404193d2ef1aa2b79084, user_id=948d98fb47c745d9b8d9615211952575, role_id=1a1c43cc97a0407eb7a7c7a1333a9d4a)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:06:18.897522 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d54c16-244e-4e26-83b2-517192a764fe admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:06:18.914513 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1279/2550] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 23:06:18 2022] PUT /identity/v3/projects/ebf024fbd4ab404193d2ef1aa2b79084/users/948d98fb47c745d9b8d9615211952575/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 23:06:18.918396 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0651e686-98dd-4898-9695-93f28c42f238 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:06:18.928389 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0651e686-98dd-4898-9695-93f28c42f238 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:06:18.988757 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c850dc25-7268-4462-a693-04ad2aa08677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:06:18.989455 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c850dc25-7268-4462-a693-04ad2aa08677 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:06:18.989740 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c850dc25-7268-4462-a693-04ad2aa08677 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:06:18.990011 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c850dc25-7268-4462-a693-04ad2aa08677 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:06:18.990796 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c850dc25-7268-4462-a693-04ad2aa08677 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:06:18.992674 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c850dc25-7268-4462-a693-04ad2aa08677 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:06:19.005165 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1272/2551] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 23:06:18 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 23:06:19.009935 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d54c16-244e-4e26-83b2-517192a764fe admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:06:19.021546 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d54c16-244e-4e26-83b2-517192a764fe admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:06:19.027821 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0b0372-1657-41f9-a666-83852621081f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:06:19.028761 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0b0372-1657-41f9-a666-83852621081f admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:06:19.029029 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0b0372-1657-41f9-a666-83852621081f admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:06:19.029321 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0b0372-1657-41f9-a666-83852621081f admin admin] PATH_INFO: `/v3/projects/ebf024fbd4ab404193d2ef1aa2b79084/users/948d98fb47c745d9b8d9615211952575/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:06:19.031598 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0b0372-1657-41f9-a666-83852621081f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebf024fbd4ab404193d2ef1aa2b79084, user_id=948d98fb47c745d9b8d9615211952575, role_id=1a1c43cc97a0407eb7a7c7a1333a9d4a)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:06:19.034721 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0b0372-1657-41f9-a666-83852621081f admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:06:19.047452 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1280/2552] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 23:06:19 2022] PUT /identity/v3/projects/ebf024fbd4ab404193d2ef1aa2b79084/users/948d98fb47c745d9b8d9615211952575/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 23:06:19.059085 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335ec8f9-d73f-46c8-b379-2a12be75d546 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:06:19.059399 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335ec8f9-d73f-46c8-b379-2a12be75d546 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:06:19.059707 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335ec8f9-d73f-46c8-b379-2a12be75d546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:06:19.089414 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-335ec8f9-d73f-46c8-b379-2a12be75d546 None None] MFA Rules not processed for user `948d98fb47c745d9b8d9615211952575`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 23:06:19.090564 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-335ec8f9-d73f-46c8-b379-2a12be75d546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:06:19.146086 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:06:19.167316 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1273/2553] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 23:06:19 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 23:06:21.161482 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aea78ae-d0c7-4998-b854-223dd9ec5cac None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:06:21.162030 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aea78ae-d0c7-4998-b854-223dd9ec5cac None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:06:21.162229 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aea78ae-d0c7-4998-b854-223dd9ec5cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:06:21.192896 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-6aea78ae-d0c7-4998-b854-223dd9ec5cac None None] MFA Rules not processed for user `d38e573b57c147afa87ba5aceb21f73b`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 23:06:21.194325 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-6aea78ae-d0c7-4998-b854-223dd9ec5cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:06:21.213724 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:06:21.253369 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1281/2554] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 23:06:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 23:06:24.672370 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335ec8f9-d73f-46c8-b379-2a12be75d546 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:06:24.673940 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-335ec8f9-d73f-46c8-b379-2a12be75d546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:06:24.737038 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335ec8f9-d73f-46c8-b379-2a12be75d546 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:06:24.741325 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975571cd-e773-458a-9d0a-630a82bed18a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:06:24.742126 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975571cd-e773-458a-9d0a-630a82bed18a service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:06:24.743155 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975571cd-e773-458a-9d0a-630a82bed18a service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:06:24.743844 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975571cd-e773-458a-9d0a-630a82bed18a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:06:24.746114 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-975571cd-e773-458a-9d0a-630a82bed18a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:06:24.757589 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975571cd-e773-458a-9d0a-630a82bed18a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:06:24.759287 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975571cd-e773-458a-9d0a-630a82bed18a service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:06:24.768398 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1274/2555] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:06:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:06:31.246685 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=14 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:06:34.764755 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=30 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:07:25.866926 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aea78ae-d0c7-4998-b854-223dd9ec5cac None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:07:25.868863 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-6aea78ae-d0c7-4998-b854-223dd9ec5cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:07:25.966954 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aea78ae-d0c7-4998-b854-223dd9ec5cac None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:07:25.972244 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41f85e6-ddcd-4a09-9082-bf765feb4c86 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0233b357708643be94c0ade17ac1fb3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:07:25.972902 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41f85e6-ddcd-4a09-9082-bf765feb4c86 service placement] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:07:25.973188 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41f85e6-ddcd-4a09-9082-bf765feb4c86 service placement] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:07:25.973464 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41f85e6-ddcd-4a09-9082-bf765feb4c86 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:07:25.975239 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-c41f85e6-ddcd-4a09-9082-bf765feb4c86 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:07:25.987708 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41f85e6-ddcd-4a09-9082-bf765feb4c86 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:07:25.989315 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41f85e6-ddcd-4a09-9082-bf765feb4c86 service placement] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:07:26.004132 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1282/2556] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:07:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:07:35.996493 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=37 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:08:16.112619 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975571cd-e773-458a-9d0a-630a82bed18a service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:08:16.114503 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-975571cd-e773-458a-9d0a-630a82bed18a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:08:16.188562 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975571cd-e773-458a-9d0a-630a82bed18a service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:08:16.192481 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ea87c7-5ec4-4764-9769-4f42fb69548e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a747e2a5684843a6ee9e3480badac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:08:16.193129 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ea87c7-5ec4-4764-9769-4f42fb69548e service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:08:16.193407 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ea87c7-5ec4-4764-9769-4f42fb69548e service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:08:16.193682 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ea87c7-5ec4-4764-9769-4f42fb69548e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:08:16.195680 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-c6ea87c7-5ec4-4764-9769-4f42fb69548e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:08:16.280393 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ea87c7-5ec4-4764-9769-4f42fb69548e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:08:16.281839 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ea87c7-5ec4-4764-9769-4f42fb69548e service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:08:16.300104 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1275/2557] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:08:16 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:08:16.344518 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41f85e6-ddcd-4a09-9082-bf765feb4c86 service placement] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:08:16.355288 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41f85e6-ddcd-4a09-9082-bf765feb4c86 service placement] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:08:16.360198 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5ca57a-62ad-4b70-92c3-12ae0187e316 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a747e2a5684843a6ee9e3480badac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:08:16.360830 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ca57a-62ad-4b70-92c3-12ae0187e316 service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:08:16.361116 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ca57a-62ad-4b70-92c3-12ae0187e316 service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:08:16.361385 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ca57a-62ad-4b70-92c3-12ae0187e316 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:08:16.363670 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-5b5ca57a-62ad-4b70-92c3-12ae0187e316 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:08:16.442824 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5ca57a-62ad-4b70-92c3-12ae0187e316 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:08:16.444313 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5ca57a-62ad-4b70-92c3-12ae0187e316 service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:08:16.453430 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1283/2558] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:08:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:08:16.518289 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ea87c7-5ec4-4764-9769-4f42fb69548e service cinder] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:08:16.526977 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ea87c7-5ec4-4764-9769-4f42fb69548e service cinder] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:08:16.531237 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ac66d6-d434-4c26-b992-6d327f507833 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a747e2a5684843a6ee9e3480badac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:08:16.531896 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac66d6-d434-4c26-b992-6d327f507833 service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:08:16.532171 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac66d6-d434-4c26-b992-6d327f507833 service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:08:16.532441 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac66d6-d434-4c26-b992-6d327f507833 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:08:16.542006 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ac66d6-d434-4c26-b992-6d327f507833 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:08:16.543467 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ac66d6-d434-4c26-b992-6d327f507833 service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:08:16.554106 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1276/2559] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:08:16 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:08:16.955089 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5ca57a-62ad-4b70-92c3-12ae0187e316 service cinder] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:08:16.968841 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5ca57a-62ad-4b70-92c3-12ae0187e316 service cinder] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:08:16.979069 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfac140-414f-4845-a014-b7d4eb7e7622 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:08:16.981458 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfac140-414f-4845-a014-b7d4eb7e7622 service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:08:16.981939 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfac140-414f-4845-a014-b7d4eb7e7622 service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:08:16.982432 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfac140-414f-4845-a014-b7d4eb7e7622 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:08:16.983714 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ac66d6-d434-4c26-b992-6d327f507833 service cinder] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:08:16.984699 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-bcfac140-414f-4845-a014-b7d4eb7e7622 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:08:16.985319 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-02ac66d6-d434-4c26-b992-6d327f507833 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:08:16.998531 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ac66d6-d434-4c26-b992-6d327f507833 service cinder] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:08:17.003140 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3bd6d7-fe3a-47b8-b713-4782d29ace8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a747e2a5684843a6ee9e3480badac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:08:17.004264 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3bd6d7-fe3a-47b8-b713-4782d29ace8c service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:08:17.004771 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3bd6d7-fe3a-47b8-b713-4782d29ace8c service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:08:17.005173 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3bd6d7-fe3a-47b8-b713-4782d29ace8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:08:17.094100 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfac140-414f-4845-a014-b7d4eb7e7622 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:08:17.096549 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3bd6d7-fe3a-47b8-b713-4782d29ace8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:08:17.096723 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfac140-414f-4845-a014-b7d4eb7e7622 service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:08:17.098353 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3bd6d7-fe3a-47b8-b713-4782d29ace8c service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:08:17.104774 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:08:17.118963 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1284/2560] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:08:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:08:17.119402 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1277/2561] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:08:16 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 23:08:17.832104 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfac140-414f-4845-a014-b7d4eb7e7622 service neutron] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:08:17.841324 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfac140-414f-4845-a014-b7d4eb7e7622 service neutron] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:08:17.845925 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72be44da-67d3-4601-82a6-280c5b993cfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:08:17.846574 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be44da-67d3-4601-82a6-280c5b993cfd service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:08:17.846850 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be44da-67d3-4601-82a6-280c5b993cfd service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:08:17.847101 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be44da-67d3-4601-82a6-280c5b993cfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:08:17.849340 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-72be44da-67d3-4601-82a6-280c5b993cfd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:08:17.933002 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72be44da-67d3-4601-82a6-280c5b993cfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:08:17.934532 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72be44da-67d3-4601-82a6-280c5b993cfd service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:08:17.939684 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:08:17.954667 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1285/2562] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:08:17 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:08:20.940358 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3bd6d7-fe3a-47b8-b713-4782d29ace8c service cinder] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:08:20.953290 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3bd6d7-fe3a-47b8-b713-4782d29ace8c service cinder] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:08:20.958454 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601c2f00-e79f-4bf7-8858-08edce4bfd49 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0233b357708643be94c0ade17ac1fb3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:08:20.959232 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c2f00-e79f-4bf7-8858-08edce4bfd49 service placement] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:08:20.959616 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c2f00-e79f-4bf7-8858-08edce4bfd49 service placement] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:08:20.959955 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c2f00-e79f-4bf7-8858-08edce4bfd49 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:08:20.961911 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-601c2f00-e79f-4bf7-8858-08edce4bfd49 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:08:20.973996 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601c2f00-e79f-4bf7-8858-08edce4bfd49 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:08:20.975643 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601c2f00-e79f-4bf7-8858-08edce4bfd49 service placement] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:08:20.986410 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1278/2563] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:08:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:08:24.245200 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72be44da-67d3-4601-82a6-280c5b993cfd service neutron] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:08:24.246802 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-72be44da-67d3-4601-82a6-280c5b993cfd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:08:24.263034 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72be44da-67d3-4601-82a6-280c5b993cfd service neutron] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:08:24.268640 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9849ce9-6cba-47cc-b53a-ee5f4e616760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:08:24.269531 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9849ce9-6cba-47cc-b53a-ee5f4e616760 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:08:24.269811 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9849ce9-6cba-47cc-b53a-ee5f4e616760 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:08:24.270080 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9849ce9-6cba-47cc-b53a-ee5f4e616760 admin admin] PATH_INFO: `/v3/users/daaf3a9a0ca54d048633192dda71384f` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:08:24.271352 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9849ce9-6cba-47cc-b53a-ee5f4e616760 admin admin] RBAC: Authorizing `identity:delete_user(user_id=daaf3a9a0ca54d048633192dda71384f)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:08:24.273234 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9849ce9-6cba-47cc-b53a-ee5f4e616760 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:08:24.323242 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-d9849ce9-6cba-47cc-b53a-ee5f4e616760 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'daaf3a9a0ca54d048633192dda71384f'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:08:24.330428 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-d9849ce9-6cba-47cc-b53a-ee5f4e616760 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'daaf3a9a0ca54d048633192dda71384f'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:08:24.331105 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-d9849ce9-6cba-47cc-b53a-ee5f4e616760 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'daaf3a9a0ca54d048633192dda71384f'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:08:24.331758 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-d9849ce9-6cba-47cc-b53a-ee5f4e616760 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'daaf3a9a0ca54d048633192dda71384f'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:08:24.344619 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-d9849ce9-6cba-47cc-b53a-ee5f4e616760 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'daaf3a9a0ca54d048633192dda71384f'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:08:24.360015 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1286/2564] 10.222.0.36 () {58 vars in 1223 bytes} [Fri Jun 24 23:08:24 2022] DELETE /identity/v3/users/daaf3a9a0ca54d048633192dda71384f => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 23:08:24.553473 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601c2f00-e79f-4bf7-8858-08edce4bfd49 service placement] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:08:24.564749 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601c2f00-e79f-4bf7-8858-08edce4bfd49 service placement] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:08:24.626757 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2fa547-e204-41eb-8d0c-cea6302c8beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:08:24.627663 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2fa547-e204-41eb-8d0c-cea6302c8beb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:08:24.627952 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2fa547-e204-41eb-8d0c-cea6302c8beb admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:08:24.628232 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2fa547-e204-41eb-8d0c-cea6302c8beb admin admin] PATH_INFO: `/v3/projects/b2504fe6b85c4a0b810bddb0e6e9b05f` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:08:24.629507 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2fa547-e204-41eb-8d0c-cea6302c8beb admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2504fe6b85c4a0b810bddb0e6e9b05f)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:08:24.631480 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2fa547-e204-41eb-8d0c-cea6302c8beb admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:08:24.686876 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-4c2fa547-e204-41eb-8d0c-cea6302c8beb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2504fe6b85c4a0b810bddb0e6e9b05f', 'request_id': 'req-4c2fa547-e204-41eb-8d0c-cea6302c8beb'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:08:24.693327 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-4c2fa547-e204-41eb-8d0c-cea6302c8beb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2504fe6b85c4a0b810bddb0e6e9b05f', 'request_id': 'req-4c2fa547-e204-41eb-8d0c-cea6302c8beb'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:08:24.702174 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-4c2fa547-e204-41eb-8d0c-cea6302c8beb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2504fe6b85c4a0b810bddb0e6e9b05f', 'request_id': 'req-4c2fa547-e204-41eb-8d0c-cea6302c8beb'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:08:24.714414 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-4c2fa547-e204-41eb-8d0c-cea6302c8beb admin admin] The token cache is being invalidate because project b2504fe6b85c4a0b810bddb0e6e9b05f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 23:08:24.714746 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-4c2fa547-e204-41eb-8d0c-cea6302c8beb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:08:24.715439 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-4c2fa547-e204-41eb-8d0c-cea6302c8beb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:08:24.719103 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1279/2565] 10.222.0.36 () {58 vars in 1232 bytes} [Fri Jun 24 23:08:24 2022] DELETE /identity/v3/projects/b2504fe6b85c4a0b810bddb0e6e9b05f => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 23:08:24.723170 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9849ce9-6cba-47cc-b53a-ee5f4e616760 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:08:24.724757 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-d9849ce9-6cba-47cc-b53a-ee5f4e616760 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:08:24.739374 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9849ce9-6cba-47cc-b53a-ee5f4e616760 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:08:24.807124 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7293965f-c41d-4241-bf64-7fc1d838e643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:08:24.808047 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7293965f-c41d-4241-bf64-7fc1d838e643 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:08:24.808305 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7293965f-c41d-4241-bf64-7fc1d838e643 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:08:24.808601 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7293965f-c41d-4241-bf64-7fc1d838e643 admin admin] PATH_INFO: `/v3/users/e439990adb0e479baaa89bb61880f2b1` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:08:24.823382 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7293965f-c41d-4241-bf64-7fc1d838e643 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e439990adb0e479baaa89bb61880f2b1)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:08:24.825918 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7293965f-c41d-4241-bf64-7fc1d838e643 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:08:24.877226 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-7293965f-c41d-4241-bf64-7fc1d838e643 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e439990adb0e479baaa89bb61880f2b1'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:08:24.882775 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:08:24.884995 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-7293965f-c41d-4241-bf64-7fc1d838e643 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e439990adb0e479baaa89bb61880f2b1'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:08:24.885964 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-7293965f-c41d-4241-bf64-7fc1d838e643 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e439990adb0e479baaa89bb61880f2b1'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:08:24.886853 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-7293965f-c41d-4241-bf64-7fc1d838e643 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e439990adb0e479baaa89bb61880f2b1'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:08:24.900563 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-7293965f-c41d-4241-bf64-7fc1d838e643 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e439990adb0e479baaa89bb61880f2b1'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:08:24.913819 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1287/2566] 10.222.0.36 () {58 vars in 1223 bytes} [Fri Jun 24 23:08:24 2022] DELETE /identity/v3/users/e439990adb0e479baaa89bb61880f2b1 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 23:08:25.097829 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2fa547-e204-41eb-8d0c-cea6302c8beb admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:08:25.099446 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-4c2fa547-e204-41eb-8d0c-cea6302c8beb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:08:25.113806 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2fa547-e204-41eb-8d0c-cea6302c8beb admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:08:25.172811 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0043ea5f-d144-4c8c-9147-997c5a6defab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:08:25.173692 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0043ea5f-d144-4c8c-9147-997c5a6defab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:08:25.173969 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0043ea5f-d144-4c8c-9147-997c5a6defab admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:08:25.174244 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0043ea5f-d144-4c8c-9147-997c5a6defab admin admin] PATH_INFO: `/v3/projects/f343c18f5b094e41a0035b6af2c9d0b4` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:08:25.185022 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0043ea5f-d144-4c8c-9147-997c5a6defab admin admin] RBAC: Authorizing `identity:delete_project(project_id=f343c18f5b094e41a0035b6af2c9d0b4)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:08:25.186957 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0043ea5f-d144-4c8c-9147-997c5a6defab admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:08:25.197943 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:08:25.238602 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-0043ea5f-d144-4c8c-9147-997c5a6defab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f343c18f5b094e41a0035b6af2c9d0b4', 'request_id': 'req-0043ea5f-d144-4c8c-9147-997c5a6defab'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:08:25.245473 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-0043ea5f-d144-4c8c-9147-997c5a6defab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f343c18f5b094e41a0035b6af2c9d0b4', 'request_id': 'req-0043ea5f-d144-4c8c-9147-997c5a6defab'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:08:25.255577 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-0043ea5f-d144-4c8c-9147-997c5a6defab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f343c18f5b094e41a0035b6af2c9d0b4', 'request_id': 'req-0043ea5f-d144-4c8c-9147-997c5a6defab'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:08:25.266778 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-0043ea5f-d144-4c8c-9147-997c5a6defab admin admin] The token cache is being invalidate because project f343c18f5b094e41a0035b6af2c9d0b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 23:08:25.267060 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-0043ea5f-d144-4c8c-9147-997c5a6defab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:08:25.267748 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-0043ea5f-d144-4c8c-9147-997c5a6defab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:08:25.269310 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1280/2567] 10.222.0.36 () {58 vars in 1232 bytes} [Fri Jun 24 23:08:25 2022] DELETE /identity/v3/projects/f343c18f5b094e41a0035b6af2c9d0b4 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 23:08:34.910462 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=9,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:08:35.263406 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=20,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:10:17.316700 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7293965f-c41d-4241-bf64-7fc1d838e643 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:10:17.318302 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-7293965f-c41d-4241-bf64-7fc1d838e643 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:10:17.381995 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7293965f-c41d-4241-bf64-7fc1d838e643 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:10:17.434763 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068215c8-8018-4062-956a-150408f01511 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a747e2a5684843a6ee9e3480badac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:10:17.435620 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068215c8-8018-4062-956a-150408f01511 service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:10:17.435903 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068215c8-8018-4062-956a-150408f01511 service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:10:17.436175 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068215c8-8018-4062-956a-150408f01511 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:10:17.438364 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-068215c8-8018-4062-956a-150408f01511 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:10:17.511268 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068215c8-8018-4062-956a-150408f01511 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:10:17.512664 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068215c8-8018-4062-956a-150408f01511 service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:10:17.534863 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1288/2568] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:10:17 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:10:17.915782 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0043ea5f-d144-4c8c-9147-997c5a6defab admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:10:17.917313 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-0043ea5f-d144-4c8c-9147-997c5a6defab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:10:17.978326 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0043ea5f-d144-4c8c-9147-997c5a6defab admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:10:17.985594 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7ed3b1-c9d4-408d-bc29-b5a3b24cdc40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:10:17.986522 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7ed3b1-c9d4-408d-bc29-b5a3b24cdc40 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:10:17.986962 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7ed3b1-c9d4-408d-bc29-b5a3b24cdc40 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:10:17.987407 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7ed3b1-c9d4-408d-bc29-b5a3b24cdc40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:10:17.990609 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-fb7ed3b1-c9d4-408d-bc29-b5a3b24cdc40 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:10:18.059622 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7ed3b1-c9d4-408d-bc29-b5a3b24cdc40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:10:18.060987 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7ed3b1-c9d4-408d-bc29-b5a3b24cdc40 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:10:18.074786 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1281/2569] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:10:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:10:20.929610 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068215c8-8018-4062-956a-150408f01511 service cinder] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:10:20.930212 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-068215c8-8018-4062-956a-150408f01511 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:10:20.981307 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7ed3b1-c9d4-408d-bc29-b5a3b24cdc40 service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:10:20.982920 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-fb7ed3b1-c9d4-408d-bc29-b5a3b24cdc40 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:10:20.997640 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:10:21.001456 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7ed3b1-c9d4-408d-bc29-b5a3b24cdc40 service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:10:21.008023 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452aa6b8-ed36-4f89-8598-c255d6deeb50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:10:21.009576 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452aa6b8-ed36-4f89-8598-c255d6deeb50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:10:21.009864 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452aa6b8-ed36-4f89-8598-c255d6deeb50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:10:21.010144 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452aa6b8-ed36-4f89-8598-c255d6deeb50 admin admin] PATH_INFO: `/v3/users/a3b0839709774ee6854a51acc7fd79f5` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:10:21.011446 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452aa6b8-ed36-4f89-8598-c255d6deeb50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3b0839709774ee6854a51acc7fd79f5)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:10:21.013470 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452aa6b8-ed36-4f89-8598-c255d6deeb50 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:10:21.016092 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068215c8-8018-4062-956a-150408f01511 service cinder] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:10:21.021743 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742af0a2-7b4a-4dfd-a565-c79d51d57593 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0233b357708643be94c0ade17ac1fb3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:10:21.022399 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742af0a2-7b4a-4dfd-a565-c79d51d57593 service placement] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:10:21.022676 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742af0a2-7b4a-4dfd-a565-c79d51d57593 service placement] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:10:21.022953 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742af0a2-7b4a-4dfd-a565-c79d51d57593 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:10:21.024856 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-742af0a2-7b4a-4dfd-a565-c79d51d57593 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:10:21.037250 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742af0a2-7b4a-4dfd-a565-c79d51d57593 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:10:21.038711 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742af0a2-7b4a-4dfd-a565-c79d51d57593 service placement] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:10:21.050648 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1289/2570] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:10:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:10:21.070093 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-452aa6b8-ed36-4f89-8598-c255d6deeb50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3b0839709774ee6854a51acc7fd79f5'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:10:21.078534 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-452aa6b8-ed36-4f89-8598-c255d6deeb50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3b0839709774ee6854a51acc7fd79f5'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:10:21.079655 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-452aa6b8-ed36-4f89-8598-c255d6deeb50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3b0839709774ee6854a51acc7fd79f5'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:10:21.080490 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-452aa6b8-ed36-4f89-8598-c255d6deeb50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3b0839709774ee6854a51acc7fd79f5'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:10:21.094188 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-452aa6b8-ed36-4f89-8598-c255d6deeb50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3b0839709774ee6854a51acc7fd79f5'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:10:21.108920 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1282/2571] 10.222.0.36 () {58 vars in 1223 bytes} [Fri Jun 24 23:10:20 2022] DELETE /identity/v3/users/a3b0839709774ee6854a51acc7fd79f5 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 23:10:21.299787 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742af0a2-7b4a-4dfd-a565-c79d51d57593 service placement] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:10:21.310940 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742af0a2-7b4a-4dfd-a565-c79d51d57593 service placement] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:10:21.375623 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee58671-1f6c-4ca0-9664-ddb517f75790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:10:21.376497 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee58671-1f6c-4ca0-9664-ddb517f75790 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:10:21.376774 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee58671-1f6c-4ca0-9664-ddb517f75790 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:10:21.377048 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee58671-1f6c-4ca0-9664-ddb517f75790 admin admin] PATH_INFO: `/v3/projects/92cea039a96d4972aacfe236615d15c0` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:10:21.388004 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee58671-1f6c-4ca0-9664-ddb517f75790 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92cea039a96d4972aacfe236615d15c0)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:10:21.389845 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee58671-1f6c-4ca0-9664-ddb517f75790 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:10:21.442770 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-3ee58671-1f6c-4ca0-9664-ddb517f75790 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92cea039a96d4972aacfe236615d15c0', 'request_id': 'req-3ee58671-1f6c-4ca0-9664-ddb517f75790'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:10:21.449922 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-3ee58671-1f6c-4ca0-9664-ddb517f75790 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92cea039a96d4972aacfe236615d15c0', 'request_id': 'req-3ee58671-1f6c-4ca0-9664-ddb517f75790'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:10:21.458420 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-3ee58671-1f6c-4ca0-9664-ddb517f75790 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92cea039a96d4972aacfe236615d15c0', 'request_id': 'req-3ee58671-1f6c-4ca0-9664-ddb517f75790'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:10:21.468558 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-3ee58671-1f6c-4ca0-9664-ddb517f75790 admin admin] The token cache is being invalidate because project 92cea039a96d4972aacfe236615d15c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 23:10:21.468846 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-3ee58671-1f6c-4ca0-9664-ddb517f75790 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:10:21.469458 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-3ee58671-1f6c-4ca0-9664-ddb517f75790 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:10:21.470997 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1290/2572] 10.222.0.36 () {58 vars in 1232 bytes} [Fri Jun 24 23:10:21 2022] DELETE /identity/v3/projects/92cea039a96d4972aacfe236615d15c0 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 23:10:21.477070 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34061325-4699-41c7-a3ce-b67ddb10c439 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:10:21.477351 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34061325-4699-41c7-a3ce-b67ddb10c439 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:10:21.477631 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34061325-4699-41c7-a3ce-b67ddb10c439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:10:21.496423 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-34061325-4699-41c7-a3ce-b67ddb10c439 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 23:10:21.497629 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-34061325-4699-41c7-a3ce-b67ddb10c439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:10:21.516115 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:10:21.568407 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1283/2573] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 23:10:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 23:10:21.576933 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630c0974-5eab-42c6-aab8-d7b5037aa7f2 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:10:21.577224 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630c0974-5eab-42c6-aab8-d7b5037aa7f2 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:10:21.577508 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630c0974-5eab-42c6-aab8-d7b5037aa7f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:10:21.595301 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-630c0974-5eab-42c6-aab8-d7b5037aa7f2 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 23:10:21.596497 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-630c0974-5eab-42c6-aab8-d7b5037aa7f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:10:21.605036 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1291/2574] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 23:10:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 23:10:21.609471 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34061325-4699-41c7-a3ce-b67ddb10c439 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:10:21.620226 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34061325-4699-41c7-a3ce-b67ddb10c439 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:10:21.625736 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2777d4-7c32-43ba-915e-068f0287cfeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:10:21.626398 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2777d4-7c32-43ba-915e-068f0287cfeb admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:10:21.626677 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2777d4-7c32-43ba-915e-068f0287cfeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:10:21.626951 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2777d4-7c32-43ba-915e-068f0287cfeb admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:10:21.627694 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2777d4-7c32-43ba-915e-068f0287cfeb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 23:10:21.628001 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2777d4-7c32-43ba-915e-068f0287cfeb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:10:21.629622 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2777d4-7c32-43ba-915e-068f0287cfeb admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:10:21.642219 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1284/2575] 10.222.0.36 () {58 vars in 1152 bytes} [Fri Jun 24 23:10:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 23:10:21.646748 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630c0974-5eab-42c6-aab8-d7b5037aa7f2 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:10:21.661739 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630c0974-5eab-42c6-aab8-d7b5037aa7f2 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:10:21.666970 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ecbbec-2629-4a0a-b288-25ff8f82b829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:10:21.667685 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ecbbec-2629-4a0a-b288-25ff8f82b829 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:10:21.667962 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ecbbec-2629-4a0a-b288-25ff8f82b829 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:10:21.668232 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ecbbec-2629-4a0a-b288-25ff8f82b829 admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:10:21.668926 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ecbbec-2629-4a0a-b288-25ff8f82b829 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:10:21.670936 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ecbbec-2629-4a0a-b288-25ff8f82b829 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:10:21.699177 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1292/2576] 10.222.0.36 () {60 vars in 1152 bytes} [Fri Jun 24 23:10:21 2022] POST /identity/v3/projects => generated 377 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 23:10:21.703631 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2777d4-7c32-43ba-915e-068f0287cfeb admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:10:21.714079 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2777d4-7c32-43ba-915e-068f0287cfeb admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:10:21.783054 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dcb14b-86f9-4be6-ab31-9f32ffac5bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:10:21.783749 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dcb14b-86f9-4be6-ab31-9f32ffac5bc4 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:10:21.784031 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dcb14b-86f9-4be6-ab31-9f32ffac5bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:10:21.784305 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dcb14b-86f9-4be6-ab31-9f32ffac5bc4 admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:10:21.784987 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dcb14b-86f9-4be6-ab31-9f32ffac5bc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:10:21.786917 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dcb14b-86f9-4be6-ab31-9f32ffac5bc4 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:10:21.807821 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1285/2577] 10.222.0.36 () {60 vars in 1143 bytes} [Fri Jun 24 23:10:21 2022] POST /identity/v3/users => generated 289 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 23:10:21.811929 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ecbbec-2629-4a0a-b288-25ff8f82b829 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:10:21.822229 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ecbbec-2629-4a0a-b288-25ff8f82b829 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:10:21.826698 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c432a721-7688-4c88-a3c5-50e5113ccb4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:10:21.827385 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c432a721-7688-4c88-a3c5-50e5113ccb4d admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:10:21.827667 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c432a721-7688-4c88-a3c5-50e5113ccb4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:10:21.827938 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c432a721-7688-4c88-a3c5-50e5113ccb4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:10:21.828654 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c432a721-7688-4c88-a3c5-50e5113ccb4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:10:21.830258 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c432a721-7688-4c88-a3c5-50e5113ccb4d admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:10:21.840032 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1293/2578] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 23:10:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 23:10:21.844018 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dcb14b-86f9-4be6-ab31-9f32ffac5bc4 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:10:21.854224 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dcb14b-86f9-4be6-ab31-9f32ffac5bc4 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:10:21.859159 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10347e49-6db1-4bf5-b8be-e8190c5cfbfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:10:21.859855 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10347e49-6db1-4bf5-b8be-e8190c5cfbfd admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:10:21.860137 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10347e49-6db1-4bf5-b8be-e8190c5cfbfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:10:21.860423 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10347e49-6db1-4bf5-b8be-e8190c5cfbfd admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:10:21.861235 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10347e49-6db1-4bf5-b8be-e8190c5cfbfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:10:21.862859 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10347e49-6db1-4bf5-b8be-e8190c5cfbfd admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:10:21.874122 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1286/2579] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 23:10:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 23:10:21.878514 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c432a721-7688-4c88-a3c5-50e5113ccb4d admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:10:21.891057 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c432a721-7688-4c88-a3c5-50e5113ccb4d admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:10:21.896149 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8635c032-6954-4fdc-9ad1-56bd05028d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:10:21.897001 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8635c032-6954-4fdc-9ad1-56bd05028d35 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:10:21.897283 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8635c032-6954-4fdc-9ad1-56bd05028d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:10:21.897553 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8635c032-6954-4fdc-9ad1-56bd05028d35 admin admin] PATH_INFO: `/v3/projects/3528b61f20c64745834abd744f453257/users/c0e2ea4fb58a478aa5a7c4d9409cfb70/roles/1928787bfcc745419829cd315900ac44` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:10:21.912405 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8635c032-6954-4fdc-9ad1-56bd05028d35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3528b61f20c64745834abd744f453257, user_id=c0e2ea4fb58a478aa5a7c4d9409cfb70, role_id=1928787bfcc745419829cd315900ac44)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:10:21.915187 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8635c032-6954-4fdc-9ad1-56bd05028d35 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:10:21.926379 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:10:21.931719 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1294/2580] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 23:10:21 2022] PUT /identity/v3/projects/3528b61f20c64745834abd744f453257/users/c0e2ea4fb58a478aa5a7c4d9409cfb70/roles/1928787bfcc745419829cd315900ac44 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 23:10:21.936900 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc70bf-46e2-49f4-8dab-66b20c3c2d32 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:10:21.937196 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc70bf-46e2-49f4-8dab-66b20c3c2d32 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:10:21.937506 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc70bf-46e2-49f4-8dab-66b20c3c2d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:10:21.956038 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-f5dc70bf-46e2-49f4-8dab-66b20c3c2d32 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 23:10:21.957253 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-f5dc70bf-46e2-49f4-8dab-66b20c3c2d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:10:22.030630 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1287/2581] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 23:10:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 23:10:22.040692 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8635c032-6954-4fdc-9ad1-56bd05028d35 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:10:22.042658 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-8635c032-6954-4fdc-9ad1-56bd05028d35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:10:22.103908 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8635c032-6954-4fdc-9ad1-56bd05028d35 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:10:22.108240 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23738961-4c24-4bf5-9aa0-32979bd9514c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:10:22.108884 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23738961-4c24-4bf5-9aa0-32979bd9514c service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:10:22.109169 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23738961-4c24-4bf5-9aa0-32979bd9514c service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:10:22.109446 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23738961-4c24-4bf5-9aa0-32979bd9514c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:10:22.119905 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23738961-4c24-4bf5-9aa0-32979bd9514c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:10:22.121352 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23738961-4c24-4bf5-9aa0-32979bd9514c service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:10:22.131150 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1295/2582] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:10:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:10:26.079402 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c9f8a7-6356-475d-ae7b-ba2bf018175c None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:10:26.080035 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c9f8a7-6356-475d-ae7b-ba2bf018175c None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:10:26.080035 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c9f8a7-6356-475d-ae7b-ba2bf018175c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:10:26.110694 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-f4c9f8a7-6356-475d-ae7b-ba2bf018175c None None] MFA Rules not processed for user `c0e2ea4fb58a478aa5a7c4d9409cfb70`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 23:10:26.112292 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-f4c9f8a7-6356-475d-ae7b-ba2bf018175c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:10:26.133051 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:10:26.191066 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1288/2583] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 23:10:26 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 23:10:26.206270 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23738961-4c24-4bf5-9aa0-32979bd9514c service neutron] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:10:26.209750 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-23738961-4c24-4bf5-9aa0-32979bd9514c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:10:26.286358 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23738961-4c24-4bf5-9aa0-32979bd9514c service neutron] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:10:26.292166 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c0565b-9c44-4c9c-8a0b-8c7c179d2d4c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214d9071042c4bad886bf060a079b6e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:10:26.292820 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c0565b-9c44-4c9c-8a0b-8c7c179d2d4c service nova] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:10:26.293092 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c0565b-9c44-4c9c-8a0b-8c7c179d2d4c service nova] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:10:26.293367 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c0565b-9c44-4c9c-8a0b-8c7c179d2d4c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:10:26.301737 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c0565b-9c44-4c9c-8a0b-8c7c179d2d4c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:10:26.303399 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c0565b-9c44-4c9c-8a0b-8c7c179d2d4c service nova] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:10:26.313178 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1296/2584] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:10:26 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:10:27.807779 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84479db-b307-45ac-8ac0-123467caac42 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:10:27.808296 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84479db-b307-45ac-8ac0-123467caac42 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:10:27.808396 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84479db-b307-45ac-8ac0-123467caac42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:10:27.826549 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-c84479db-b307-45ac-8ac0-123467caac42 None None] MFA Rules not processed for user `c0e2ea4fb58a478aa5a7c4d9409cfb70`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 23:10:27.827886 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-c84479db-b307-45ac-8ac0-123467caac42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:10:27.836451 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1289/2585] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 23:10:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 23:10:28.194853 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c0565b-9c44-4c9c-8a0b-8c7c179d2d4c service nova] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:10:28.208210 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c0565b-9c44-4c9c-8a0b-8c7c179d2d4c service nova] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:10:28.214156 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffd34ce-3a70-4574-ac33-c43bf52f135e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:10:28.215353 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffd34ce-3a70-4574-ac33-c43bf52f135e service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:10:28.215812 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffd34ce-3a70-4574-ac33-c43bf52f135e service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:10:28.216088 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffd34ce-3a70-4574-ac33-c43bf52f135e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:10:28.217981 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-4ffd34ce-3a70-4574-ac33-c43bf52f135e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:10:28.229711 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffd34ce-3a70-4574-ac33-c43bf52f135e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:10:28.231526 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffd34ce-3a70-4574-ac33-c43bf52f135e service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:10:28.240575 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1297/2586] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:10:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:10:28.595686 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84479db-b307-45ac-8ac0-123467caac42 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:10:28.597216 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-c84479db-b307-45ac-8ac0-123467caac42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:10:28.699032 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84479db-b307-45ac-8ac0-123467caac42 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:10:28.704000 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f32ec0-7a9e-4138-bbea-2bd1c0d416ee service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0233b357708643be94c0ade17ac1fb3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:10:28.704651 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f32ec0-7a9e-4138-bbea-2bd1c0d416ee service placement] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:10:28.704935 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f32ec0-7a9e-4138-bbea-2bd1c0d416ee service placement] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:10:28.705211 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f32ec0-7a9e-4138-bbea-2bd1c0d416ee service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:10:28.706982 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-b4f32ec0-7a9e-4138-bbea-2bd1c0d416ee service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:10:28.718646 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f32ec0-7a9e-4138-bbea-2bd1c0d416ee service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:10:28.720300 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f32ec0-7a9e-4138-bbea-2bd1c0d416ee service placement] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:10:28.732443 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1290/2587] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:10:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:10:31.377339 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffd34ce-3a70-4574-ac33-c43bf52f135e service neutron] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:10:31.383401 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-4ffd34ce-3a70-4574-ac33-c43bf52f135e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:10:31.406905 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffd34ce-3a70-4574-ac33-c43bf52f135e service neutron] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:10:31.413494 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a46514-bc20-427a-a817-fb88cf9180a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214d9071042c4bad886bf060a079b6e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:10:31.414170 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a46514-bc20-427a-a817-fb88cf9180a1 service nova] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:10:31.414453 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a46514-bc20-427a-a817-fb88cf9180a1 service nova] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:10:31.414724 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a46514-bc20-427a-a817-fb88cf9180a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:10:31.417051 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-35a46514-bc20-427a-a817-fb88cf9180a1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:10:31.430417 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a46514-bc20-427a-a817-fb88cf9180a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:10:31.432364 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a46514-bc20-427a-a817-fb88cf9180a1 service nova] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:10:31.445318 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1298/2588] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:10:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:10:36.566990 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f32ec0-7a9e-4138-bbea-2bd1c0d416ee service placement] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:10:36.580626 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f32ec0-7a9e-4138-bbea-2bd1c0d416ee service placement] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:10:36.586403 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19e5f7c-cc8a-46d2-8477-8da4244becdb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214d9071042c4bad886bf060a079b6e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:10:36.587061 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e5f7c-cc8a-46d2-8477-8da4244becdb service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:10:36.587375 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e5f7c-cc8a-46d2-8477-8da4244becdb service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:10:36.587650 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e5f7c-cc8a-46d2-8477-8da4244becdb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:10:36.590166 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-a19e5f7c-cc8a-46d2-8477-8da4244becdb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:10:36.602730 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19e5f7c-cc8a-46d2-8477-8da4244becdb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:10:36.604584 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19e5f7c-cc8a-46d2-8477-8da4244becdb service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:10:36.614854 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1291/2589] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:10:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:10:41.440320 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=72 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:10:46.610675 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=60 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:11:35.577825 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a46514-bc20-427a-a817-fb88cf9180a1 service nova] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:11:35.590240 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a46514-bc20-427a-a817-fb88cf9180a1 service nova] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:11:35.594787 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176ed6d7-7e33-4adf-a5c5-f62c766c054a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:11:35.595468 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ed6d7-7e33-4adf-a5c5-f62c766c054a service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:11:35.595753 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ed6d7-7e33-4adf-a5c5-f62c766c054a service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:11:35.596039 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ed6d7-7e33-4adf-a5c5-f62c766c054a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:11:35.598178 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-176ed6d7-7e33-4adf-a5c5-f62c766c054a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:11:35.608415 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176ed6d7-7e33-4adf-a5c5-f62c766c054a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:11:35.609857 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176ed6d7-7e33-4adf-a5c5-f62c766c054a service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:11:35.618460 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1299/2590] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:11:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:11:45.614624 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=6 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:12:30.847284 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19e5f7c-cc8a-46d2-8477-8da4244becdb service nova] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:12:30.911085 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19e5f7c-cc8a-46d2-8477-8da4244becdb service nova] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:12:30.916755 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c788f53-9011-455f-987e-3a07534b5c3b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0233b357708643be94c0ade17ac1fb3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:12:30.917399 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c788f53-9011-455f-987e-3a07534b5c3b service placement] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:12:30.917683 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c788f53-9011-455f-987e-3a07534b5c3b service placement] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:12:30.917960 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c788f53-9011-455f-987e-3a07534b5c3b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:12:30.919842 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-3c788f53-9011-455f-987e-3a07534b5c3b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:12:30.931540 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c788f53-9011-455f-987e-3a07534b5c3b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:12:30.933189 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c788f53-9011-455f-987e-3a07534b5c3b service placement] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:12:30.943135 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1292/2591] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:12:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:12:40.939296 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=27 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:14:18.472581 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176ed6d7-7e33-4adf-a5c5-f62c766c054a service neutron] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:14:18.474610 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-176ed6d7-7e33-4adf-a5c5-f62c766c054a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:14:18.585354 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176ed6d7-7e33-4adf-a5c5-f62c766c054a service neutron] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:14:18.589562 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db6d654-00d8-4d82-aacf-f6ab28facd60 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a747e2a5684843a6ee9e3480badac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:14:18.590239 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db6d654-00d8-4d82-aacf-f6ab28facd60 service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:14:18.590530 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db6d654-00d8-4d82-aacf-f6ab28facd60 service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:14:18.590821 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db6d654-00d8-4d82-aacf-f6ab28facd60 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:14:18.592838 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-7db6d654-00d8-4d82-aacf-f6ab28facd60 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:14:18.657029 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db6d654-00d8-4d82-aacf-f6ab28facd60 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:14:18.658447 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db6d654-00d8-4d82-aacf-f6ab28facd60 service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:14:18.669237 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1300/2592] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:14:18 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:14:18.743272 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c788f53-9011-455f-987e-3a07534b5c3b service placement] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:14:18.753902 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c788f53-9011-455f-987e-3a07534b5c3b service placement] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:14:18.757543 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8df0e57-c086-4782-ba69-0da5160fd662 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a747e2a5684843a6ee9e3480badac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:14:18.758213 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df0e57-c086-4782-ba69-0da5160fd662 service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:14:18.758494 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df0e57-c086-4782-ba69-0da5160fd662 service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:14:18.758769 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df0e57-c086-4782-ba69-0da5160fd662 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:14:18.760648 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-e8df0e57-c086-4782-ba69-0da5160fd662 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:14:18.832527 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8df0e57-c086-4782-ba69-0da5160fd662 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:14:18.834002 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8df0e57-c086-4782-ba69-0da5160fd662 service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:14:18.852987 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1293/2593] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:14:18 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:14:19.146247 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db6d654-00d8-4d82-aacf-f6ab28facd60 service cinder] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:14:19.156178 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db6d654-00d8-4d82-aacf-f6ab28facd60 service cinder] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:14:19.160820 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2473b91-9a94-4358-be1a-82382e673d8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:14:19.161497 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2473b91-9a94-4358-be1a-82382e673d8f service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:14:19.161752 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2473b91-9a94-4358-be1a-82382e673d8f service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:14:19.162017 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2473b91-9a94-4358-be1a-82382e673d8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:14:19.164208 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-a2473b91-9a94-4358-be1a-82382e673d8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:14:19.179153 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2473b91-9a94-4358-be1a-82382e673d8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:14:19.180629 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2473b91-9a94-4358-be1a-82382e673d8f service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:14:19.191656 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1301/2594] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:14:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:14:19.877141 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8df0e57-c086-4782-ba69-0da5160fd662 service cinder] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:14:19.878857 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-e8df0e57-c086-4782-ba69-0da5160fd662 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:14:19.890722 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8df0e57-c086-4782-ba69-0da5160fd662 service cinder] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:14:19.895003 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccdd698-2e36-4504-b3dc-468138aad899 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a747e2a5684843a6ee9e3480badac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:14:19.895686 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccdd698-2e36-4504-b3dc-468138aad899 service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:14:19.895968 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccdd698-2e36-4504-b3dc-468138aad899 service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:14:19.896242 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccdd698-2e36-4504-b3dc-468138aad899 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:14:19.898424 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-6ccdd698-2e36-4504-b3dc-468138aad899 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:14:19.966214 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccdd698-2e36-4504-b3dc-468138aad899 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:14:19.967785 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccdd698-2e36-4504-b3dc-468138aad899 service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:14:19.978022 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1294/2595] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:14:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:14:20.380476 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2473b91-9a94-4358-be1a-82382e673d8f service neutron] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:14:20.389741 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2473b91-9a94-4358-be1a-82382e673d8f service neutron] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:14:20.393673 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d882a9-b56b-4a17-b6fb-6289489e5704 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:14:20.394387 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d882a9-b56b-4a17-b6fb-6289489e5704 service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:14:20.394719 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d882a9-b56b-4a17-b6fb-6289489e5704 service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:14:20.394924 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d882a9-b56b-4a17-b6fb-6289489e5704 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:14:20.396756 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-b0d882a9-b56b-4a17-b6fb-6289489e5704 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:14:20.410447 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d882a9-b56b-4a17-b6fb-6289489e5704 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:14:20.411978 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d882a9-b56b-4a17-b6fb-6289489e5704 service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:14:20.423197 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1302/2596] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:14:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:14:25.454279 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccdd698-2e36-4504-b3dc-468138aad899 service cinder] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:14:25.456005 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-6ccdd698-2e36-4504-b3dc-468138aad899 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:14:25.555491 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccdd698-2e36-4504-b3dc-468138aad899 service cinder] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:14:25.561272 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16151511-9abf-485a-9881-ba50f014ba9b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd156158fa06647569a8bb2d8d0019f28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:14:25.562801 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16151511-9abf-485a-9881-ba50f014ba9b service glance] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:14:25.563124 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16151511-9abf-485a-9881-ba50f014ba9b service glance] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:14:25.563477 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16151511-9abf-485a-9881-ba50f014ba9b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:14:25.565398 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-16151511-9abf-485a-9881-ba50f014ba9b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:14:25.581028 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application [None req-16151511-9abf-485a-9881-ba50f014ba9b service glance] Could not find project: a3a7f1d0bf2c40d38cd8c896f05ecd4d.: keystone.exception.ProjectNotFound: Could not find project: a3a7f1d0bf2c40d38cd8c896f05ecd4d. Jun 24 23:14:25.581028 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 23:14:25.581028 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 23:14:25.581028 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 23:14:25.581028 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 23:14:25.581028 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 23:14:25.581028 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 23:14:25.581028 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 23:14:25.581028 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 23:14:25.581028 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 23:14:25.581028 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 23:14:25.581028 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 23:14:25.581028 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 285, in get Jun 24 23:14:25.581028 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:validate_token') Jun 24 23:14:25.581028 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Jun 24 23:14:25.582017 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Jun 24 23:14:25.582017 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Jun 24 23:14:25.582017 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Jun 24 23:14:25.582017 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 23:14:25.582017 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 23:14:25.582017 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 145, in validate_token Jun 24 23:14:25.582017 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application token = self._validate_token(token_id) Jun 24 23:14:25.582017 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 23:14:25.582017 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 23:14:25.582017 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 23:14:25.582017 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 23:14:25.582017 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 23:14:25.582017 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 23:14:25.582017 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 23:14:25.582017 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 23:14:25.582017 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 23:14:25.582017 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 23:14:25.583078 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 23:14:25.583078 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 23:14:25.583078 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 23:14:25.583078 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 23:14:25.583078 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 179, in _validate_token Jun 24 23:14:25.583078 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application token.mint(token_id, issued_at) Jun 24 23:14:25.583078 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 579, in mint Jun 24 23:14:25.583078 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self._validate_token_resources() Jun 24 23:14:25.583078 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 464, in _validate_token_resources Jun 24 23:14:25.583078 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application if self.project and not self.project.get('enabled'): Jun 24 23:14:25.583078 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 162, in project Jun 24 23:14:25.583078 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application self.__project = PROVIDERS.resource_api.get_project( Jun 24 23:14:25.583078 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 23:14:25.583078 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 23:14:25.583078 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 23:14:25.583078 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 23:14:25.583078 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 23:14:25.584126 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 23:14:25.584126 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 23:14:25.584126 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application with Lock( Jun 24 23:14:25.584126 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 23:14:25.584126 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._enter() Jun 24 23:14:25.584126 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 23:14:25.584126 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 23:14:25.584126 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 23:14:25.584126 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.creator() Jun 24 23:14:25.584126 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 23:14:25.584126 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application created_value = creator( Jun 24 23:14:25.584126 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 23:14:25.584126 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 23:14:25.584126 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 23:14:25.584126 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 23:14:25.584126 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 23:14:25.584126 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 23:14:25.585037 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: a3a7f1d0bf2c40d38cd8c896f05ecd4d. Jun 24 23:14:25.585037 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: ERROR keystone.server.flask.application Jun 24 23:14:25.585664 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1295/2597] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:14:25 2022] GET /identity/v3/auth/tokens => generated 113 bytes in 132 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 24 23:14:26.245084 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d882a9-b56b-4a17-b6fb-6289489e5704 service neutron] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:14:26.246663 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-b0d882a9-b56b-4a17-b6fb-6289489e5704 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:14:26.261985 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d882a9-b56b-4a17-b6fb-6289489e5704 service neutron] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:14:26.267652 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1fa977-a5b8-45fe-81bd-b21c113f3a3d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd156158fa06647569a8bb2d8d0019f28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:14:26.268298 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1fa977-a5b8-45fe-81bd-b21c113f3a3d service glance] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:14:26.268578 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1fa977-a5b8-45fe-81bd-b21c113f3a3d service glance] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:14:26.268857 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1fa977-a5b8-45fe-81bd-b21c113f3a3d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:14:26.271141 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-ce1fa977-a5b8-45fe-81bd-b21c113f3a3d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:14:26.284713 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application [None req-ce1fa977-a5b8-45fe-81bd-b21c113f3a3d service glance] Could not find project: b2504fe6b85c4a0b810bddb0e6e9b05f.: keystone.exception.ProjectNotFound: Could not find project: b2504fe6b85c4a0b810bddb0e6e9b05f. Jun 24 23:14:26.284713 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 23:14:26.284713 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 23:14:26.284713 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 23:14:26.284713 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 23:14:26.284713 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 23:14:26.284713 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 23:14:26.284713 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 23:14:26.284713 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 23:14:26.284713 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 23:14:26.284713 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 23:14:26.284713 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 23:14:26.284713 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 285, in get Jun 24 23:14:26.284713 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:validate_token') Jun 24 23:14:26.284713 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Jun 24 23:14:26.285581 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Jun 24 23:14:26.285581 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Jun 24 23:14:26.285581 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Jun 24 23:14:26.285581 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 23:14:26.285581 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 23:14:26.285581 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 145, in validate_token Jun 24 23:14:26.285581 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application token = self._validate_token(token_id) Jun 24 23:14:26.285581 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 23:14:26.285581 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 23:14:26.285581 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 23:14:26.285581 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 23:14:26.285581 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 23:14:26.285581 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 23:14:26.285581 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 23:14:26.285581 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 23:14:26.285581 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 23:14:26.285581 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 23:14:26.286471 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 23:14:26.286471 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 23:14:26.286471 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 23:14:26.286471 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 23:14:26.286471 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 179, in _validate_token Jun 24 23:14:26.286471 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application token.mint(token_id, issued_at) Jun 24 23:14:26.286471 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 579, in mint Jun 24 23:14:26.286471 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application self._validate_token_resources() Jun 24 23:14:26.286471 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 464, in _validate_token_resources Jun 24 23:14:26.286471 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application if self.project and not self.project.get('enabled'): Jun 24 23:14:26.286471 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 162, in project Jun 24 23:14:26.286471 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application self.__project = PROVIDERS.resource_api.get_project( Jun 24 23:14:26.286471 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 23:14:26.286471 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 23:14:26.286471 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 23:14:26.286471 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 23:14:26.286471 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 23:14:26.287521 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 23:14:26.287521 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 23:14:26.287521 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application with Lock( Jun 24 23:14:26.287521 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 23:14:26.287521 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._enter() Jun 24 23:14:26.287521 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 23:14:26.287521 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 23:14:26.287521 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 23:14:26.287521 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.creator() Jun 24 23:14:26.287521 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 23:14:26.287521 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application created_value = creator( Jun 24 23:14:26.287521 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 23:14:26.287521 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 23:14:26.287521 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 23:14:26.287521 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 23:14:26.287521 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 23:14:26.287521 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 23:14:26.288477 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: b2504fe6b85c4a0b810bddb0e6e9b05f. Jun 24 23:14:26.288477 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: ERROR keystone.server.flask.application Jun 24 23:14:26.288477 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1303/2598] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:14:26 2022] GET /identity/v3/auth/tokens => generated 113 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 24 23:14:27.970050 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16151511-9abf-485a-9881-ba50f014ba9b service glance] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:14:27.979728 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16151511-9abf-485a-9881-ba50f014ba9b service glance] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:14:27.983426 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7bae7b-5c91-4d3c-b494-8d84adc91a7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a747e2a5684843a6ee9e3480badac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:14:27.984059 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7bae7b-5c91-4d3c-b494-8d84adc91a7a service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:14:27.984344 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7bae7b-5c91-4d3c-b494-8d84adc91a7a service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:14:27.984616 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7bae7b-5c91-4d3c-b494-8d84adc91a7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:14:27.986523 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-7f7bae7b-5c91-4d3c-b494-8d84adc91a7a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:14:27.992703 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:14:28.052579 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7bae7b-5c91-4d3c-b494-8d84adc91a7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:14:28.054037 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7bae7b-5c91-4d3c-b494-8d84adc91a7a service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:14:28.063751 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1296/2599] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:14:27 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:14:28.261330 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1fa977-a5b8-45fe-81bd-b21c113f3a3d service glance] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:14:28.262838 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-ce1fa977-a5b8-45fe-81bd-b21c113f3a3d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:14:28.277385 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1fa977-a5b8-45fe-81bd-b21c113f3a3d service glance] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:14:28.283235 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cadcfc6-3ee3-46d0-a35f-7dd7d5da5742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:14:28.284152 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cadcfc6-3ee3-46d0-a35f-7dd7d5da5742 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:14:28.284554 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cadcfc6-3ee3-46d0-a35f-7dd7d5da5742 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:14:28.284982 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cadcfc6-3ee3-46d0-a35f-7dd7d5da5742 admin admin] PATH_INFO: `/v3/users/9fe8572d95434ae9a040922743b08fa2` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:14:28.286115 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cadcfc6-3ee3-46d0-a35f-7dd7d5da5742 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fe8572d95434ae9a040922743b08fa2)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:14:28.288123 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cadcfc6-3ee3-46d0-a35f-7dd7d5da5742 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:14:28.331994 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:14:28.341018 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-1cadcfc6-3ee3-46d0-a35f-7dd7d5da5742 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fe8572d95434ae9a040922743b08fa2'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:14:28.348113 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-1cadcfc6-3ee3-46d0-a35f-7dd7d5da5742 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fe8572d95434ae9a040922743b08fa2'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:14:28.348773 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-1cadcfc6-3ee3-46d0-a35f-7dd7d5da5742 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fe8572d95434ae9a040922743b08fa2'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:14:28.349373 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-1cadcfc6-3ee3-46d0-a35f-7dd7d5da5742 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fe8572d95434ae9a040922743b08fa2'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:14:28.361147 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-1cadcfc6-3ee3-46d0-a35f-7dd7d5da5742 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fe8572d95434ae9a040922743b08fa2'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:14:28.375568 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1304/2600] 10.222.0.36 () {58 vars in 1223 bytes} [Fri Jun 24 23:14:28 2022] DELETE /identity/v3/users/9fe8572d95434ae9a040922743b08fa2 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 23:14:28.380476 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec3b86f-b26a-41dd-a204-aed677a863ab None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:14:28.380773 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec3b86f-b26a-41dd-a204-aed677a863ab None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:14:28.381052 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec3b86f-b26a-41dd-a204-aed677a863ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:14:28.400132 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-8ec3b86f-b26a-41dd-a204-aed677a863ab None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 23:14:28.401355 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-8ec3b86f-b26a-41dd-a204-aed677a863ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:14:28.466951 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1297/2601] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 23:14:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 23:14:28.476726 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cadcfc6-3ee3-46d0-a35f-7dd7d5da5742 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:14:28.478224 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-1cadcfc6-3ee3-46d0-a35f-7dd7d5da5742 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:14:28.537755 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cadcfc6-3ee3-46d0-a35f-7dd7d5da5742 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:14:28.541911 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3e68b4-b4bb-4f3b-a8c1-b3a356b64dee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:14:28.542571 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e68b4-b4bb-4f3b-a8c1-b3a356b64dee service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:14:28.542857 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e68b4-b4bb-4f3b-a8c1-b3a356b64dee service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:14:28.543181 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e68b4-b4bb-4f3b-a8c1-b3a356b64dee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:14:28.553258 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3e68b4-b4bb-4f3b-a8c1-b3a356b64dee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:14:28.554814 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3e68b4-b4bb-4f3b-a8c1-b3a356b64dee service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:14:28.564403 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1305/2602] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:14:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:14:28.856205 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec3b86f-b26a-41dd-a204-aed677a863ab None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:14:28.857742 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-8ec3b86f-b26a-41dd-a204-aed677a863ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:14:28.870917 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec3b86f-b26a-41dd-a204-aed677a863ab None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:14:28.876280 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41db8a7-1902-434a-a172-c4d78968ff9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:14:28.877247 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41db8a7-1902-434a-a172-c4d78968ff9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:14:28.877519 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41db8a7-1902-434a-a172-c4d78968ff9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:14:28.877798 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41db8a7-1902-434a-a172-c4d78968ff9b admin admin] PATH_INFO: `/v3/projects/4707e9d23c704000a5afeb961f7ab4e3` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:14:28.879168 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41db8a7-1902-434a-a172-c4d78968ff9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4707e9d23c704000a5afeb961f7ab4e3)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:14:28.881302 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41db8a7-1902-434a-a172-c4d78968ff9b admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:14:28.931623 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-b41db8a7-1902-434a-a172-c4d78968ff9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4707e9d23c704000a5afeb961f7ab4e3', 'request_id': 'req-b41db8a7-1902-434a-a172-c4d78968ff9b'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:14:28.937960 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-b41db8a7-1902-434a-a172-c4d78968ff9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4707e9d23c704000a5afeb961f7ab4e3', 'request_id': 'req-b41db8a7-1902-434a-a172-c4d78968ff9b'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:14:28.946948 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-b41db8a7-1902-434a-a172-c4d78968ff9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4707e9d23c704000a5afeb961f7ab4e3', 'request_id': 'req-b41db8a7-1902-434a-a172-c4d78968ff9b'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:14:28.958230 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-b41db8a7-1902-434a-a172-c4d78968ff9b admin admin] The token cache is being invalidate because project 4707e9d23c704000a5afeb961f7ab4e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 23:14:28.958527 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-b41db8a7-1902-434a-a172-c4d78968ff9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:14:28.959177 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-b41db8a7-1902-434a-a172-c4d78968ff9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:14:28.960816 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1298/2603] 10.222.0.36 () {58 vars in 1232 bytes} [Fri Jun 24 23:14:28 2022] DELETE /identity/v3/projects/4707e9d23c704000a5afeb961f7ab4e3 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 23:14:28.964822 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3e68b4-b4bb-4f3b-a8c1-b3a356b64dee service neutron] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:14:28.974452 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3e68b4-b4bb-4f3b-a8c1-b3a356b64dee service neutron] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:14:29.032659 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb0c2f7-48f1-4c1d-b847-cc6bdc008a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:14:29.033533 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb0c2f7-48f1-4c1d-b847-cc6bdc008a3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:14:29.033860 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb0c2f7-48f1-4c1d-b847-cc6bdc008a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:14:29.034048 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb0c2f7-48f1-4c1d-b847-cc6bdc008a3f admin admin] PATH_INFO: `/v3/users/948d98fb47c745d9b8d9615211952575` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:14:29.035376 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb0c2f7-48f1-4c1d-b847-cc6bdc008a3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=948d98fb47c745d9b8d9615211952575)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:14:29.037329 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb0c2f7-48f1-4c1d-b847-cc6bdc008a3f admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:14:29.085200 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-0cb0c2f7-48f1-4c1d-b847-cc6bdc008a3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '948d98fb47c745d9b8d9615211952575'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:14:29.091840 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-0cb0c2f7-48f1-4c1d-b847-cc6bdc008a3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '948d98fb47c745d9b8d9615211952575'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:14:29.092479 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-0cb0c2f7-48f1-4c1d-b847-cc6bdc008a3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '948d98fb47c745d9b8d9615211952575'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:14:29.093074 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-0cb0c2f7-48f1-4c1d-b847-cc6bdc008a3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '948d98fb47c745d9b8d9615211952575'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:14:29.094897 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:14:29.106459 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-0cb0c2f7-48f1-4c1d-b847-cc6bdc008a3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '948d98fb47c745d9b8d9615211952575'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:14:29.120064 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1306/2604] 10.222.0.36 () {58 vars in 1223 bytes} [Fri Jun 24 23:14:28 2022] DELETE /identity/v3/users/948d98fb47c745d9b8d9615211952575 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 23:14:29.395600 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41db8a7-1902-434a-a172-c4d78968ff9b admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:14:29.397167 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-b41db8a7-1902-434a-a172-c4d78968ff9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:14:29.411333 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41db8a7-1902-434a-a172-c4d78968ff9b admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:14:29.431714 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:14:29.473351 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7873d467-1074-48b9-92c3-5a93075c5382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:14:29.474143 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7873d467-1074-48b9-92c3-5a93075c5382 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:14:29.474424 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7873d467-1074-48b9-92c3-5a93075c5382 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:14:29.474700 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7873d467-1074-48b9-92c3-5a93075c5382 admin admin] PATH_INFO: `/v3/projects/ebf024fbd4ab404193d2ef1aa2b79084` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:14:29.475904 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7873d467-1074-48b9-92c3-5a93075c5382 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebf024fbd4ab404193d2ef1aa2b79084)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:14:29.477813 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7873d467-1074-48b9-92c3-5a93075c5382 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:14:29.536974 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-7873d467-1074-48b9-92c3-5a93075c5382 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebf024fbd4ab404193d2ef1aa2b79084', 'request_id': 'req-7873d467-1074-48b9-92c3-5a93075c5382'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:14:29.543067 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-7873d467-1074-48b9-92c3-5a93075c5382 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebf024fbd4ab404193d2ef1aa2b79084', 'request_id': 'req-7873d467-1074-48b9-92c3-5a93075c5382'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:14:29.551515 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-7873d467-1074-48b9-92c3-5a93075c5382 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebf024fbd4ab404193d2ef1aa2b79084', 'request_id': 'req-7873d467-1074-48b9-92c3-5a93075c5382'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:14:29.562096 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-7873d467-1074-48b9-92c3-5a93075c5382 admin admin] The token cache is being invalidate because project ebf024fbd4ab404193d2ef1aa2b79084 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 23:14:29.562384 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-7873d467-1074-48b9-92c3-5a93075c5382 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:14:29.563049 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-7873d467-1074-48b9-92c3-5a93075c5382 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:14:29.564707 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1299/2605] 10.222.0.36 () {58 vars in 1232 bytes} [Fri Jun 24 23:14:29 2022] DELETE /identity/v3/projects/ebf024fbd4ab404193d2ef1aa2b79084 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 23:14:29.569772 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2abceb-f870-44fe-b6e1-1a8b315a1739 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:14:29.570236 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2abceb-f870-44fe-b6e1-1a8b315a1739 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:14:29.570335 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2abceb-f870-44fe-b6e1-1a8b315a1739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:14:29.588770 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-9b2abceb-f870-44fe-b6e1-1a8b315a1739 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 23:14:29.589970 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-9b2abceb-f870-44fe-b6e1-1a8b315a1739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:14:29.662483 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1307/2606] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 23:14:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 23:14:29.670887 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547779a6-74d2-4fe2-b663-0193accd57f1 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:14:29.671286 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547779a6-74d2-4fe2-b663-0193accd57f1 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:14:29.671687 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547779a6-74d2-4fe2-b663-0193accd57f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:14:29.692067 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-547779a6-74d2-4fe2-b663-0193accd57f1 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 23:14:29.693277 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-547779a6-74d2-4fe2-b663-0193accd57f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:14:29.702093 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1300/2607] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 23:14:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 23:14:29.707180 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2abceb-f870-44fe-b6e1-1a8b315a1739 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:14:29.722604 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2abceb-f870-44fe-b6e1-1a8b315a1739 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:14:29.728593 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e28f8d-520c-47c7-9379-493eb77cf711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:14:29.729192 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e28f8d-520c-47c7-9379-493eb77cf711 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:14:29.729470 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e28f8d-520c-47c7-9379-493eb77cf711 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:14:29.729736 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e28f8d-520c-47c7-9379-493eb77cf711 admin admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:14:29.730469 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e28f8d-520c-47c7-9379-493eb77cf711 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 23:14:29.730779 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e28f8d-520c-47c7-9379-493eb77cf711 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:14:29.732689 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e28f8d-520c-47c7-9379-493eb77cf711 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:14:29.745325 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1308/2608] 10.222.0.36 () {58 vars in 1152 bytes} [Fri Jun 24 23:14:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 23:14:29.749843 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547779a6-74d2-4fe2-b663-0193accd57f1 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:14:29.759769 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547779a6-74d2-4fe2-b663-0193accd57f1 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:14:29.765628 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b0099c-a839-4ed2-9e0b-9df5b719d397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:14:29.766283 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b0099c-a839-4ed2-9e0b-9df5b719d397 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:14:29.766567 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b0099c-a839-4ed2-9e0b-9df5b719d397 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:14:29.766839 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b0099c-a839-4ed2-9e0b-9df5b719d397 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:14:29.767569 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b0099c-a839-4ed2-9e0b-9df5b719d397 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:14:29.769789 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b0099c-a839-4ed2-9e0b-9df5b719d397 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:14:29.799226 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1301/2609] 10.222.0.36 () {60 vars in 1152 bytes} [Fri Jun 24 23:14:29 2022] POST /identity/v3/projects => generated 363 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 23:14:29.803832 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e28f8d-520c-47c7-9379-493eb77cf711 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:14:29.814709 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e28f8d-520c-47c7-9379-493eb77cf711 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:14:29.882397 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c452c0de-7ea5-4314-849d-0b5ae3e29951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:14:29.883063 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c452c0de-7ea5-4314-849d-0b5ae3e29951 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:14:29.883364 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c452c0de-7ea5-4314-849d-0b5ae3e29951 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:14:29.883634 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c452c0de-7ea5-4314-849d-0b5ae3e29951 admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:14:29.884314 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c452c0de-7ea5-4314-849d-0b5ae3e29951 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:14:29.886246 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c452c0de-7ea5-4314-849d-0b5ae3e29951 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:14:29.911264 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1309/2610] 10.222.0.36 () {60 vars in 1143 bytes} [Fri Jun 24 23:14:29 2022] POST /identity/v3/users => generated 282 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 23:14:29.915507 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b0099c-a839-4ed2-9e0b-9df5b719d397 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:14:29.926013 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b0099c-a839-4ed2-9e0b-9df5b719d397 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:14:29.930786 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df77b03b-5bd3-4c86-acc1-35199ef9a594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:14:29.931482 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df77b03b-5bd3-4c86-acc1-35199ef9a594 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:14:29.931764 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df77b03b-5bd3-4c86-acc1-35199ef9a594 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:14:29.932037 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df77b03b-5bd3-4c86-acc1-35199ef9a594 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:14:29.932748 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df77b03b-5bd3-4c86-acc1-35199ef9a594 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:14:29.934417 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df77b03b-5bd3-4c86-acc1-35199ef9a594 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:14:29.948580 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1302/2611] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 23:14:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 23:14:29.949820 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c452c0de-7ea5-4314-849d-0b5ae3e29951 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:14:29.960367 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c452c0de-7ea5-4314-849d-0b5ae3e29951 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:14:29.965221 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b4ffd6-5a18-47c1-9fb8-5dfa557c13be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:14:29.965879 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b4ffd6-5a18-47c1-9fb8-5dfa557c13be admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:14:29.966161 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b4ffd6-5a18-47c1-9fb8-5dfa557c13be admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:14:29.966435 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b4ffd6-5a18-47c1-9fb8-5dfa557c13be admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:14:29.967157 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b4ffd6-5a18-47c1-9fb8-5dfa557c13be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:14:29.968857 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b4ffd6-5a18-47c1-9fb8-5dfa557c13be admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:14:29.979055 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1310/2612] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 23:14:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 23:14:29.983234 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df77b03b-5bd3-4c86-acc1-35199ef9a594 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:14:29.994744 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df77b03b-5bd3-4c86-acc1-35199ef9a594 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:14:29.999990 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3a195c-2b88-4545-8feb-d152dc035cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:14:30.000876 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a195c-2b88-4545-8feb-d152dc035cae admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:14:30.001248 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a195c-2b88-4545-8feb-d152dc035cae admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:14:30.001416 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a195c-2b88-4545-8feb-d152dc035cae admin admin] PATH_INFO: `/v3/projects/590f07df95794e6cb75beb0ad26bf67b/users/1b0f85522b3e4d449243a3e88ac25ae5/roles/1928787bfcc745419829cd315900ac44` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:14:30.017189 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3a195c-2b88-4545-8feb-d152dc035cae admin admin] RBAC: Authorizing `identity:create_grant(project_id=590f07df95794e6cb75beb0ad26bf67b, user_id=1b0f85522b3e4d449243a3e88ac25ae5, role_id=1928787bfcc745419829cd315900ac44)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:14:30.020077 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3a195c-2b88-4545-8feb-d152dc035cae admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:14:30.035556 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1303/2613] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 23:14:29 2022] PUT /identity/v3/projects/590f07df95794e6cb75beb0ad26bf67b/users/1b0f85522b3e4d449243a3e88ac25ae5/roles/1928787bfcc745419829cd315900ac44 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 23:14:30.046357 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e395638-7c92-41be-827c-20349b6c810b None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:14:30.046644 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e395638-7c92-41be-827c-20349b6c810b None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:14:30.046981 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e395638-7c92-41be-827c-20349b6c810b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:14:30.074726 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-6e395638-7c92-41be-827c-20349b6c810b None None] MFA Rules not processed for user `1b0f85522b3e4d449243a3e88ac25ae5`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 23:14:30.075938 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-6e395638-7c92-41be-827c-20349b6c810b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:14:30.107244 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:14:30.143150 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1311/2614] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 23:14:30 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 23:14:30.147963 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3a195c-2b88-4545-8feb-d152dc035cae admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:14:30.201727 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:14:30.215507 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3a195c-2b88-4545-8feb-d152dc035cae admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:14:30.221951 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97a0160-4ca8-44f0-af52-77ba44936129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:14:30.222620 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a0160-4ca8-44f0-af52-77ba44936129 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:14:30.222903 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a0160-4ca8-44f0-af52-77ba44936129 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:14:30.223178 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a0160-4ca8-44f0-af52-77ba44936129 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:14:30.223898 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97a0160-4ca8-44f0-af52-77ba44936129 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:14:30.225839 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97a0160-4ca8-44f0-af52-77ba44936129 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:14:30.252918 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1304/2615] 10.222.0.36 () {60 vars in 1152 bytes} [Fri Jun 24 23:14:30 2022] POST /identity/v3/projects => generated 363 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 23:14:30.258721 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e395638-7c92-41be-827c-20349b6c810b None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:14:30.270941 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e395638-7c92-41be-827c-20349b6c810b None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:14:30.341767 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26409c8e-9b0e-484d-b4e6-ee6bdd132d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:14:30.342435 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26409c8e-9b0e-484d-b4e6-ee6bdd132d42 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:14:30.342718 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26409c8e-9b0e-484d-b4e6-ee6bdd132d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:14:30.342995 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26409c8e-9b0e-484d-b4e6-ee6bdd132d42 admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:14:30.343797 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26409c8e-9b0e-484d-b4e6-ee6bdd132d42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:14:30.345834 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26409c8e-9b0e-484d-b4e6-ee6bdd132d42 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:14:30.371051 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1312/2616] 10.222.0.36 () {60 vars in 1143 bytes} [Fri Jun 24 23:14:30 2022] POST /identity/v3/users => generated 288 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 23:14:30.376692 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97a0160-4ca8-44f0-af52-77ba44936129 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:14:30.394888 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97a0160-4ca8-44f0-af52-77ba44936129 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:14:30.400807 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117e8fe4-4e70-4240-b6cb-990e027bf755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:14:30.401460 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117e8fe4-4e70-4240-b6cb-990e027bf755 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:14:30.401743 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117e8fe4-4e70-4240-b6cb-990e027bf755 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:14:30.402011 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117e8fe4-4e70-4240-b6cb-990e027bf755 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:14:30.402719 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117e8fe4-4e70-4240-b6cb-990e027bf755 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:14:30.404378 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117e8fe4-4e70-4240-b6cb-990e027bf755 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:14:30.416257 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1305/2617] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 23:14:30 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 23:14:30.420424 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26409c8e-9b0e-484d-b4e6-ee6bdd132d42 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:14:30.431128 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26409c8e-9b0e-484d-b4e6-ee6bdd132d42 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:14:30.436947 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b48d910-cf00-43c7-bc2d-28c3795b90ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:14:30.437852 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b48d910-cf00-43c7-bc2d-28c3795b90ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:14:30.438130 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b48d910-cf00-43c7-bc2d-28c3795b90ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:14:30.438399 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b48d910-cf00-43c7-bc2d-28c3795b90ef admin admin] PATH_INFO: `/v3/projects/0a7d71e9e70a4289849d721b4aa84853/users/00b6caa2f6d54e24a36be7a88fd503bb/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:14:30.454701 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b48d910-cf00-43c7-bc2d-28c3795b90ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a7d71e9e70a4289849d721b4aa84853, user_id=00b6caa2f6d54e24a36be7a88fd503bb, role_id=1a1c43cc97a0407eb7a7c7a1333a9d4a)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:14:30.457748 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b48d910-cf00-43c7-bc2d-28c3795b90ef admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:14:30.472225 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1313/2618] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 23:14:30 2022] PUT /identity/v3/projects/0a7d71e9e70a4289849d721b4aa84853/users/00b6caa2f6d54e24a36be7a88fd503bb/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 23:14:30.476422 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117e8fe4-4e70-4240-b6cb-990e027bf755 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:14:30.486870 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117e8fe4-4e70-4240-b6cb-990e027bf755 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:14:30.544988 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39681144-cfb3-4cd7-ac3b-b7c89a7796f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:14:30.545650 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39681144-cfb3-4cd7-ac3b-b7c89a7796f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:14:30.545930 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39681144-cfb3-4cd7-ac3b-b7c89a7796f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:14:30.546201 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39681144-cfb3-4cd7-ac3b-b7c89a7796f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:14:30.546915 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39681144-cfb3-4cd7-ac3b-b7c89a7796f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:14:30.548552 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39681144-cfb3-4cd7-ac3b-b7c89a7796f8 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:14:30.558543 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1306/2619] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 23:14:30 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 23:14:30.563045 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b48d910-cf00-43c7-bc2d-28c3795b90ef admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:14:30.575178 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b48d910-cf00-43c7-bc2d-28c3795b90ef admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:14:30.581348 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8818e7a-26d2-41b5-9890-4e54901813e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:14:30.582216 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8818e7a-26d2-41b5-9890-4e54901813e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:14:30.582493 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8818e7a-26d2-41b5-9890-4e54901813e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:14:30.582759 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8818e7a-26d2-41b5-9890-4e54901813e2 admin admin] PATH_INFO: `/v3/projects/0a7d71e9e70a4289849d721b4aa84853/users/00b6caa2f6d54e24a36be7a88fd503bb/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:14:30.584970 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8818e7a-26d2-41b5-9890-4e54901813e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a7d71e9e70a4289849d721b4aa84853, user_id=00b6caa2f6d54e24a36be7a88fd503bb, role_id=1a1c43cc97a0407eb7a7c7a1333a9d4a)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:14:30.587652 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8818e7a-26d2-41b5-9890-4e54901813e2 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:14:30.599942 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1314/2620] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 23:14:30 2022] PUT /identity/v3/projects/0a7d71e9e70a4289849d721b4aa84853/users/00b6caa2f6d54e24a36be7a88fd503bb/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 23:14:30.662467 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ef3fc8-d85b-4ad4-9992-b1d1b710cbb1 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:14:30.662773 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ef3fc8-d85b-4ad4-9992-b1d1b710cbb1 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:14:30.663035 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ef3fc8-d85b-4ad4-9992-b1d1b710cbb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:14:30.697495 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-46ef3fc8-d85b-4ad4-9992-b1d1b710cbb1 None None] MFA Rules not processed for user `00b6caa2f6d54e24a36be7a88fd503bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 23:14:30.698705 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-46ef3fc8-d85b-4ad4-9992-b1d1b710cbb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:14:30.771720 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1307/2621] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 23:14:30 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 23:14:30.783292 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8818e7a-26d2-41b5-9890-4e54901813e2 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:14:30.785567 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-a8818e7a-26d2-41b5-9890-4e54901813e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:14:30.847708 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8818e7a-26d2-41b5-9890-4e54901813e2 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:14:30.854381 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb18045-8c02-42c4-94e1-3f4b78d8254e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a747e2a5684843a6ee9e3480badac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:14:30.855318 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb18045-8c02-42c4-94e1-3f4b78d8254e service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:14:30.855762 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb18045-8c02-42c4-94e1-3f4b78d8254e service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:14:30.856113 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb18045-8c02-42c4-94e1-3f4b78d8254e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:14:30.869017 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb18045-8c02-42c4-94e1-3f4b78d8254e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:14:30.870485 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb18045-8c02-42c4-94e1-3f4b78d8254e service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:14:30.880290 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1315/2622] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:14:30 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:14:30.953575 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ef3fc8-d85b-4ad4-9992-b1d1b710cbb1 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:14:30.963716 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ef3fc8-d85b-4ad4-9992-b1d1b710cbb1 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:14:30.967492 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a85f42-a3fa-478d-a94d-3e1b688511a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a747e2a5684843a6ee9e3480badac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:14:30.968134 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a85f42-a3fa-478d-a94d-3e1b688511a7 service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:14:30.968419 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a85f42-a3fa-478d-a94d-3e1b688511a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:14:30.968701 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a85f42-a3fa-478d-a94d-3e1b688511a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:14:31.019440 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:14:31.033487 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a85f42-a3fa-478d-a94d-3e1b688511a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:14:31.034910 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a85f42-a3fa-478d-a94d-3e1b688511a7 service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:14:31.043902 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1308/2623] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:14:30 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:14:40.876073 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=83,keystone:INSERT=5 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:14:41.040070 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=7 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:14:46.124100 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb18045-8c02-42c4-94e1-3f4b78d8254e service cinder] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:14:46.192839 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb18045-8c02-42c4-94e1-3f4b78d8254e service cinder] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:14:46.197969 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7bc422-5b70-4ee6-ad6a-a7fa960597ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:14:46.198780 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7bc422-5b70-4ee6-ad6a-a7fa960597ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:14:46.199105 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7bc422-5b70-4ee6-ad6a-a7fa960597ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:14:46.199411 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7bc422-5b70-4ee6-ad6a-a7fa960597ff admin admin] PATH_INFO: `/v3/users/1b0f85522b3e4d449243a3e88ac25ae5` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:14:46.200592 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7bc422-5b70-4ee6-ad6a-a7fa960597ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b0f85522b3e4d449243a3e88ac25ae5)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:14:46.202552 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7bc422-5b70-4ee6-ad6a-a7fa960597ff admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:14:46.255899 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-bf7bc422-5b70-4ee6-ad6a-a7fa960597ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b0f85522b3e4d449243a3e88ac25ae5'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:14:46.262670 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-bf7bc422-5b70-4ee6-ad6a-a7fa960597ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b0f85522b3e4d449243a3e88ac25ae5'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:14:46.263365 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-bf7bc422-5b70-4ee6-ad6a-a7fa960597ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b0f85522b3e4d449243a3e88ac25ae5'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:14:46.263962 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-bf7bc422-5b70-4ee6-ad6a-a7fa960597ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b0f85522b3e4d449243a3e88ac25ae5'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:14:46.275974 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-bf7bc422-5b70-4ee6-ad6a-a7fa960597ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b0f85522b3e4d449243a3e88ac25ae5'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:14:46.290751 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1316/2624] 10.222.0.36 () {58 vars in 1223 bytes} [Fri Jun 24 23:14:46 2022] DELETE /identity/v3/users/1b0f85522b3e4d449243a3e88ac25ae5 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 23:14:46.295150 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd4000b-491e-4a06-adc6-196b46df8ffa None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:14:46.295674 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd4000b-491e-4a06-adc6-196b46df8ffa None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:14:46.295768 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd4000b-491e-4a06-adc6-196b46df8ffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:14:46.312722 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-dbd4000b-491e-4a06-adc6-196b46df8ffa None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 23:14:46.313914 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-dbd4000b-491e-4a06-adc6-196b46df8ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:14:46.382818 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1309/2625] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 23:14:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 23:14:46.392867 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7bc422-5b70-4ee6-ad6a-a7fa960597ff admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:14:46.394657 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-bf7bc422-5b70-4ee6-ad6a-a7fa960597ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:14:46.455569 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7bc422-5b70-4ee6-ad6a-a7fa960597ff admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:14:46.460296 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31414b5-3361-4edf-9075-fab87d032a78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:14:46.460950 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31414b5-3361-4edf-9075-fab87d032a78 service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:14:46.461233 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31414b5-3361-4edf-9075-fab87d032a78 service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:14:46.461502 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31414b5-3361-4edf-9075-fab87d032a78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:14:46.471564 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31414b5-3361-4edf-9075-fab87d032a78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:14:46.473115 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31414b5-3361-4edf-9075-fab87d032a78 service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:14:46.482516 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1317/2626] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:14:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:14:46.760890 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd4000b-491e-4a06-adc6-196b46df8ffa None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:14:46.762374 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-dbd4000b-491e-4a06-adc6-196b46df8ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:14:46.780445 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd4000b-491e-4a06-adc6-196b46df8ffa None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:14:46.785696 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2dfdd3-2c45-4264-8661-95986b8a0dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:14:46.786748 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2dfdd3-2c45-4264-8661-95986b8a0dce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:14:46.787033 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2dfdd3-2c45-4264-8661-95986b8a0dce admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:14:46.787345 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2dfdd3-2c45-4264-8661-95986b8a0dce admin admin] PATH_INFO: `/v3/projects/590f07df95794e6cb75beb0ad26bf67b` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:14:46.788608 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2dfdd3-2c45-4264-8661-95986b8a0dce admin admin] RBAC: Authorizing `identity:delete_project(project_id=590f07df95794e6cb75beb0ad26bf67b)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:14:46.790605 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2dfdd3-2c45-4264-8661-95986b8a0dce admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:14:46.842823 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-8e2dfdd3-2c45-4264-8661-95986b8a0dce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '590f07df95794e6cb75beb0ad26bf67b', 'request_id': 'req-8e2dfdd3-2c45-4264-8661-95986b8a0dce'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:14:46.849359 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-8e2dfdd3-2c45-4264-8661-95986b8a0dce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '590f07df95794e6cb75beb0ad26bf67b', 'request_id': 'req-8e2dfdd3-2c45-4264-8661-95986b8a0dce'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:14:46.858393 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-8e2dfdd3-2c45-4264-8661-95986b8a0dce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '590f07df95794e6cb75beb0ad26bf67b', 'request_id': 'req-8e2dfdd3-2c45-4264-8661-95986b8a0dce'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:14:46.869146 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-8e2dfdd3-2c45-4264-8661-95986b8a0dce admin admin] The token cache is being invalidate because project 590f07df95794e6cb75beb0ad26bf67b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 23:14:46.869487 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-8e2dfdd3-2c45-4264-8661-95986b8a0dce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:14:46.870356 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-8e2dfdd3-2c45-4264-8661-95986b8a0dce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:14:46.872638 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1310/2627] 10.222.0.36 () {58 vars in 1232 bytes} [Fri Jun 24 23:14:46 2022] DELETE /identity/v3/projects/590f07df95794e6cb75beb0ad26bf67b => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 23:14:46.876599 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31414b5-3361-4edf-9075-fab87d032a78 service neutron] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:14:46.886682 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31414b5-3361-4edf-9075-fab87d032a78 service neutron] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:14:46.904928 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:14:46.943968 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d68251a-ec5d-4cd4-9749-d92ef89f04de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:14:46.944847 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d68251a-ec5d-4cd4-9749-d92ef89f04de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:14:46.945163 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d68251a-ec5d-4cd4-9749-d92ef89f04de admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:14:46.945408 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d68251a-ec5d-4cd4-9749-d92ef89f04de admin admin] PATH_INFO: `/v3/users/00b6caa2f6d54e24a36be7a88fd503bb` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:14:46.946648 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d68251a-ec5d-4cd4-9749-d92ef89f04de admin admin] RBAC: Authorizing `identity:delete_user(user_id=00b6caa2f6d54e24a36be7a88fd503bb)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:14:46.948623 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d68251a-ec5d-4cd4-9749-d92ef89f04de admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:14:47.004260 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-5d68251a-ec5d-4cd4-9749-d92ef89f04de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00b6caa2f6d54e24a36be7a88fd503bb'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:14:47.011832 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-5d68251a-ec5d-4cd4-9749-d92ef89f04de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00b6caa2f6d54e24a36be7a88fd503bb'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:14:47.012612 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-5d68251a-ec5d-4cd4-9749-d92ef89f04de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00b6caa2f6d54e24a36be7a88fd503bb'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:14:47.013356 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-5d68251a-ec5d-4cd4-9749-d92ef89f04de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00b6caa2f6d54e24a36be7a88fd503bb'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:14:47.025931 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-5d68251a-ec5d-4cd4-9749-d92ef89f04de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00b6caa2f6d54e24a36be7a88fd503bb'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:14:47.040838 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1318/2628] 10.222.0.36 () {58 vars in 1223 bytes} [Fri Jun 24 23:14:46 2022] DELETE /identity/v3/users/00b6caa2f6d54e24a36be7a88fd503bb => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 23:14:47.334000 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2dfdd3-2c45-4264-8661-95986b8a0dce admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:14:47.335667 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-8e2dfdd3-2c45-4264-8661-95986b8a0dce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:14:47.350927 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2dfdd3-2c45-4264-8661-95986b8a0dce admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:14:47.413446 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19741cbe-d346-4966-bfb8-64c588857e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:14:47.414317 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19741cbe-d346-4966-bfb8-64c588857e23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:14:47.414592 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19741cbe-d346-4966-bfb8-64c588857e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:14:47.414865 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19741cbe-d346-4966-bfb8-64c588857e23 admin admin] PATH_INFO: `/v3/projects/0a7d71e9e70a4289849d721b4aa84853` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:14:47.416232 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19741cbe-d346-4966-bfb8-64c588857e23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a7d71e9e70a4289849d721b4aa84853)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:14:47.418149 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19741cbe-d346-4966-bfb8-64c588857e23 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:14:47.453467 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:14:47.472301 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-19741cbe-d346-4966-bfb8-64c588857e23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a7d71e9e70a4289849d721b4aa84853', 'request_id': 'req-19741cbe-d346-4966-bfb8-64c588857e23'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:14:47.478604 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-19741cbe-d346-4966-bfb8-64c588857e23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a7d71e9e70a4289849d721b4aa84853', 'request_id': 'req-19741cbe-d346-4966-bfb8-64c588857e23'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:14:47.487395 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-19741cbe-d346-4966-bfb8-64c588857e23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a7d71e9e70a4289849d721b4aa84853', 'request_id': 'req-19741cbe-d346-4966-bfb8-64c588857e23'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:14:47.499795 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-19741cbe-d346-4966-bfb8-64c588857e23 admin admin] The token cache is being invalidate because project 0a7d71e9e70a4289849d721b4aa84853 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 23:14:47.500094 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-19741cbe-d346-4966-bfb8-64c588857e23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:14:47.500755 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-19741cbe-d346-4966-bfb8-64c588857e23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:14:47.502729 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1311/2629] 10.222.0.36 () {58 vars in 1232 bytes} [Fri Jun 24 23:14:47 2022] DELETE /identity/v3/projects/0a7d71e9e70a4289849d721b4aa84853 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 23:14:47.507689 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7568c95e-9d53-4061-ba35-fe8df0416836 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:14:47.508146 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7568c95e-9d53-4061-ba35-fe8df0416836 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:14:47.508244 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7568c95e-9d53-4061-ba35-fe8df0416836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:14:47.526476 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-7568c95e-9d53-4061-ba35-fe8df0416836 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 23:14:47.527714 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-7568c95e-9d53-4061-ba35-fe8df0416836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:14:47.598378 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1319/2630] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 23:14:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 23:14:47.606286 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bcdeb7-6c42-4763-8e83-e442dfd4ada6 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:14:47.606608 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bcdeb7-6c42-4763-8e83-e442dfd4ada6 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:14:47.606885 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bcdeb7-6c42-4763-8e83-e442dfd4ada6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:14:47.626298 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-01bcdeb7-6c42-4763-8e83-e442dfd4ada6 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 23:14:47.627635 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-01bcdeb7-6c42-4763-8e83-e442dfd4ada6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:14:47.636550 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1312/2631] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 23:14:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 23:14:47.640913 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7568c95e-9d53-4061-ba35-fe8df0416836 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:14:47.651214 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7568c95e-9d53-4061-ba35-fe8df0416836 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:14:47.655713 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708c6142-1b73-416d-9434-38b7fc8a5442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:14:47.656362 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708c6142-1b73-416d-9434-38b7fc8a5442 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:14:47.656642 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708c6142-1b73-416d-9434-38b7fc8a5442 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:14:47.656925 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708c6142-1b73-416d-9434-38b7fc8a5442 admin admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:14:47.657623 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708c6142-1b73-416d-9434-38b7fc8a5442 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 23:14:47.657926 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708c6142-1b73-416d-9434-38b7fc8a5442 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:14:47.659601 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708c6142-1b73-416d-9434-38b7fc8a5442 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:14:47.671093 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1320/2632] 10.222.0.36 () {58 vars in 1152 bytes} [Fri Jun 24 23:14:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 23:14:47.675436 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bcdeb7-6c42-4763-8e83-e442dfd4ada6 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:14:47.685367 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bcdeb7-6c42-4763-8e83-e442dfd4ada6 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:14:47.690763 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af26621-f0e0-47c4-8f49-5522fc348de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:14:47.691522 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af26621-f0e0-47c4-8f49-5522fc348de0 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:14:47.691801 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af26621-f0e0-47c4-8f49-5522fc348de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:14:47.692074 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af26621-f0e0-47c4-8f49-5522fc348de0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:14:47.692762 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af26621-f0e0-47c4-8f49-5522fc348de0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:14:47.694669 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af26621-f0e0-47c4-8f49-5522fc348de0 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:14:47.721704 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1313/2633] 10.222.0.36 () {60 vars in 1152 bytes} [Fri Jun 24 23:14:47 2022] POST /identity/v3/projects => generated 379 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 23:14:47.726000 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708c6142-1b73-416d-9434-38b7fc8a5442 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:14:47.736144 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708c6142-1b73-416d-9434-38b7fc8a5442 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:14:47.761970 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:14:47.794647 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ceaa72-6374-4d4f-9634-22a2917cef7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:14:47.795338 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ceaa72-6374-4d4f-9634-22a2917cef7c admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:14:47.795617 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ceaa72-6374-4d4f-9634-22a2917cef7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:14:47.795889 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ceaa72-6374-4d4f-9634-22a2917cef7c admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:14:47.796570 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ceaa72-6374-4d4f-9634-22a2917cef7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:14:47.798497 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ceaa72-6374-4d4f-9634-22a2917cef7c admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:14:47.819777 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1321/2634] 10.222.0.36 () {60 vars in 1143 bytes} [Fri Jun 24 23:14:47 2022] POST /identity/v3/users => generated 290 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 23:14:47.825581 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af26621-f0e0-47c4-8f49-5522fc348de0 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:14:47.837170 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af26621-f0e0-47c4-8f49-5522fc348de0 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:14:47.843469 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0eecc1-887c-4be8-8a09-95959d030684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:14:47.844140 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0eecc1-887c-4be8-8a09-95959d030684 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:14:47.844423 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0eecc1-887c-4be8-8a09-95959d030684 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:14:47.844697 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0eecc1-887c-4be8-8a09-95959d030684 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:14:47.845431 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0eecc1-887c-4be8-8a09-95959d030684 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:14:47.847037 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0eecc1-887c-4be8-8a09-95959d030684 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:14:47.858098 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1314/2635] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 23:14:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 23:14:47.862195 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ceaa72-6374-4d4f-9634-22a2917cef7c admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:14:47.872988 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ceaa72-6374-4d4f-9634-22a2917cef7c admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:14:47.878541 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a03ed4-274b-4d19-97d8-6365b4bb4240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:14:47.879363 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a03ed4-274b-4d19-97d8-6365b4bb4240 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:14:47.879650 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a03ed4-274b-4d19-97d8-6365b4bb4240 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:14:47.879924 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a03ed4-274b-4d19-97d8-6365b4bb4240 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:14:47.880673 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a03ed4-274b-4d19-97d8-6365b4bb4240 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:14:47.882303 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a03ed4-274b-4d19-97d8-6365b4bb4240 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:14:47.892316 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1322/2636] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 23:14:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 23:14:47.896497 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0eecc1-887c-4be8-8a09-95959d030684 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:14:47.906612 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0eecc1-887c-4be8-8a09-95959d030684 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:14:47.911829 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4fe7a9-a172-43f4-adba-4c6d3c827f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:14:47.912699 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4fe7a9-a172-43f4-adba-4c6d3c827f7a admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:14:47.912974 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4fe7a9-a172-43f4-adba-4c6d3c827f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:14:47.913247 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4fe7a9-a172-43f4-adba-4c6d3c827f7a admin admin] PATH_INFO: `/v3/projects/7fe1915ac4df4cbab247305b02785a08/users/d1538fcf81c94259be6e7135f16689f6/roles/1928787bfcc745419829cd315900ac44` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:14:47.934533 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4fe7a9-a172-43f4-adba-4c6d3c827f7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fe1915ac4df4cbab247305b02785a08, user_id=d1538fcf81c94259be6e7135f16689f6, role_id=1928787bfcc745419829cd315900ac44)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:14:47.937237 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4fe7a9-a172-43f4-adba-4c6d3c827f7a admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:14:47.959192 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1315/2637] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 23:14:47 2022] PUT /identity/v3/projects/7fe1915ac4df4cbab247305b02785a08/users/d1538fcf81c94259be6e7135f16689f6/roles/1928787bfcc745419829cd315900ac44 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 23:14:47.970799 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff46ead8-07cf-46a9-9b8e-445f7bc0ec76 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:14:47.971093 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff46ead8-07cf-46a9-9b8e-445f7bc0ec76 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:14:47.971407 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff46ead8-07cf-46a9-9b8e-445f7bc0ec76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:14:47.998648 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-ff46ead8-07cf-46a9-9b8e-445f7bc0ec76 None None] MFA Rules not processed for user `d1538fcf81c94259be6e7135f16689f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 23:14:47.999995 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-ff46ead8-07cf-46a9-9b8e-445f7bc0ec76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:14:48.068714 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1323/2638] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 23:14:47 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 23:14:48.073354 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4fe7a9-a172-43f4-adba-4c6d3c827f7a admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:14:48.139290 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4fe7a9-a172-43f4-adba-4c6d3c827f7a admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:14:48.146555 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbd8b69-d6f4-460d-a5c9-eaba206b407b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:14:48.147285 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbd8b69-d6f4-460d-a5c9-eaba206b407b admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:14:48.147575 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbd8b69-d6f4-460d-a5c9-eaba206b407b admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:14:48.147846 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbd8b69-d6f4-460d-a5c9-eaba206b407b admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:14:48.148591 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbd8b69-d6f4-460d-a5c9-eaba206b407b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:14:48.150508 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbd8b69-d6f4-460d-a5c9-eaba206b407b admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:14:48.178099 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1316/2639] 10.222.0.36 () {60 vars in 1152 bytes} [Fri Jun 24 23:14:48 2022] POST /identity/v3/projects => generated 381 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 23:14:48.182230 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff46ead8-07cf-46a9-9b8e-445f7bc0ec76 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:14:48.193116 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff46ead8-07cf-46a9-9b8e-445f7bc0ec76 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:14:48.250377 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5e5123-bf92-4c16-92ad-5e5ea16a8aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:14:48.251041 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5e5123-bf92-4c16-92ad-5e5ea16a8aaa admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:14:48.251354 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5e5123-bf92-4c16-92ad-5e5ea16a8aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:14:48.251617 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5e5123-bf92-4c16-92ad-5e5ea16a8aaa admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:14:48.252299 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5e5123-bf92-4c16-92ad-5e5ea16a8aaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:14:48.254261 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5e5123-bf92-4c16-92ad-5e5ea16a8aaa admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:14:48.276802 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1324/2640] 10.222.0.36 () {60 vars in 1143 bytes} [Fri Jun 24 23:14:48 2022] POST /identity/v3/users => generated 297 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 23:14:48.281062 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbd8b69-d6f4-460d-a5c9-eaba206b407b admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:14:48.291671 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbd8b69-d6f4-460d-a5c9-eaba206b407b admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:14:48.296807 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e03f186-912d-4c4e-b37c-cc38dac771fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:14:48.297477 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e03f186-912d-4c4e-b37c-cc38dac771fd admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:14:48.297759 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e03f186-912d-4c4e-b37c-cc38dac771fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:14:48.298032 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e03f186-912d-4c4e-b37c-cc38dac771fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:14:48.298803 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e03f186-912d-4c4e-b37c-cc38dac771fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:14:48.300472 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e03f186-912d-4c4e-b37c-cc38dac771fd admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:14:48.311737 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1317/2641] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 23:14:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 23:14:48.316078 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5e5123-bf92-4c16-92ad-5e5ea16a8aaa admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:14:48.326917 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5e5123-bf92-4c16-92ad-5e5ea16a8aaa admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:14:48.332836 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0f7443-100b-4737-8e11-83df93345151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:14:48.333735 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f7443-100b-4737-8e11-83df93345151 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:14:48.334014 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f7443-100b-4737-8e11-83df93345151 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:14:48.334274 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f7443-100b-4737-8e11-83df93345151 admin admin] PATH_INFO: `/v3/projects/c6510f31de8f4b87a166c735841c014d/users/8c3e9fde37f84b9582f32bb043292138/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:14:48.351757 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0f7443-100b-4737-8e11-83df93345151 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6510f31de8f4b87a166c735841c014d, user_id=8c3e9fde37f84b9582f32bb043292138, role_id=1a1c43cc97a0407eb7a7c7a1333a9d4a)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:14:48.354452 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0f7443-100b-4737-8e11-83df93345151 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:14:48.370822 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1325/2642] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 23:14:48 2022] PUT /identity/v3/projects/c6510f31de8f4b87a166c735841c014d/users/8c3e9fde37f84b9582f32bb043292138/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 23:14:48.375084 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e03f186-912d-4c4e-b37c-cc38dac771fd admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:14:48.387082 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e03f186-912d-4c4e-b37c-cc38dac771fd admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:14:48.409945 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:14:48.454407 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9e4b2b-4d79-467b-9a99-103601adafcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:14:48.455120 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9e4b2b-4d79-467b-9a99-103601adafcb admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:14:48.455466 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9e4b2b-4d79-467b-9a99-103601adafcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:14:48.455697 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9e4b2b-4d79-467b-9a99-103601adafcb admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:14:48.456425 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9e4b2b-4d79-467b-9a99-103601adafcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:14:48.461110 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9e4b2b-4d79-467b-9a99-103601adafcb admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:14:48.475156 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1318/2643] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 23:14:48 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 23:14:48.476384 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0f7443-100b-4737-8e11-83df93345151 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:14:48.482552 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:14:48.489629 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0f7443-100b-4737-8e11-83df93345151 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:14:48.494842 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df0a0aa-ebbf-4076-8a3a-364e63aadca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:14:48.495786 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df0a0aa-ebbf-4076-8a3a-364e63aadca5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:14:48.496071 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df0a0aa-ebbf-4076-8a3a-364e63aadca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:14:48.496344 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df0a0aa-ebbf-4076-8a3a-364e63aadca5 admin admin] PATH_INFO: `/v3/projects/c6510f31de8f4b87a166c735841c014d/users/8c3e9fde37f84b9582f32bb043292138/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:14:48.498329 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df0a0aa-ebbf-4076-8a3a-364e63aadca5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6510f31de8f4b87a166c735841c014d, user_id=8c3e9fde37f84b9582f32bb043292138, role_id=1a1c43cc97a0407eb7a7c7a1333a9d4a)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:14:48.501017 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df0a0aa-ebbf-4076-8a3a-364e63aadca5 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:14:48.511532 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1326/2644] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 23:14:48 2022] PUT /identity/v3/projects/c6510f31de8f4b87a166c735841c014d/users/8c3e9fde37f84b9582f32bb043292138/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 23:14:48.522205 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e13fe5-cefc-4f7c-a75f-917957e9e3c0 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:14:48.522638 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e13fe5-cefc-4f7c-a75f-917957e9e3c0 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:14:48.522979 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e13fe5-cefc-4f7c-a75f-917957e9e3c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:14:48.549274 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-27e13fe5-cefc-4f7c-a75f-917957e9e3c0 None None] MFA Rules not processed for user `8c3e9fde37f84b9582f32bb043292138`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 23:14:48.550507 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-27e13fe5-cefc-4f7c-a75f-917957e9e3c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:14:48.627731 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1319/2645] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 23:14:48 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 23:14:48.640486 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df0a0aa-ebbf-4076-8a3a-364e63aadca5 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:14:48.642316 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-9df0a0aa-ebbf-4076-8a3a-364e63aadca5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:14:48.705883 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df0a0aa-ebbf-4076-8a3a-364e63aadca5 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:14:48.710666 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa41dee-7adb-460a-b5a4-2888f7913935 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a747e2a5684843a6ee9e3480badac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:14:48.711349 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa41dee-7adb-460a-b5a4-2888f7913935 service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:14:48.711632 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa41dee-7adb-460a-b5a4-2888f7913935 service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:14:48.711908 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa41dee-7adb-460a-b5a4-2888f7913935 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:14:48.721140 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa41dee-7adb-460a-b5a4-2888f7913935 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:14:48.722614 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa41dee-7adb-460a-b5a4-2888f7913935 service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:14:48.732093 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1327/2646] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:14:48 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:14:49.055373 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e13fe5-cefc-4f7c-a75f-917957e9e3c0 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:14:49.064982 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e13fe5-cefc-4f7c-a75f-917957e9e3c0 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:14:49.071167 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fd7725-b125-4c4e-8cc0-4b382b65e5e1 tempest-VolumeQuotaClassesTest-1396377295 tempest-VolumeQuotaClassesTest-1396377295-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3e9fde37f84b9582f32bb043292138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6510f31de8f4b87a166c735841c014d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:14:49.071864 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fd7725-b125-4c4e-8cc0-4b382b65e5e1 tempest-VolumeQuotaClassesTest-1396377295 tempest-VolumeQuotaClassesTest-1396377295-project-admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:14:49.072149 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fd7725-b125-4c4e-8cc0-4b382b65e5e1 tempest-VolumeQuotaClassesTest-1396377295 tempest-VolumeQuotaClassesTest-1396377295-project-admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:14:49.072424 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fd7725-b125-4c4e-8cc0-4b382b65e5e1 tempest-VolumeQuotaClassesTest-1396377295 tempest-VolumeQuotaClassesTest-1396377295-project-admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:14:49.073162 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fd7725-b125-4c4e-8cc0-4b382b65e5e1 tempest-VolumeQuotaClassesTest-1396377295 tempest-VolumeQuotaClassesTest-1396377295-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 23:14:49.073474 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fd7725-b125-4c4e-8cc0-4b382b65e5e1 tempest-VolumeQuotaClassesTest-1396377295 tempest-VolumeQuotaClassesTest-1396377295-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:14:49.075090 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fd7725-b125-4c4e-8cc0-4b382b65e5e1 tempest-VolumeQuotaClassesTest-1396377295 tempest-VolumeQuotaClassesTest-1396377295-project-admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:14:49.087631 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1320/2647] 10.222.0.36 () {58 vars in 1152 bytes} [Fri Jun 24 23:14:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 23:14:49.092296 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa41dee-7adb-460a-b5a4-2888f7913935 service cinder] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:14:49.106054 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa41dee-7adb-460a-b5a4-2888f7913935 service cinder] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:14:49.112961 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10e80fd-22e9-4469-b4fe-3f5a6e48d3e0 tempest-VolumeQuotaClassesTest-1396377295 tempest-VolumeQuotaClassesTest-1396377295-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3e9fde37f84b9582f32bb043292138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6510f31de8f4b87a166c735841c014d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:14:49.114085 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10e80fd-22e9-4469-b4fe-3f5a6e48d3e0 tempest-VolumeQuotaClassesTest-1396377295 tempest-VolumeQuotaClassesTest-1396377295-project-admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:14:49.114604 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10e80fd-22e9-4469-b4fe-3f5a6e48d3e0 tempest-VolumeQuotaClassesTest-1396377295 tempest-VolumeQuotaClassesTest-1396377295-project-admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:14:49.114916 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10e80fd-22e9-4469-b4fe-3f5a6e48d3e0 tempest-VolumeQuotaClassesTest-1396377295 tempest-VolumeQuotaClassesTest-1396377295-project-admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:14:49.115679 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10e80fd-22e9-4469-b4fe-3f5a6e48d3e0 tempest-VolumeQuotaClassesTest-1396377295 tempest-VolumeQuotaClassesTest-1396377295-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:14:49.117699 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10e80fd-22e9-4469-b4fe-3f5a6e48d3e0 tempest-VolumeQuotaClassesTest-1396377295 tempest-VolumeQuotaClassesTest-1396377295-project-admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:14:49.147351 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1328/2648] 10.222.0.36 () {60 vars in 1152 bytes} [Fri Jun 24 23:14:49 2022] POST /identity/v3/projects => generated 354 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 23:14:49.151544 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fd7725-b125-4c4e-8cc0-4b382b65e5e1 tempest-VolumeQuotaClassesTest-1396377295 tempest-VolumeQuotaClassesTest-1396377295-project-admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:14:49.161964 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fd7725-b125-4c4e-8cc0-4b382b65e5e1 tempest-VolumeQuotaClassesTest-1396377295 tempest-VolumeQuotaClassesTest-1396377295-project-admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:14:49.219768 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50968592-7353-489f-8d90-8776daa94c5f tempest-VolumeQuotaClassesTest-1396377295 tempest-VolumeQuotaClassesTest-1396377295-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3e9fde37f84b9582f32bb043292138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6510f31de8f4b87a166c735841c014d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:14:49.220455 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50968592-7353-489f-8d90-8776daa94c5f tempest-VolumeQuotaClassesTest-1396377295 tempest-VolumeQuotaClassesTest-1396377295-project-admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:14:49.220746 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50968592-7353-489f-8d90-8776daa94c5f tempest-VolumeQuotaClassesTest-1396377295 tempest-VolumeQuotaClassesTest-1396377295-project-admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:14:49.221027 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50968592-7353-489f-8d90-8776daa94c5f tempest-VolumeQuotaClassesTest-1396377295 tempest-VolumeQuotaClassesTest-1396377295-project-admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:14:49.221744 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50968592-7353-489f-8d90-8776daa94c5f tempest-VolumeQuotaClassesTest-1396377295 tempest-VolumeQuotaClassesTest-1396377295-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 23:14:49.222052 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50968592-7353-489f-8d90-8776daa94c5f tempest-VolumeQuotaClassesTest-1396377295 tempest-VolumeQuotaClassesTest-1396377295-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:14:49.224197 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50968592-7353-489f-8d90-8776daa94c5f tempest-VolumeQuotaClassesTest-1396377295 tempest-VolumeQuotaClassesTest-1396377295-project-admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:14:49.236478 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1321/2649] 10.222.0.36 () {58 vars in 1152 bytes} [Fri Jun 24 23:14:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 23:14:49.276038 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10e80fd-22e9-4469-b4fe-3f5a6e48d3e0 tempest-VolumeQuotaClassesTest-1396377295 tempest-VolumeQuotaClassesTest-1396377295-project-admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:14:49.289813 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10e80fd-22e9-4469-b4fe-3f5a6e48d3e0 tempest-VolumeQuotaClassesTest-1396377295 tempest-VolumeQuotaClassesTest-1396377295-project-admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:14:49.295349 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1e3999-2f5d-4e31-9648-ccbee825eb64 tempest-VolumeQuotaClassesTest-1396377295 tempest-VolumeQuotaClassesTest-1396377295-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3e9fde37f84b9582f32bb043292138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6510f31de8f4b87a166c735841c014d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:14:49.296208 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1e3999-2f5d-4e31-9648-ccbee825eb64 tempest-VolumeQuotaClassesTest-1396377295 tempest-VolumeQuotaClassesTest-1396377295-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:14:49.296489 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1e3999-2f5d-4e31-9648-ccbee825eb64 tempest-VolumeQuotaClassesTest-1396377295 tempest-VolumeQuotaClassesTest-1396377295-project-admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:14:49.296760 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1e3999-2f5d-4e31-9648-ccbee825eb64 tempest-VolumeQuotaClassesTest-1396377295 tempest-VolumeQuotaClassesTest-1396377295-project-admin] PATH_INFO: `/v3/projects/78cb6e261d17463e84c733d0a118c4f4` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:14:49.298014 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1e3999-2f5d-4e31-9648-ccbee825eb64 tempest-VolumeQuotaClassesTest-1396377295 tempest-VolumeQuotaClassesTest-1396377295-project-admin] RBAC: Authorizing `identity:delete_project(project_id=78cb6e261d17463e84c733d0a118c4f4)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:14:49.299981 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1e3999-2f5d-4e31-9648-ccbee825eb64 tempest-VolumeQuotaClassesTest-1396377295 tempest-VolumeQuotaClassesTest-1396377295-project-admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:14:49.353751 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-ca1e3999-2f5d-4e31-9648-ccbee825eb64 tempest-VolumeQuotaClassesTest-1396377295 tempest-VolumeQuotaClassesTest-1396377295-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78cb6e261d17463e84c733d0a118c4f4', 'request_id': 'req-ca1e3999-2f5d-4e31-9648-ccbee825eb64'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:14:49.359876 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-ca1e3999-2f5d-4e31-9648-ccbee825eb64 tempest-VolumeQuotaClassesTest-1396377295 tempest-VolumeQuotaClassesTest-1396377295-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78cb6e261d17463e84c733d0a118c4f4', 'request_id': 'req-ca1e3999-2f5d-4e31-9648-ccbee825eb64'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:14:49.369108 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-ca1e3999-2f5d-4e31-9648-ccbee825eb64 tempest-VolumeQuotaClassesTest-1396377295 tempest-VolumeQuotaClassesTest-1396377295-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78cb6e261d17463e84c733d0a118c4f4', 'request_id': 'req-ca1e3999-2f5d-4e31-9648-ccbee825eb64'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:14:49.379913 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-ca1e3999-2f5d-4e31-9648-ccbee825eb64 tempest-VolumeQuotaClassesTest-1396377295 tempest-VolumeQuotaClassesTest-1396377295-project-admin] The token cache is being invalidate because project 78cb6e261d17463e84c733d0a118c4f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 23:14:49.380202 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-ca1e3999-2f5d-4e31-9648-ccbee825eb64 tempest-VolumeQuotaClassesTest-1396377295 tempest-VolumeQuotaClassesTest-1396377295-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:14:49.380852 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-ca1e3999-2f5d-4e31-9648-ccbee825eb64 tempest-VolumeQuotaClassesTest-1396377295 tempest-VolumeQuotaClassesTest-1396377295-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:14:49.382424 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1329/2650] 10.222.0.36 () {58 vars in 1232 bytes} [Fri Jun 24 23:14:49 2022] DELETE /identity/v3/projects/78cb6e261d17463e84c733d0a118c4f4 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 23:14:49.583001 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50968592-7353-489f-8d90-8776daa94c5f tempest-VolumeQuotaClassesTest-1396377295 tempest-VolumeQuotaClassesTest-1396377295-project-admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:14:49.585241 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-50968592-7353-489f-8d90-8776daa94c5f tempest-VolumeQuotaClassesTest-1396377295 tempest-VolumeQuotaClassesTest-1396377295-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:14:49.621516 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:14:49.656185 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50968592-7353-489f-8d90-8776daa94c5f tempest-VolumeQuotaClassesTest-1396377295 tempest-VolumeQuotaClassesTest-1396377295-project-admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:14:49.713750 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeda11a-9bc6-46bc-a113-d4c712e192ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:14:49.714673 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeda11a-9bc6-46bc-a113-d4c712e192ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:14:49.714952 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeda11a-9bc6-46bc-a113-d4c712e192ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:14:49.715222 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeda11a-9bc6-46bc-a113-d4c712e192ba admin admin] PATH_INFO: `/v3/users/d1538fcf81c94259be6e7135f16689f6` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:14:49.716552 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeda11a-9bc6-46bc-a113-d4c712e192ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1538fcf81c94259be6e7135f16689f6)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:14:49.718512 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeda11a-9bc6-46bc-a113-d4c712e192ba admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:14:49.772934 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-afeda11a-9bc6-46bc-a113-d4c712e192ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1538fcf81c94259be6e7135f16689f6'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:14:49.780388 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-afeda11a-9bc6-46bc-a113-d4c712e192ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1538fcf81c94259be6e7135f16689f6'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:14:49.781481 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-afeda11a-9bc6-46bc-a113-d4c712e192ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1538fcf81c94259be6e7135f16689f6'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:14:49.781678 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-afeda11a-9bc6-46bc-a113-d4c712e192ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1538fcf81c94259be6e7135f16689f6'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:14:49.800182 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-afeda11a-9bc6-46bc-a113-d4c712e192ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1538fcf81c94259be6e7135f16689f6'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:14:49.816027 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1322/2651] 10.222.0.36 () {58 vars in 1223 bytes} [Fri Jun 24 23:14:49 2022] DELETE /identity/v3/users/d1538fcf81c94259be6e7135f16689f6 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 23:14:49.820747 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d195ec62-d9a0-4b6a-af5a-92da63f65281 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:14:49.822542 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d195ec62-d9a0-4b6a-af5a-92da63f65281 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:14:49.822902 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d195ec62-d9a0-4b6a-af5a-92da63f65281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:14:49.842751 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-d195ec62-d9a0-4b6a-af5a-92da63f65281 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 23:14:49.844012 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-d195ec62-d9a0-4b6a-af5a-92da63f65281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:14:49.895524 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:14:49.910829 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1330/2652] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 23:14:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 23:14:49.920567 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeda11a-9bc6-46bc-a113-d4c712e192ba admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:14:49.922071 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-afeda11a-9bc6-46bc-a113-d4c712e192ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:14:49.983186 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeda11a-9bc6-46bc-a113-d4c712e192ba admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:14:49.987202 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e490a668-fd8a-41ff-afdb-79233922a73d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:14:49.987962 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e490a668-fd8a-41ff-afdb-79233922a73d service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:14:49.988671 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e490a668-fd8a-41ff-afdb-79233922a73d service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:14:49.989149 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e490a668-fd8a-41ff-afdb-79233922a73d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:14:49.996336 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:14:49.998694 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e490a668-fd8a-41ff-afdb-79233922a73d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:14:50.000527 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e490a668-fd8a-41ff-afdb-79233922a73d service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:14:50.010577 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1323/2653] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:14:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:14:50.274529 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d195ec62-d9a0-4b6a-af5a-92da63f65281 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:14:50.276089 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-d195ec62-d9a0-4b6a-af5a-92da63f65281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:14:50.289172 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d195ec62-d9a0-4b6a-af5a-92da63f65281 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:14:50.294461 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c388517c-f3f3-4916-a0b9-e19f853afa1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:14:50.295415 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c388517c-f3f3-4916-a0b9-e19f853afa1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:14:50.295844 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c388517c-f3f3-4916-a0b9-e19f853afa1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:14:50.296121 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c388517c-f3f3-4916-a0b9-e19f853afa1d admin admin] PATH_INFO: `/v3/projects/7fe1915ac4df4cbab247305b02785a08` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:14:50.297388 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c388517c-f3f3-4916-a0b9-e19f853afa1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fe1915ac4df4cbab247305b02785a08)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:14:50.299376 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c388517c-f3f3-4916-a0b9-e19f853afa1d admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:14:50.350939 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-c388517c-f3f3-4916-a0b9-e19f853afa1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fe1915ac4df4cbab247305b02785a08', 'request_id': 'req-c388517c-f3f3-4916-a0b9-e19f853afa1d'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:14:50.357079 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-c388517c-f3f3-4916-a0b9-e19f853afa1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fe1915ac4df4cbab247305b02785a08', 'request_id': 'req-c388517c-f3f3-4916-a0b9-e19f853afa1d'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:14:50.366110 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-c388517c-f3f3-4916-a0b9-e19f853afa1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fe1915ac4df4cbab247305b02785a08', 'request_id': 'req-c388517c-f3f3-4916-a0b9-e19f853afa1d'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:14:50.376628 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-c388517c-f3f3-4916-a0b9-e19f853afa1d admin admin] The token cache is being invalidate because project 7fe1915ac4df4cbab247305b02785a08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 23:14:50.376921 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-c388517c-f3f3-4916-a0b9-e19f853afa1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:14:50.377547 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-c388517c-f3f3-4916-a0b9-e19f853afa1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:14:50.379169 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1331/2654] 10.222.0.36 () {58 vars in 1232 bytes} [Fri Jun 24 23:14:50 2022] DELETE /identity/v3/projects/7fe1915ac4df4cbab247305b02785a08 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 23:14:50.383279 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e490a668-fd8a-41ff-afdb-79233922a73d service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:14:50.393149 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e490a668-fd8a-41ff-afdb-79233922a73d service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:14:50.451153 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac4957d-404e-4027-b3be-c5906491c5d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:14:50.452069 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac4957d-404e-4027-b3be-c5906491c5d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:14:50.452345 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac4957d-404e-4027-b3be-c5906491c5d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:14:50.452617 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac4957d-404e-4027-b3be-c5906491c5d0 admin admin] PATH_INFO: `/v3/users/8c3e9fde37f84b9582f32bb043292138` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:14:50.453850 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac4957d-404e-4027-b3be-c5906491c5d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c3e9fde37f84b9582f32bb043292138)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:14:50.455799 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac4957d-404e-4027-b3be-c5906491c5d0 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:14:50.504633 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-dac4957d-404e-4027-b3be-c5906491c5d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c3e9fde37f84b9582f32bb043292138'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:14:50.511821 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-dac4957d-404e-4027-b3be-c5906491c5d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c3e9fde37f84b9582f32bb043292138'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:14:50.512466 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-dac4957d-404e-4027-b3be-c5906491c5d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c3e9fde37f84b9582f32bb043292138'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:14:50.513059 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-dac4957d-404e-4027-b3be-c5906491c5d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c3e9fde37f84b9582f32bb043292138'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:14:50.529703 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-dac4957d-404e-4027-b3be-c5906491c5d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c3e9fde37f84b9582f32bb043292138'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:14:50.545610 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1324/2655] 10.222.0.36 () {58 vars in 1223 bytes} [Fri Jun 24 23:14:50 2022] DELETE /identity/v3/users/8c3e9fde37f84b9582f32bb043292138 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 23:14:50.823368 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c388517c-f3f3-4916-a0b9-e19f853afa1d admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:14:50.825015 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-c388517c-f3f3-4916-a0b9-e19f853afa1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:14:50.838766 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c388517c-f3f3-4916-a0b9-e19f853afa1d admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:14:50.904338 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2437ad-3ec9-4f54-b16d-9878926c7ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:14:50.905222 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2437ad-3ec9-4f54-b16d-9878926c7ad8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:14:50.906303 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2437ad-3ec9-4f54-b16d-9878926c7ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:14:50.906303 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2437ad-3ec9-4f54-b16d-9878926c7ad8 admin admin] PATH_INFO: `/v3/projects/c6510f31de8f4b87a166c735841c014d` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:14:50.908324 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2437ad-3ec9-4f54-b16d-9878926c7ad8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6510f31de8f4b87a166c735841c014d)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:14:50.909089 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2437ad-3ec9-4f54-b16d-9878926c7ad8 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:14:50.963484 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-2e2437ad-3ec9-4f54-b16d-9878926c7ad8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6510f31de8f4b87a166c735841c014d', 'request_id': 'req-2e2437ad-3ec9-4f54-b16d-9878926c7ad8'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:14:50.972368 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-2e2437ad-3ec9-4f54-b16d-9878926c7ad8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6510f31de8f4b87a166c735841c014d', 'request_id': 'req-2e2437ad-3ec9-4f54-b16d-9878926c7ad8'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:14:50.981541 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-2e2437ad-3ec9-4f54-b16d-9878926c7ad8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6510f31de8f4b87a166c735841c014d', 'request_id': 'req-2e2437ad-3ec9-4f54-b16d-9878926c7ad8'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:14:50.994772 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-2e2437ad-3ec9-4f54-b16d-9878926c7ad8 admin admin] The token cache is being invalidate because project c6510f31de8f4b87a166c735841c014d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 23:14:50.995058 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-2e2437ad-3ec9-4f54-b16d-9878926c7ad8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:14:50.995718 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-2e2437ad-3ec9-4f54-b16d-9878926c7ad8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:14:50.997251 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1332/2656] 10.222.0.36 () {58 vars in 1232 bytes} [Fri Jun 24 23:14:50 2022] DELETE /identity/v3/projects/c6510f31de8f4b87a166c735841c014d => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 23:14:51.002317 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d87445-1270-405c-b2b5-724e515d991d None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:14:51.002811 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d87445-1270-405c-b2b5-724e515d991d None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:14:51.002919 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d87445-1270-405c-b2b5-724e515d991d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:14:51.021296 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-41d87445-1270-405c-b2b5-724e515d991d None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 23:14:51.022470 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-41d87445-1270-405c-b2b5-724e515d991d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:14:51.089950 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1325/2657] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 23:14:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 23:14:51.097767 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341257b2-428d-474b-a256-0dd455c25c91 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:14:51.098078 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341257b2-428d-474b-a256-0dd455c25c91 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:14:51.098353 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341257b2-428d-474b-a256-0dd455c25c91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:14:51.115002 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:14:51.121345 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-341257b2-428d-474b-a256-0dd455c25c91 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 23:14:51.122982 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-341257b2-428d-474b-a256-0dd455c25c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:14:51.131807 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1333/2658] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 23:14:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 23:14:51.135941 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d87445-1270-405c-b2b5-724e515d991d None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:14:51.145957 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d87445-1270-405c-b2b5-724e515d991d None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:14:51.150958 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf5cc71-9829-4a67-b70c-b16acd4e684c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:14:51.151665 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf5cc71-9829-4a67-b70c-b16acd4e684c admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:14:51.151941 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf5cc71-9829-4a67-b70c-b16acd4e684c admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:14:51.152220 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf5cc71-9829-4a67-b70c-b16acd4e684c admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:14:51.152935 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf5cc71-9829-4a67-b70c-b16acd4e684c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 23:14:51.153239 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf5cc71-9829-4a67-b70c-b16acd4e684c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:14:51.154853 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf5cc71-9829-4a67-b70c-b16acd4e684c admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:14:51.166959 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1326/2659] 10.222.0.36 () {58 vars in 1152 bytes} [Fri Jun 24 23:14:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 23:14:51.171491 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341257b2-428d-474b-a256-0dd455c25c91 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:14:51.181348 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341257b2-428d-474b-a256-0dd455c25c91 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:14:51.186741 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69371851-82fc-4773-b511-90851baffa5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:14:51.187429 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69371851-82fc-4773-b511-90851baffa5e admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:14:51.187713 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69371851-82fc-4773-b511-90851baffa5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:14:51.187966 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69371851-82fc-4773-b511-90851baffa5e admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:14:51.188672 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69371851-82fc-4773-b511-90851baffa5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:14:51.190570 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69371851-82fc-4773-b511-90851baffa5e admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:14:51.218992 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1334/2660] 10.222.0.36 () {60 vars in 1152 bytes} [Fri Jun 24 23:14:51 2022] POST /identity/v3/projects => generated 379 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 23:14:51.225620 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf5cc71-9829-4a67-b70c-b16acd4e684c admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:14:51.233776 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:14:51.240834 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf5cc71-9829-4a67-b70c-b16acd4e684c admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:14:51.310268 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6432a390-78ee-40cd-bde7-0f713c1784ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:14:51.310937 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6432a390-78ee-40cd-bde7-0f713c1784ce admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:14:51.311225 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6432a390-78ee-40cd-bde7-0f713c1784ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:14:51.311661 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6432a390-78ee-40cd-bde7-0f713c1784ce admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:14:51.312736 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6432a390-78ee-40cd-bde7-0f713c1784ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:14:51.315830 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6432a390-78ee-40cd-bde7-0f713c1784ce admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:14:51.339521 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1327/2661] 10.222.0.36 () {60 vars in 1143 bytes} [Fri Jun 24 23:14:51 2022] POST /identity/v3/users => generated 290 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 23:14:51.343806 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69371851-82fc-4773-b511-90851baffa5e admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:14:51.358024 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69371851-82fc-4773-b511-90851baffa5e admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:14:51.365593 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dba161d-61b0-4cb0-8ad3-bbf9726b6b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:14:51.366293 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dba161d-61b0-4cb0-8ad3-bbf9726b6b8f admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:14:51.366616 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dba161d-61b0-4cb0-8ad3-bbf9726b6b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:14:51.366862 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dba161d-61b0-4cb0-8ad3-bbf9726b6b8f admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:14:51.367819 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dba161d-61b0-4cb0-8ad3-bbf9726b6b8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:14:51.369469 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dba161d-61b0-4cb0-8ad3-bbf9726b6b8f admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:14:51.381774 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1335/2662] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 23:14:51 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 23:14:51.385826 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6432a390-78ee-40cd-bde7-0f713c1784ce admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:14:51.396344 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6432a390-78ee-40cd-bde7-0f713c1784ce admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:14:51.401079 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9670e9f-b122-41f6-ba22-a4fdf23a5002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:14:51.401715 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9670e9f-b122-41f6-ba22-a4fdf23a5002 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:14:51.401995 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9670e9f-b122-41f6-ba22-a4fdf23a5002 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:14:51.402268 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9670e9f-b122-41f6-ba22-a4fdf23a5002 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:14:51.402983 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9670e9f-b122-41f6-ba22-a4fdf23a5002 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:14:51.404612 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9670e9f-b122-41f6-ba22-a4fdf23a5002 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:14:51.415293 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1328/2663] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 23:14:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 23:14:51.419514 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dba161d-61b0-4cb0-8ad3-bbf9726b6b8f admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:14:51.429963 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dba161d-61b0-4cb0-8ad3-bbf9726b6b8f admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:14:51.434785 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535f7f3c-e382-4318-8e93-df8abccd3711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:14:51.435721 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535f7f3c-e382-4318-8e93-df8abccd3711 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:14:51.435999 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535f7f3c-e382-4318-8e93-df8abccd3711 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:14:51.436266 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535f7f3c-e382-4318-8e93-df8abccd3711 admin admin] PATH_INFO: `/v3/projects/593f86ad2c3542678cb7fe15056c3280/users/5026005876084c45822f5bcd4327bb8e/roles/1928787bfcc745419829cd315900ac44` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:14:51.451191 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535f7f3c-e382-4318-8e93-df8abccd3711 admin admin] RBAC: Authorizing `identity:create_grant(project_id=593f86ad2c3542678cb7fe15056c3280, user_id=5026005876084c45822f5bcd4327bb8e, role_id=1928787bfcc745419829cd315900ac44)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:14:51.453952 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535f7f3c-e382-4318-8e93-df8abccd3711 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:14:51.470486 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1336/2664] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 23:14:51 2022] PUT /identity/v3/projects/593f86ad2c3542678cb7fe15056c3280/users/5026005876084c45822f5bcd4327bb8e/roles/1928787bfcc745419829cd315900ac44 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 23:14:51.482203 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02767760-fe34-4f0f-aa9f-13b773720451 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:14:51.482498 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02767760-fe34-4f0f-aa9f-13b773720451 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:14:51.482790 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02767760-fe34-4f0f-aa9f-13b773720451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:14:51.511105 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-02767760-fe34-4f0f-aa9f-13b773720451 None None] MFA Rules not processed for user `5026005876084c45822f5bcd4327bb8e`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 23:14:51.512369 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-02767760-fe34-4f0f-aa9f-13b773720451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:14:51.580022 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1329/2665] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 23:14:51 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 23:14:51.585299 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535f7f3c-e382-4318-8e93-df8abccd3711 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:14:51.654196 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535f7f3c-e382-4318-8e93-df8abccd3711 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:14:51.659293 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b968e10-5396-4370-b1f9-1b14f6647ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:14:51.660123 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b968e10-5396-4370-b1f9-1b14f6647ea5 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:14:51.660541 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b968e10-5396-4370-b1f9-1b14f6647ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:14:51.660967 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b968e10-5396-4370-b1f9-1b14f6647ea5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:14:51.662041 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b968e10-5396-4370-b1f9-1b14f6647ea5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:14:51.665187 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b968e10-5396-4370-b1f9-1b14f6647ea5 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:14:51.698438 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1337/2666] 10.222.0.36 () {60 vars in 1152 bytes} [Fri Jun 24 23:14:51 2022] POST /identity/v3/projects => generated 379 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 23:14:51.703197 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02767760-fe34-4f0f-aa9f-13b773720451 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:14:51.719913 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02767760-fe34-4f0f-aa9f-13b773720451 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:14:51.779591 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1488d7-61c6-40ed-b906-120b5240d16d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:14:51.780266 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1488d7-61c6-40ed-b906-120b5240d16d admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:14:51.780545 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1488d7-61c6-40ed-b906-120b5240d16d admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:14:51.780816 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1488d7-61c6-40ed-b906-120b5240d16d admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:14:51.781513 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1488d7-61c6-40ed-b906-120b5240d16d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:14:51.783460 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1488d7-61c6-40ed-b906-120b5240d16d admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:14:51.799977 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:14:51.805419 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1330/2667] 10.222.0.36 () {60 vars in 1143 bytes} [Fri Jun 24 23:14:51 2022] POST /identity/v3/users => generated 296 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 23:14:51.810000 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b968e10-5396-4370-b1f9-1b14f6647ea5 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:14:51.823022 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b968e10-5396-4370-b1f9-1b14f6647ea5 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:14:51.828778 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ae6618-8807-4d84-b503-39fbc7d26277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:14:51.829562 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae6618-8807-4d84-b503-39fbc7d26277 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:14:51.829727 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae6618-8807-4d84-b503-39fbc7d26277 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:14:51.829960 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae6618-8807-4d84-b503-39fbc7d26277 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:14:51.830689 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ae6618-8807-4d84-b503-39fbc7d26277 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:14:51.832432 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ae6618-8807-4d84-b503-39fbc7d26277 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:14:51.847149 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1338/2668] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 23:14:51 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 23:14:51.848179 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1488d7-61c6-40ed-b906-120b5240d16d admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:14:51.859852 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1488d7-61c6-40ed-b906-120b5240d16d admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:14:51.865655 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e73236-da10-4901-9555-93c9499b5533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:14:51.866739 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e73236-da10-4901-9555-93c9499b5533 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:14:51.866848 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e73236-da10-4901-9555-93c9499b5533 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:14:51.867200 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e73236-da10-4901-9555-93c9499b5533 admin admin] PATH_INFO: `/v3/projects/57df6d6e619640c2831bcfefa71495a2/users/e81190d9eed144a3974c0508421281b3/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:14:51.882835 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e73236-da10-4901-9555-93c9499b5533 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57df6d6e619640c2831bcfefa71495a2, user_id=e81190d9eed144a3974c0508421281b3, role_id=1a1c43cc97a0407eb7a7c7a1333a9d4a)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:14:51.885548 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e73236-da10-4901-9555-93c9499b5533 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:14:51.899983 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1331/2669] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 23:14:51 2022] PUT /identity/v3/projects/57df6d6e619640c2831bcfefa71495a2/users/e81190d9eed144a3974c0508421281b3/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 23:14:51.904158 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ae6618-8807-4d84-b503-39fbc7d26277 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:14:51.914675 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ae6618-8807-4d84-b503-39fbc7d26277 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:14:51.976271 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4662dd8-a096-4077-bdbe-97fd80f5e097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:14:51.976942 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4662dd8-a096-4077-bdbe-97fd80f5e097 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:14:51.977223 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4662dd8-a096-4077-bdbe-97fd80f5e097 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:14:51.977493 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4662dd8-a096-4077-bdbe-97fd80f5e097 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:14:51.978218 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4662dd8-a096-4077-bdbe-97fd80f5e097 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:14:51.979860 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4662dd8-a096-4077-bdbe-97fd80f5e097 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:14:51.993474 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1339/2670] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 23:14:51 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 23:14:51.999959 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e73236-da10-4901-9555-93c9499b5533 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:14:52.017690 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e73236-da10-4901-9555-93c9499b5533 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:14:52.023863 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e93c6c-f67d-48f2-9ef1-14f03a09dced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:14:52.024751 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e93c6c-f67d-48f2-9ef1-14f03a09dced admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:14:52.025036 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e93c6c-f67d-48f2-9ef1-14f03a09dced admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:14:52.025314 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e93c6c-f67d-48f2-9ef1-14f03a09dced admin admin] PATH_INFO: `/v3/projects/57df6d6e619640c2831bcfefa71495a2/users/e81190d9eed144a3974c0508421281b3/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:14:52.027350 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e93c6c-f67d-48f2-9ef1-14f03a09dced admin admin] RBAC: Authorizing `identity:create_grant(project_id=57df6d6e619640c2831bcfefa71495a2, user_id=e81190d9eed144a3974c0508421281b3, role_id=1a1c43cc97a0407eb7a7c7a1333a9d4a)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:14:52.030014 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e93c6c-f67d-48f2-9ef1-14f03a09dced admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:14:52.040687 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1332/2671] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 23:14:51 2022] PUT /identity/v3/projects/57df6d6e619640c2831bcfefa71495a2/users/e81190d9eed144a3974c0508421281b3/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 23:14:52.051982 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d197e7fd-a775-49ba-8179-df4e95c73b30 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:14:52.052342 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d197e7fd-a775-49ba-8179-df4e95c73b30 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:14:52.052598 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d197e7fd-a775-49ba-8179-df4e95c73b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:14:52.079520 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:14:52.084758 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-d197e7fd-a775-49ba-8179-df4e95c73b30 None None] MFA Rules not processed for user `e81190d9eed144a3974c0508421281b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 23:14:52.086734 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-d197e7fd-a775-49ba-8179-df4e95c73b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:14:52.173589 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1340/2672] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 23:14:52 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 23:14:52.185330 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e93c6c-f67d-48f2-9ef1-14f03a09dced admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:14:52.187595 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-a9e93c6c-f67d-48f2-9ef1-14f03a09dced admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:14:52.250133 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e93c6c-f67d-48f2-9ef1-14f03a09dced admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:14:52.254433 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368a634b-1e29-48cb-bed4-d3550682f3b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a747e2a5684843a6ee9e3480badac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:14:52.255089 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a634b-1e29-48cb-bed4-d3550682f3b5 service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:14:52.255424 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a634b-1e29-48cb-bed4-d3550682f3b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:14:52.255705 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a634b-1e29-48cb-bed4-d3550682f3b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:14:52.264982 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368a634b-1e29-48cb-bed4-d3550682f3b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:14:52.266457 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368a634b-1e29-48cb-bed4-d3550682f3b5 service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:14:52.276291 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1333/2673] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:14:52 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:14:52.658630 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d197e7fd-a775-49ba-8179-df4e95c73b30 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:14:52.729303 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d197e7fd-a775-49ba-8179-df4e95c73b30 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:14:52.736394 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13bfd39-ff90-446b-b330-db3ee0d6ca92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:14:52.737632 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13bfd39-ff90-446b-b330-db3ee0d6ca92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:14:52.738003 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13bfd39-ff90-446b-b330-db3ee0d6ca92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:14:52.738684 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13bfd39-ff90-446b-b330-db3ee0d6ca92 admin admin] PATH_INFO: `/v3/users/5026005876084c45822f5bcd4327bb8e` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:14:52.739919 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13bfd39-ff90-446b-b330-db3ee0d6ca92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5026005876084c45822f5bcd4327bb8e)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:14:52.741851 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13bfd39-ff90-446b-b330-db3ee0d6ca92 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:14:52.790569 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-e13bfd39-ff90-446b-b330-db3ee0d6ca92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5026005876084c45822f5bcd4327bb8e'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:14:52.798084 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-e13bfd39-ff90-446b-b330-db3ee0d6ca92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5026005876084c45822f5bcd4327bb8e'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:14:52.798867 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-e13bfd39-ff90-446b-b330-db3ee0d6ca92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5026005876084c45822f5bcd4327bb8e'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:14:52.799599 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-e13bfd39-ff90-446b-b330-db3ee0d6ca92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5026005876084c45822f5bcd4327bb8e'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:14:52.811530 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-e13bfd39-ff90-446b-b330-db3ee0d6ca92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5026005876084c45822f5bcd4327bb8e'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:14:52.826687 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1341/2674] 10.222.0.36 () {58 vars in 1223 bytes} [Fri Jun 24 23:14:52 2022] DELETE /identity/v3/users/5026005876084c45822f5bcd4327bb8e => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 23:14:52.830056 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93601ec1-473b-45aa-b11c-74e44b091ba9 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:14:52.830349 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93601ec1-473b-45aa-b11c-74e44b091ba9 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:14:52.830631 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93601ec1-473b-45aa-b11c-74e44b091ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:14:52.848352 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-93601ec1-473b-45aa-b11c-74e44b091ba9 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 23:14:52.849549 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-93601ec1-473b-45aa-b11c-74e44b091ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:14:52.911163 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1334/2675] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 23:14:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 23:14:52.921563 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13bfd39-ff90-446b-b330-db3ee0d6ca92 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:14:52.923059 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-e13bfd39-ff90-446b-b330-db3ee0d6ca92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:14:52.943791 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:14:52.986765 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13bfd39-ff90-446b-b330-db3ee0d6ca92 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:14:52.990731 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c3870-d537-4ff8-85a3-03ae49d9d3bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:14:52.991419 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c3870-d537-4ff8-85a3-03ae49d9d3bd service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:14:52.991704 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c3870-d537-4ff8-85a3-03ae49d9d3bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:14:52.991978 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c3870-d537-4ff8-85a3-03ae49d9d3bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:14:53.001462 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7c3870-d537-4ff8-85a3-03ae49d9d3bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:14:53.002909 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7c3870-d537-4ff8-85a3-03ae49d9d3bd service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:14:53.012737 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1342/2676] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:14:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:14:53.289281 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93601ec1-473b-45aa-b11c-74e44b091ba9 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:14:53.290880 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-93601ec1-473b-45aa-b11c-74e44b091ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:14:53.304611 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93601ec1-473b-45aa-b11c-74e44b091ba9 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:14:53.315002 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d138679-a6a3-44f8-ab14-4f8e0e1928ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:14:53.315928 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d138679-a6a3-44f8-ab14-4f8e0e1928ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:14:53.316272 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d138679-a6a3-44f8-ab14-4f8e0e1928ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:14:53.317212 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d138679-a6a3-44f8-ab14-4f8e0e1928ae admin admin] PATH_INFO: `/v3/projects/593f86ad2c3542678cb7fe15056c3280` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:14:53.318537 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d138679-a6a3-44f8-ab14-4f8e0e1928ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=593f86ad2c3542678cb7fe15056c3280)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:14:53.320515 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d138679-a6a3-44f8-ab14-4f8e0e1928ae admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:14:53.370063 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-7d138679-a6a3-44f8-ab14-4f8e0e1928ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '593f86ad2c3542678cb7fe15056c3280', 'request_id': 'req-7d138679-a6a3-44f8-ab14-4f8e0e1928ae'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:14:53.376435 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-7d138679-a6a3-44f8-ab14-4f8e0e1928ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '593f86ad2c3542678cb7fe15056c3280', 'request_id': 'req-7d138679-a6a3-44f8-ab14-4f8e0e1928ae'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:14:53.385859 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-7d138679-a6a3-44f8-ab14-4f8e0e1928ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '593f86ad2c3542678cb7fe15056c3280', 'request_id': 'req-7d138679-a6a3-44f8-ab14-4f8e0e1928ae'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:14:53.387167 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:14:53.399142 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-7d138679-a6a3-44f8-ab14-4f8e0e1928ae admin admin] The token cache is being invalidate because project 593f86ad2c3542678cb7fe15056c3280 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 23:14:53.399761 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-7d138679-a6a3-44f8-ab14-4f8e0e1928ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:14:53.400755 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-7d138679-a6a3-44f8-ab14-4f8e0e1928ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:14:53.402681 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1335/2677] 10.222.0.36 () {58 vars in 1232 bytes} [Fri Jun 24 23:14:53 2022] DELETE /identity/v3/projects/593f86ad2c3542678cb7fe15056c3280 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 23:14:53.406430 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c3870-d537-4ff8-85a3-03ae49d9d3bd service neutron] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:14:53.416705 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c3870-d537-4ff8-85a3-03ae49d9d3bd service neutron] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:14:53.473081 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9ff06f-5384-4f76-87be-09d50b8f8e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:14:53.473967 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ff06f-5384-4f76-87be-09d50b8f8e0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:14:53.474243 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ff06f-5384-4f76-87be-09d50b8f8e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:14:53.474513 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ff06f-5384-4f76-87be-09d50b8f8e0b admin admin] PATH_INFO: `/v3/users/e81190d9eed144a3974c0508421281b3` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:14:53.475759 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9ff06f-5384-4f76-87be-09d50b8f8e0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e81190d9eed144a3974c0508421281b3)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:14:53.477715 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9ff06f-5384-4f76-87be-09d50b8f8e0b admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:14:53.527314 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-bb9ff06f-5384-4f76-87be-09d50b8f8e0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e81190d9eed144a3974c0508421281b3'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:14:53.534349 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-bb9ff06f-5384-4f76-87be-09d50b8f8e0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e81190d9eed144a3974c0508421281b3'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:14:53.535097 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-bb9ff06f-5384-4f76-87be-09d50b8f8e0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e81190d9eed144a3974c0508421281b3'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:14:53.535875 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-bb9ff06f-5384-4f76-87be-09d50b8f8e0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e81190d9eed144a3974c0508421281b3'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:14:53.548461 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-bb9ff06f-5384-4f76-87be-09d50b8f8e0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e81190d9eed144a3974c0508421281b3'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:14:53.564555 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1343/2678] 10.222.0.36 () {58 vars in 1223 bytes} [Fri Jun 24 23:14:53 2022] DELETE /identity/v3/users/e81190d9eed144a3974c0508421281b3 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 23:14:53.856870 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d138679-a6a3-44f8-ab14-4f8e0e1928ae admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:14:53.858487 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-7d138679-a6a3-44f8-ab14-4f8e0e1928ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:14:53.874786 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d138679-a6a3-44f8-ab14-4f8e0e1928ae admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:14:53.935092 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a55860b-5004-478f-a9d7-1107e984c812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:14:53.935991 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a55860b-5004-478f-a9d7-1107e984c812 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:14:53.936271 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a55860b-5004-478f-a9d7-1107e984c812 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:14:53.936547 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a55860b-5004-478f-a9d7-1107e984c812 admin admin] PATH_INFO: `/v3/projects/57df6d6e619640c2831bcfefa71495a2` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:14:53.937799 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a55860b-5004-478f-a9d7-1107e984c812 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57df6d6e619640c2831bcfefa71495a2)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:14:53.939775 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a55860b-5004-478f-a9d7-1107e984c812 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:14:53.991526 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-5a55860b-5004-478f-a9d7-1107e984c812 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57df6d6e619640c2831bcfefa71495a2', 'request_id': 'req-5a55860b-5004-478f-a9d7-1107e984c812'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:14:54.002245 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-5a55860b-5004-478f-a9d7-1107e984c812 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57df6d6e619640c2831bcfefa71495a2', 'request_id': 'req-5a55860b-5004-478f-a9d7-1107e984c812'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:14:54.011767 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-5a55860b-5004-478f-a9d7-1107e984c812 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57df6d6e619640c2831bcfefa71495a2', 'request_id': 'req-5a55860b-5004-478f-a9d7-1107e984c812'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:14:54.028318 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-5a55860b-5004-478f-a9d7-1107e984c812 admin admin] The token cache is being invalidate because project 57df6d6e619640c2831bcfefa71495a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 23:14:54.028619 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-5a55860b-5004-478f-a9d7-1107e984c812 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:14:54.029543 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-5a55860b-5004-478f-a9d7-1107e984c812 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:14:54.031604 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1336/2679] 10.222.0.36 () {58 vars in 1232 bytes} [Fri Jun 24 23:14:53 2022] DELETE /identity/v3/projects/57df6d6e619640c2831bcfefa71495a2 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 23:14:54.037379 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313b1ed3-8596-4b1f-9a81-26d06e7cb548 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:14:54.037883 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313b1ed3-8596-4b1f-9a81-26d06e7cb548 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:14:54.037980 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313b1ed3-8596-4b1f-9a81-26d06e7cb548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:14:54.058607 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-313b1ed3-8596-4b1f-9a81-26d06e7cb548 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 23:14:54.060536 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-313b1ed3-8596-4b1f-9a81-26d06e7cb548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:14:54.103650 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:14:54.131722 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1344/2680] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 23:14:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 23:14:54.139533 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4208d4e7-a9f9-43ee-937d-3064b5398caa None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:14:54.139825 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4208d4e7-a9f9-43ee-937d-3064b5398caa None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:14:54.140099 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4208d4e7-a9f9-43ee-937d-3064b5398caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:14:54.159328 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-4208d4e7-a9f9-43ee-937d-3064b5398caa None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 23:14:54.160798 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-4208d4e7-a9f9-43ee-937d-3064b5398caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:14:54.170276 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1337/2681] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 23:14:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 23:14:54.174529 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313b1ed3-8596-4b1f-9a81-26d06e7cb548 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:14:54.184801 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313b1ed3-8596-4b1f-9a81-26d06e7cb548 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:14:54.190747 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21968ea8-5442-430a-9e76-f04c919c908c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:14:54.191500 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21968ea8-5442-430a-9e76-f04c919c908c admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:14:54.191854 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21968ea8-5442-430a-9e76-f04c919c908c admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:14:54.192133 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21968ea8-5442-430a-9e76-f04c919c908c admin admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:14:54.192863 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21968ea8-5442-430a-9e76-f04c919c908c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 23:14:54.193154 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21968ea8-5442-430a-9e76-f04c919c908c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:14:54.194804 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21968ea8-5442-430a-9e76-f04c919c908c admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:14:54.207766 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1345/2682] 10.222.0.36 () {58 vars in 1152 bytes} [Fri Jun 24 23:14:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 23:14:54.212230 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4208d4e7-a9f9-43ee-937d-3064b5398caa None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:14:54.222066 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4208d4e7-a9f9-43ee-937d-3064b5398caa None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:14:54.228143 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd5883d-2718-462e-963f-b8240a9ca39e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:14:54.228790 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd5883d-2718-462e-963f-b8240a9ca39e admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:14:54.229072 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd5883d-2718-462e-963f-b8240a9ca39e admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:14:54.229349 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd5883d-2718-462e-963f-b8240a9ca39e admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:14:54.230049 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd5883d-2718-462e-963f-b8240a9ca39e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:14:54.232046 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd5883d-2718-462e-963f-b8240a9ca39e admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:14:54.263173 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1338/2683] 10.222.0.36 () {60 vars in 1152 bytes} [Fri Jun 24 23:14:54 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 23:14:54.265455 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21968ea8-5442-430a-9e76-f04c919c908c admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:14:54.277467 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21968ea8-5442-430a-9e76-f04c919c908c admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:14:54.339338 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3ade0e-e76d-4140-9713-c5640321846f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:14:54.339960 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3ade0e-e76d-4140-9713-c5640321846f admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:14:54.340245 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3ade0e-e76d-4140-9713-c5640321846f admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:14:54.340521 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3ade0e-e76d-4140-9713-c5640321846f admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:14:54.341218 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3ade0e-e76d-4140-9713-c5640321846f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:14:54.343192 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3ade0e-e76d-4140-9713-c5640321846f admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:14:54.367518 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1346/2684] 10.222.0.36 () {60 vars in 1143 bytes} [Fri Jun 24 23:14:54 2022] POST /identity/v3/users => generated 287 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 23:14:54.371855 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd5883d-2718-462e-963f-b8240a9ca39e admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:14:54.382464 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd5883d-2718-462e-963f-b8240a9ca39e admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:14:54.387528 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddba99b-1c8c-496d-a5e6-f6905e97111a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:14:54.388183 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddba99b-1c8c-496d-a5e6-f6905e97111a admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:14:54.388464 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddba99b-1c8c-496d-a5e6-f6905e97111a admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:14:54.388741 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddba99b-1c8c-496d-a5e6-f6905e97111a admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:14:54.389469 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddba99b-1c8c-496d-a5e6-f6905e97111a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:14:54.391081 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddba99b-1c8c-496d-a5e6-f6905e97111a admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:14:54.401760 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1339/2685] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 23:14:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 23:14:54.406233 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3ade0e-e76d-4140-9713-c5640321846f admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:14:54.418830 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3ade0e-e76d-4140-9713-c5640321846f admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:14:54.424446 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4487fa-13ec-4e30-8abe-13754d9e8ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:14:54.425239 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4487fa-13ec-4e30-8abe-13754d9e8ba2 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:14:54.425397 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4487fa-13ec-4e30-8abe-13754d9e8ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:14:54.425672 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4487fa-13ec-4e30-8abe-13754d9e8ba2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:14:54.426544 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4487fa-13ec-4e30-8abe-13754d9e8ba2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:14:54.428225 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4487fa-13ec-4e30-8abe-13754d9e8ba2 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:14:54.442001 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1347/2686] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 23:14:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 23:14:54.443445 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddba99b-1c8c-496d-a5e6-f6905e97111a admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:14:54.453520 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddba99b-1c8c-496d-a5e6-f6905e97111a admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:14:54.458627 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baff39a-eacb-4e72-aea3-71dedc0ef744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:14:54.459631 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baff39a-eacb-4e72-aea3-71dedc0ef744 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:14:54.459970 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baff39a-eacb-4e72-aea3-71dedc0ef744 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:14:54.460304 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baff39a-eacb-4e72-aea3-71dedc0ef744 admin admin] PATH_INFO: `/v3/projects/b0d2441aa25d49af890230b9bf3673b9/users/ffcc3203f15842608ac254e9a521453e/roles/1928787bfcc745419829cd315900ac44` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:14:54.475536 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baff39a-eacb-4e72-aea3-71dedc0ef744 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0d2441aa25d49af890230b9bf3673b9, user_id=ffcc3203f15842608ac254e9a521453e, role_id=1928787bfcc745419829cd315900ac44)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:14:54.478234 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baff39a-eacb-4e72-aea3-71dedc0ef744 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:14:54.495035 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1340/2687] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 23:14:54 2022] PUT /identity/v3/projects/b0d2441aa25d49af890230b9bf3673b9/users/ffcc3203f15842608ac254e9a521453e/roles/1928787bfcc745419829cd315900ac44 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 23:14:54.500441 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1e6c93-6b77-4753-bd94-f229938f12ba None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:14:54.500839 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1e6c93-6b77-4753-bd94-f229938f12ba None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:14:54.501182 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1e6c93-6b77-4753-bd94-f229938f12ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:14:54.519681 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-fa1e6c93-6b77-4753-bd94-f229938f12ba None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 23:14:54.521044 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-fa1e6c93-6b77-4753-bd94-f229938f12ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:14:54.580920 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1348/2688] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 23:14:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 23:14:54.590841 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baff39a-eacb-4e72-aea3-71dedc0ef744 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:14:54.592513 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-2baff39a-eacb-4e72-aea3-71dedc0ef744 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:14:54.611040 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:DELETE=9,keystone:SELECT=88,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:14:54.653910 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baff39a-eacb-4e72-aea3-71dedc0ef744 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:14:54.657619 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36b28b6-2df0-404a-a290-cea8ecb83b8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:14:54.658262 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36b28b6-2df0-404a-a290-cea8ecb83b8b service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:14:54.658547 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36b28b6-2df0-404a-a290-cea8ecb83b8b service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:14:54.658821 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36b28b6-2df0-404a-a290-cea8ecb83b8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:14:54.668065 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36b28b6-2df0-404a-a290-cea8ecb83b8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:14:54.669514 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36b28b6-2df0-404a-a290-cea8ecb83b8b service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:14:54.679054 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1341/2689] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:14:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:14:55.306258 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bee68e-80fc-41ec-9df2-a3a09a059c09 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:14:55.306792 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bee68e-80fc-41ec-9df2-a3a09a059c09 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:14:55.307032 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bee68e-80fc-41ec-9df2-a3a09a059c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:14:55.336120 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-68bee68e-80fc-41ec-9df2-a3a09a059c09 None None] MFA Rules not processed for user `ffcc3203f15842608ac254e9a521453e`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 23:14:55.337609 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-68bee68e-80fc-41ec-9df2-a3a09a059c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:14:55.372863 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:14:55.407623 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1349/2690] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 23:14:55 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 23:14:55.412500 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36b28b6-2df0-404a-a290-cea8ecb83b8b service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:14:55.422962 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36b28b6-2df0-404a-a290-cea8ecb83b8b service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:14:55.427915 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5f5e30-5328-47c2-8c06-5c75f2224a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:14:55.428764 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5f5e30-5328-47c2-8c06-5c75f2224a4e admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:14:55.429217 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5f5e30-5328-47c2-8c06-5c75f2224a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:14:55.429630 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5f5e30-5328-47c2-8c06-5c75f2224a4e admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:14:55.430462 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5f5e30-5328-47c2-8c06-5c75f2224a4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:14:55.432577 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5f5e30-5328-47c2-8c06-5c75f2224a4e admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:14:55.467341 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1342/2691] 10.222.0.36 () {60 vars in 1152 bytes} [Fri Jun 24 23:14:55 2022] POST /identity/v3/projects => generated 371 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 23:14:55.469167 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bee68e-80fc-41ec-9df2-a3a09a059c09 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:14:55.480632 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bee68e-80fc-41ec-9df2-a3a09a059c09 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:14:55.539786 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada1ae5f-86bf-4ed0-99d1-5a3398a5a292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:14:55.540514 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada1ae5f-86bf-4ed0-99d1-5a3398a5a292 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:14:55.540797 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada1ae5f-86bf-4ed0-99d1-5a3398a5a292 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:14:55.541072 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada1ae5f-86bf-4ed0-99d1-5a3398a5a292 admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:14:55.541766 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada1ae5f-86bf-4ed0-99d1-5a3398a5a292 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:14:55.543756 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada1ae5f-86bf-4ed0-99d1-5a3398a5a292 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:14:55.570842 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1350/2692] 10.222.0.36 () {60 vars in 1143 bytes} [Fri Jun 24 23:14:55 2022] POST /identity/v3/users => generated 292 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 23:14:55.572157 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5f5e30-5328-47c2-8c06-5c75f2224a4e admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:14:55.582900 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5f5e30-5328-47c2-8c06-5c75f2224a4e admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:14:55.589849 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7a2821-7f67-4890-a932-b494648ad735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:14:55.590748 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7a2821-7f67-4890-a932-b494648ad735 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:14:55.591181 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7a2821-7f67-4890-a932-b494648ad735 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:14:55.591619 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7a2821-7f67-4890-a932-b494648ad735 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:14:55.592576 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7a2821-7f67-4890-a932-b494648ad735 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:14:55.594624 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7a2821-7f67-4890-a932-b494648ad735 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:14:55.611413 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1343/2693] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 23:14:55 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 23:14:55.612314 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada1ae5f-86bf-4ed0-99d1-5a3398a5a292 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:14:55.624618 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada1ae5f-86bf-4ed0-99d1-5a3398a5a292 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:14:55.629690 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10194912-c81e-4830-bad4-b75192b2e41e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:14:55.630571 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10194912-c81e-4830-bad4-b75192b2e41e admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:14:55.630857 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10194912-c81e-4830-bad4-b75192b2e41e admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:14:55.631129 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10194912-c81e-4830-bad4-b75192b2e41e admin admin] PATH_INFO: `/v3/projects/ef17b5087b344ed5a13ca8404f520385/users/298ef52fc4c94c8b89f0bd04be848331/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:14:55.646365 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10194912-c81e-4830-bad4-b75192b2e41e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef17b5087b344ed5a13ca8404f520385, user_id=298ef52fc4c94c8b89f0bd04be848331, role_id=1a1c43cc97a0407eb7a7c7a1333a9d4a)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:14:55.649180 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10194912-c81e-4830-bad4-b75192b2e41e admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:14:55.663967 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1351/2694] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 23:14:55 2022] PUT /identity/v3/projects/ef17b5087b344ed5a13ca8404f520385/users/298ef52fc4c94c8b89f0bd04be848331/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 23:14:55.668195 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7a2821-7f67-4890-a932-b494648ad735 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:14:55.678676 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7a2821-7f67-4890-a932-b494648ad735 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:14:55.741638 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21133186-f8cd-457c-9ad3-2a587a6f3670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:14:55.742339 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21133186-f8cd-457c-9ad3-2a587a6f3670 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:14:55.742640 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21133186-f8cd-457c-9ad3-2a587a6f3670 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:14:55.742903 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21133186-f8cd-457c-9ad3-2a587a6f3670 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:14:55.743665 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21133186-f8cd-457c-9ad3-2a587a6f3670 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:14:55.745273 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21133186-f8cd-457c-9ad3-2a587a6f3670 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:14:55.758971 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1344/2695] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 23:14:55 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 23:14:55.760372 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10194912-c81e-4830-bad4-b75192b2e41e admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:14:55.770745 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10194912-c81e-4830-bad4-b75192b2e41e admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:14:55.775520 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b2d483-daa2-4022-9bd7-e7de695a8eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:14:55.776568 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b2d483-daa2-4022-9bd7-e7de695a8eae admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:14:55.776847 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b2d483-daa2-4022-9bd7-e7de695a8eae admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:14:55.777114 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b2d483-daa2-4022-9bd7-e7de695a8eae admin admin] PATH_INFO: `/v3/projects/ef17b5087b344ed5a13ca8404f520385/users/298ef52fc4c94c8b89f0bd04be848331/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:14:55.779055 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b2d483-daa2-4022-9bd7-e7de695a8eae admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef17b5087b344ed5a13ca8404f520385, user_id=298ef52fc4c94c8b89f0bd04be848331, role_id=1a1c43cc97a0407eb7a7c7a1333a9d4a)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:14:55.781753 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b2d483-daa2-4022-9bd7-e7de695a8eae admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:14:55.792541 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1352/2696] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 23:14:55 2022] PUT /identity/v3/projects/ef17b5087b344ed5a13ca8404f520385/users/298ef52fc4c94c8b89f0bd04be848331/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 23:14:56.450726 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd3e9d3-99b8-40bf-9d01-c92349fe9336 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:14:56.451293 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd3e9d3-99b8-40bf-9d01-c92349fe9336 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:14:56.451293 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd3e9d3-99b8-40bf-9d01-c92349fe9336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:14:56.480130 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-6bd3e9d3-99b8-40bf-9d01-c92349fe9336 None None] MFA Rules not processed for user `298ef52fc4c94c8b89f0bd04be848331`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 23:14:56.481362 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-6bd3e9d3-99b8-40bf-9d01-c92349fe9336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:14:56.567951 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1345/2697] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 23:14:56 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 23:14:56.581348 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b2d483-daa2-4022-9bd7-e7de695a8eae admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:14:56.583524 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-44b2d483-daa2-4022-9bd7-e7de695a8eae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:14:56.663455 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b2d483-daa2-4022-9bd7-e7de695a8eae admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:14:56.667048 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b8ff4e-27c3-4c1b-b780-57c82f9dc557 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a747e2a5684843a6ee9e3480badac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:14:56.667744 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b8ff4e-27c3-4c1b-b780-57c82f9dc557 service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:14:56.668025 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b8ff4e-27c3-4c1b-b780-57c82f9dc557 service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:14:56.668299 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b8ff4e-27c3-4c1b-b780-57c82f9dc557 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:14:56.712778 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:14:56.730822 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b8ff4e-27c3-4c1b-b780-57c82f9dc557 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:14:56.732323 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b8ff4e-27c3-4c1b-b780-57c82f9dc557 service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:14:56.743606 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1353/2698] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:14:56 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:14:58.099438 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd3e9d3-99b8-40bf-9d01-c92349fe9336 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:14:58.101030 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-6bd3e9d3-99b8-40bf-9d01-c92349fe9336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:14:58.113679 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd3e9d3-99b8-40bf-9d01-c92349fe9336 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:14:58.117533 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a67fbd-daa9-480a-8b55-48bd3ae166a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a747e2a5684843a6ee9e3480badac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:14:58.118170 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a67fbd-daa9-480a-8b55-48bd3ae166a5 service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:14:58.118450 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a67fbd-daa9-480a-8b55-48bd3ae166a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:14:58.118722 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a67fbd-daa9-480a-8b55-48bd3ae166a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:14:58.124626 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:14:58.129965 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a67fbd-daa9-480a-8b55-48bd3ae166a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:14:58.131961 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a67fbd-daa9-480a-8b55-48bd3ae166a5 service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:14:58.142500 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1346/2699] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:14:58 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:14:58.539357 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b8ff4e-27c3-4c1b-b780-57c82f9dc557 service cinder] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:14:58.541022 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-b0b8ff4e-27c3-4c1b-b780-57c82f9dc557 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:14:58.602689 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b8ff4e-27c3-4c1b-b780-57c82f9dc557 service cinder] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:14:58.607364 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129f2671-5c6b-4ab5-96fe-590a604d0ad8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:14:58.608013 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f2671-5c6b-4ab5-96fe-590a604d0ad8 service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:14:58.608420 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f2671-5c6b-4ab5-96fe-590a604d0ad8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:14:58.608853 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f2671-5c6b-4ab5-96fe-590a604d0ad8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:14:58.611009 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-129f2671-5c6b-4ab5-96fe-590a604d0ad8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:14:58.675851 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129f2671-5c6b-4ab5-96fe-590a604d0ad8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:14:58.677310 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129f2671-5c6b-4ab5-96fe-590a604d0ad8 service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:14:58.687167 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1354/2700] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:14:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:14:59.212812 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a67fbd-daa9-480a-8b55-48bd3ae166a5 service cinder] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:14:59.214304 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-31a67fbd-daa9-480a-8b55-48bd3ae166a5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:14:59.229129 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a67fbd-daa9-480a-8b55-48bd3ae166a5 service cinder] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:14:59.234111 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44603a4-7a73-4103-b6a0-050246d34493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:14:59.234991 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44603a4-7a73-4103-b6a0-050246d34493 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:14:59.235304 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44603a4-7a73-4103-b6a0-050246d34493 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:14:59.235582 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44603a4-7a73-4103-b6a0-050246d34493 admin admin] PATH_INFO: `/v3/users/2fae81647c0e444caaee81e81675381b` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:14:59.236879 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44603a4-7a73-4103-b6a0-050246d34493 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fae81647c0e444caaee81e81675381b)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:14:59.239145 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44603a4-7a73-4103-b6a0-050246d34493 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:14:59.291377 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e44603a4-7a73-4103-b6a0-050246d34493 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fae81647c0e444caaee81e81675381b'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:14:59.298550 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e44603a4-7a73-4103-b6a0-050246d34493 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fae81647c0e444caaee81e81675381b'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:14:59.299380 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e44603a4-7a73-4103-b6a0-050246d34493 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fae81647c0e444caaee81e81675381b'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:14:59.300045 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e44603a4-7a73-4103-b6a0-050246d34493 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fae81647c0e444caaee81e81675381b'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:14:59.312207 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e44603a4-7a73-4103-b6a0-050246d34493 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fae81647c0e444caaee81e81675381b'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:14:59.326829 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1347/2701] 10.222.0.36 () {58 vars in 1223 bytes} [Fri Jun 24 23:14:59 2022] DELETE /identity/v3/users/2fae81647c0e444caaee81e81675381b => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 23:14:59.505918 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129f2671-5c6b-4ab5-96fe-590a604d0ad8 service neutron] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:14:59.516497 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129f2671-5c6b-4ab5-96fe-590a604d0ad8 service neutron] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:14:59.579524 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a505f07f-93c2-4e4a-b0f1-6b78ca6ccf53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:14:59.581386 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a505f07f-93c2-4e4a-b0f1-6b78ca6ccf53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:14:59.582725 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a505f07f-93c2-4e4a-b0f1-6b78ca6ccf53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:14:59.583012 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a505f07f-93c2-4e4a-b0f1-6b78ca6ccf53 admin admin] PATH_INFO: `/v3/projects/bc10e8eab96e44daa0f2f3f71ef658f7` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:14:59.584753 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a505f07f-93c2-4e4a-b0f1-6b78ca6ccf53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc10e8eab96e44daa0f2f3f71ef658f7)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:14:59.588627 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a505f07f-93c2-4e4a-b0f1-6b78ca6ccf53 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:14:59.633453 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:14:59.647110 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-a505f07f-93c2-4e4a-b0f1-6b78ca6ccf53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc10e8eab96e44daa0f2f3f71ef658f7', 'request_id': 'req-a505f07f-93c2-4e4a-b0f1-6b78ca6ccf53'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:14:59.653852 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-a505f07f-93c2-4e4a-b0f1-6b78ca6ccf53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc10e8eab96e44daa0f2f3f71ef658f7', 'request_id': 'req-a505f07f-93c2-4e4a-b0f1-6b78ca6ccf53'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:14:59.663506 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-a505f07f-93c2-4e4a-b0f1-6b78ca6ccf53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc10e8eab96e44daa0f2f3f71ef658f7', 'request_id': 'req-a505f07f-93c2-4e4a-b0f1-6b78ca6ccf53'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:14:59.676976 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-a505f07f-93c2-4e4a-b0f1-6b78ca6ccf53 admin admin] The token cache is being invalidate because project bc10e8eab96e44daa0f2f3f71ef658f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 23:14:59.677512 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-a505f07f-93c2-4e4a-b0f1-6b78ca6ccf53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:14:59.678246 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-a505f07f-93c2-4e4a-b0f1-6b78ca6ccf53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:14:59.679941 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1355/2702] 10.222.0.36 () {58 vars in 1232 bytes} [Fri Jun 24 23:14:59 2022] DELETE /identity/v3/projects/bc10e8eab96e44daa0f2f3f71ef658f7 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 23:15:09.323506 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=32,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:15:09.673023 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:DELETE=5,keystone:SELECT=11,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:15:10.836188 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44603a4-7a73-4103-b6a0-050246d34493 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:15:10.837810 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-e44603a4-7a73-4103-b6a0-050246d34493 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:15:10.912529 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44603a4-7a73-4103-b6a0-050246d34493 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:15:10.988998 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a0a47f-77e4-47d7-ae1c-e30dd4922e46 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0233b357708643be94c0ade17ac1fb3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:15:10.989681 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a0a47f-77e4-47d7-ae1c-e30dd4922e46 service placement] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:15:10.989973 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a0a47f-77e4-47d7-ae1c-e30dd4922e46 service placement] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:15:10.990242 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a0a47f-77e4-47d7-ae1c-e30dd4922e46 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:15:10.992255 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-27a0a47f-77e4-47d7-ae1c-e30dd4922e46 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:15:11.004492 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a0a47f-77e4-47d7-ae1c-e30dd4922e46 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:15:11.006078 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a0a47f-77e4-47d7-ae1c-e30dd4922e46 service placement] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:15:11.018850 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1348/2703] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:15:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:15:11.416699 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a505f07f-93c2-4e4a-b0f1-6b78ca6ccf53 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:15:11.418185 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-a505f07f-93c2-4e4a-b0f1-6b78ca6ccf53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:15:11.488913 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a505f07f-93c2-4e4a-b0f1-6b78ca6ccf53 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:15:11.493616 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12914d97-210c-42fc-ac38-f386355e4baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:15:11.494527 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12914d97-210c-42fc-ac38-f386355e4baa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:15:11.494811 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12914d97-210c-42fc-ac38-f386355e4baa admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:15:11.495088 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12914d97-210c-42fc-ac38-f386355e4baa admin admin] PATH_INFO: `/v3/users/ffcc3203f15842608ac254e9a521453e` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:15:11.496324 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12914d97-210c-42fc-ac38-f386355e4baa admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffcc3203f15842608ac254e9a521453e)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:15:11.498268 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12914d97-210c-42fc-ac38-f386355e4baa admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:15:11.548859 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-12914d97-210c-42fc-ac38-f386355e4baa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffcc3203f15842608ac254e9a521453e'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:15:11.556252 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-12914d97-210c-42fc-ac38-f386355e4baa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffcc3203f15842608ac254e9a521453e'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:15:11.556925 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-12914d97-210c-42fc-ac38-f386355e4baa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffcc3203f15842608ac254e9a521453e'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:15:11.557518 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-12914d97-210c-42fc-ac38-f386355e4baa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffcc3203f15842608ac254e9a521453e'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:15:11.569811 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-12914d97-210c-42fc-ac38-f386355e4baa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffcc3203f15842608ac254e9a521453e'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:15:11.584217 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1356/2704] 10.222.0.36 () {58 vars in 1223 bytes} [Fri Jun 24 23:15:11 2022] DELETE /identity/v3/users/ffcc3203f15842608ac254e9a521453e => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 23:15:11.772253 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a0a47f-77e4-47d7-ae1c-e30dd4922e46 service placement] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:15:11.784485 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a0a47f-77e4-47d7-ae1c-e30dd4922e46 service placement] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:15:11.843026 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59474d8-903d-4c34-bb14-4f4a10dc4a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:15:11.843990 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59474d8-903d-4c34-bb14-4f4a10dc4a13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:15:11.844269 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59474d8-903d-4c34-bb14-4f4a10dc4a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:15:11.844543 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59474d8-903d-4c34-bb14-4f4a10dc4a13 admin admin] PATH_INFO: `/v3/projects/b0d2441aa25d49af890230b9bf3673b9` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:15:11.845747 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59474d8-903d-4c34-bb14-4f4a10dc4a13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0d2441aa25d49af890230b9bf3673b9)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:15:11.848121 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59474d8-903d-4c34-bb14-4f4a10dc4a13 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:15:11.887031 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:15:11.898492 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-a59474d8-903d-4c34-bb14-4f4a10dc4a13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0d2441aa25d49af890230b9bf3673b9', 'request_id': 'req-a59474d8-903d-4c34-bb14-4f4a10dc4a13'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:15:11.905032 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-a59474d8-903d-4c34-bb14-4f4a10dc4a13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0d2441aa25d49af890230b9bf3673b9', 'request_id': 'req-a59474d8-903d-4c34-bb14-4f4a10dc4a13'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:15:11.914221 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-a59474d8-903d-4c34-bb14-4f4a10dc4a13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0d2441aa25d49af890230b9bf3673b9', 'request_id': 'req-a59474d8-903d-4c34-bb14-4f4a10dc4a13'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:15:11.925775 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-a59474d8-903d-4c34-bb14-4f4a10dc4a13 admin admin] The token cache is being invalidate because project b0d2441aa25d49af890230b9bf3673b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 23:15:11.926068 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-a59474d8-903d-4c34-bb14-4f4a10dc4a13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:15:11.926722 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-a59474d8-903d-4c34-bb14-4f4a10dc4a13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:15:11.928341 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1349/2705] 10.222.0.36 () {58 vars in 1232 bytes} [Fri Jun 24 23:15:11 2022] DELETE /identity/v3/projects/b0d2441aa25d49af890230b9bf3673b9 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 23:15:11.932524 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12914d97-210c-42fc-ac38-f386355e4baa admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:15:11.933981 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-12914d97-210c-42fc-ac38-f386355e4baa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:15:11.947576 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12914d97-210c-42fc-ac38-f386355e4baa admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:15:12.006965 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbf881e-7ced-402a-a0c0-cf45dff151c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:15:12.007866 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbf881e-7ced-402a-a0c0-cf45dff151c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:15:12.008172 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbf881e-7ced-402a-a0c0-cf45dff151c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:15:12.008444 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbf881e-7ced-402a-a0c0-cf45dff151c0 admin admin] PATH_INFO: `/v3/users/298ef52fc4c94c8b89f0bd04be848331` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:15:12.009733 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbf881e-7ced-402a-a0c0-cf45dff151c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=298ef52fc4c94c8b89f0bd04be848331)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:15:12.011700 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbf881e-7ced-402a-a0c0-cf45dff151c0 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:15:12.035957 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:15:12.064038 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-dcbf881e-7ced-402a-a0c0-cf45dff151c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '298ef52fc4c94c8b89f0bd04be848331'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:15:12.071569 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-dcbf881e-7ced-402a-a0c0-cf45dff151c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '298ef52fc4c94c8b89f0bd04be848331'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:15:12.072339 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-dcbf881e-7ced-402a-a0c0-cf45dff151c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '298ef52fc4c94c8b89f0bd04be848331'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:15:12.073001 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-dcbf881e-7ced-402a-a0c0-cf45dff151c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '298ef52fc4c94c8b89f0bd04be848331'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:15:12.086588 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-dcbf881e-7ced-402a-a0c0-cf45dff151c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '298ef52fc4c94c8b89f0bd04be848331'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:15:12.100767 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1357/2706] 10.222.0.36 () {58 vars in 1223 bytes} [Fri Jun 24 23:15:11 2022] DELETE /identity/v3/users/298ef52fc4c94c8b89f0bd04be848331 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 23:15:12.280859 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59474d8-903d-4c34-bb14-4f4a10dc4a13 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:15:12.282348 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-a59474d8-903d-4c34-bb14-4f4a10dc4a13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:15:12.296882 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59474d8-903d-4c34-bb14-4f4a10dc4a13 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:15:12.355953 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adbde61-ce4d-483e-8466-187e5c80ca35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:15:12.356818 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adbde61-ce4d-483e-8466-187e5c80ca35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:15:12.357097 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adbde61-ce4d-483e-8466-187e5c80ca35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:15:12.357372 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adbde61-ce4d-483e-8466-187e5c80ca35 admin admin] PATH_INFO: `/v3/projects/ef17b5087b344ed5a13ca8404f520385` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:15:12.358578 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adbde61-ce4d-483e-8466-187e5c80ca35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef17b5087b344ed5a13ca8404f520385)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:15:12.360564 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adbde61-ce4d-483e-8466-187e5c80ca35 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:15:12.415002 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-6adbde61-ce4d-483e-8466-187e5c80ca35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef17b5087b344ed5a13ca8404f520385', 'request_id': 'req-6adbde61-ce4d-483e-8466-187e5c80ca35'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:15:12.421144 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-6adbde61-ce4d-483e-8466-187e5c80ca35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef17b5087b344ed5a13ca8404f520385', 'request_id': 'req-6adbde61-ce4d-483e-8466-187e5c80ca35'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:15:12.430090 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-6adbde61-ce4d-483e-8466-187e5c80ca35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef17b5087b344ed5a13ca8404f520385', 'request_id': 'req-6adbde61-ce4d-483e-8466-187e5c80ca35'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:15:12.442376 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-6adbde61-ce4d-483e-8466-187e5c80ca35 admin admin] The token cache is being invalidate because project ef17b5087b344ed5a13ca8404f520385 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 23:15:12.442685 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-6adbde61-ce4d-483e-8466-187e5c80ca35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:15:12.443350 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-6adbde61-ce4d-483e-8466-187e5c80ca35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:15:12.444962 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1350/2707] 10.222.0.36 () {58 vars in 1232 bytes} [Fri Jun 24 23:15:12 2022] DELETE /identity/v3/projects/ef17b5087b344ed5a13ca8404f520385 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 23:15:12.449939 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e907e0d-dfc5-44ee-934d-f2372bb6c974 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:15:12.450388 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e907e0d-dfc5-44ee-934d-f2372bb6c974 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:15:12.450494 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e907e0d-dfc5-44ee-934d-f2372bb6c974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:15:12.469212 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-5e907e0d-dfc5-44ee-934d-f2372bb6c974 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 23:15:12.470410 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-5e907e0d-dfc5-44ee-934d-f2372bb6c974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:15:12.533872 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1358/2708] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 23:15:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 23:15:12.543702 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8facb5a0-33f3-42c5-bed4-bca96b67c83f None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:15:12.544001 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8facb5a0-33f3-42c5-bed4-bca96b67c83f None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:15:12.544256 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8facb5a0-33f3-42c5-bed4-bca96b67c83f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:15:12.563655 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-8facb5a0-33f3-42c5-bed4-bca96b67c83f None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 23:15:12.564882 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-8facb5a0-33f3-42c5-bed4-bca96b67c83f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:15:12.578622 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1351/2709] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 23:15:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 23:15:12.583132 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e907e0d-dfc5-44ee-934d-f2372bb6c974 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:15:12.593625 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e907e0d-dfc5-44ee-934d-f2372bb6c974 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:15:12.599515 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7722b3-a902-4a47-8da9-5cf63deb350d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:15:12.600177 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7722b3-a902-4a47-8da9-5cf63deb350d admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:15:12.600462 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7722b3-a902-4a47-8da9-5cf63deb350d admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:15:12.600738 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7722b3-a902-4a47-8da9-5cf63deb350d admin admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:15:12.601448 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7722b3-a902-4a47-8da9-5cf63deb350d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 23:15:12.601778 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7722b3-a902-4a47-8da9-5cf63deb350d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:15:12.603435 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7722b3-a902-4a47-8da9-5cf63deb350d admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:15:12.617388 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1359/2710] 10.222.0.36 () {58 vars in 1152 bytes} [Fri Jun 24 23:15:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 23:15:12.621928 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8facb5a0-33f3-42c5-bed4-bca96b67c83f None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:15:12.632124 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8facb5a0-33f3-42c5-bed4-bca96b67c83f None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:15:12.638732 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad6b6c7-1178-4700-937e-72ed51802e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:15:12.639422 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad6b6c7-1178-4700-937e-72ed51802e42 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:15:12.639708 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad6b6c7-1178-4700-937e-72ed51802e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:15:12.639982 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad6b6c7-1178-4700-937e-72ed51802e42 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:15:12.640676 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad6b6c7-1178-4700-937e-72ed51802e42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:15:12.642597 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad6b6c7-1178-4700-937e-72ed51802e42 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:15:12.671758 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1352/2711] 10.222.0.36 () {60 vars in 1152 bytes} [Fri Jun 24 23:15:12 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 23:15:12.676105 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7722b3-a902-4a47-8da9-5cf63deb350d admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:15:12.686886 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7722b3-a902-4a47-8da9-5cf63deb350d admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:15:12.746055 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d5b7dc-3644-40a2-a8b5-55db6e6af466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:15:12.746705 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d5b7dc-3644-40a2-a8b5-55db6e6af466 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:15:12.746986 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d5b7dc-3644-40a2-a8b5-55db6e6af466 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:15:12.747291 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d5b7dc-3644-40a2-a8b5-55db6e6af466 admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:15:12.747953 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d5b7dc-3644-40a2-a8b5-55db6e6af466 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:15:12.749878 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d5b7dc-3644-40a2-a8b5-55db6e6af466 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:15:12.771541 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1360/2712] 10.222.0.36 () {60 vars in 1143 bytes} [Fri Jun 24 23:15:12 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 23:15:12.775934 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad6b6c7-1178-4700-937e-72ed51802e42 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:15:12.786375 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad6b6c7-1178-4700-937e-72ed51802e42 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:15:12.791598 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a88521-8397-49c2-a84d-41993c3285e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:15:12.792282 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a88521-8397-49c2-a84d-41993c3285e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:15:12.792560 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a88521-8397-49c2-a84d-41993c3285e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:15:12.792832 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a88521-8397-49c2-a84d-41993c3285e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:15:12.793547 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a88521-8397-49c2-a84d-41993c3285e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:15:12.795144 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a88521-8397-49c2-a84d-41993c3285e5 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:15:12.805889 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1353/2713] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 23:15:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 23:15:12.809994 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d5b7dc-3644-40a2-a8b5-55db6e6af466 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:15:12.820429 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d5b7dc-3644-40a2-a8b5-55db6e6af466 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:15:12.825501 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0e4236-c9a9-438f-8dfb-065d2bfad460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:15:12.826138 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0e4236-c9a9-438f-8dfb-065d2bfad460 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:15:12.826421 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0e4236-c9a9-438f-8dfb-065d2bfad460 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:15:12.826708 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0e4236-c9a9-438f-8dfb-065d2bfad460 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:15:12.827451 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0e4236-c9a9-438f-8dfb-065d2bfad460 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:15:12.829054 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0e4236-c9a9-438f-8dfb-065d2bfad460 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:15:12.839037 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1361/2714] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 23:15:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 23:15:12.843219 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a88521-8397-49c2-a84d-41993c3285e5 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:15:12.853771 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a88521-8397-49c2-a84d-41993c3285e5 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:15:12.858750 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922f70d1-c0aa-4826-b686-18f42fc2d930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:15:12.859656 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922f70d1-c0aa-4826-b686-18f42fc2d930 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:15:12.859956 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922f70d1-c0aa-4826-b686-18f42fc2d930 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:15:12.860265 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922f70d1-c0aa-4826-b686-18f42fc2d930 admin admin] PATH_INFO: `/v3/projects/e6edefdfdb984ccea657cdb83c9e3abf/users/90e1510156e442139483c727daf08f36/roles/1928787bfcc745419829cd315900ac44` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:15:12.871843 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:15:12.875827 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922f70d1-c0aa-4826-b686-18f42fc2d930 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6edefdfdb984ccea657cdb83c9e3abf, user_id=90e1510156e442139483c727daf08f36, role_id=1928787bfcc745419829cd315900ac44)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:15:12.879272 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922f70d1-c0aa-4826-b686-18f42fc2d930 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:15:12.894928 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1354/2715] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 23:15:12 2022] PUT /identity/v3/projects/e6edefdfdb984ccea657cdb83c9e3abf/users/90e1510156e442139483c727daf08f36/roles/1928787bfcc745419829cd315900ac44 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 23:15:12.905322 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77512e1-41d7-4f97-ae31-b70ed2e7d766 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:15:12.905665 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77512e1-41d7-4f97-ae31-b70ed2e7d766 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:15:12.905935 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77512e1-41d7-4f97-ae31-b70ed2e7d766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:15:12.913383 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:15:12.934682 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-f77512e1-41d7-4f97-ae31-b70ed2e7d766 None None] MFA Rules not processed for user `90e1510156e442139483c727daf08f36`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 23:15:12.935939 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-f77512e1-41d7-4f97-ae31-b70ed2e7d766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:15:13.001835 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1362/2716] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 23:15:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 23:15:13.013062 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922f70d1-c0aa-4826-b686-18f42fc2d930 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:15:13.014896 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-922f70d1-c0aa-4826-b686-18f42fc2d930 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:15:13.078697 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922f70d1-c0aa-4826-b686-18f42fc2d930 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:15:13.082810 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c062a4ce-96e8-49c1-9d96-d3245382cd43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a747e2a5684843a6ee9e3480badac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:15:13.083477 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c062a4ce-96e8-49c1-9d96-d3245382cd43 service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:15:13.083760 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c062a4ce-96e8-49c1-9d96-d3245382cd43 service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:15:13.084031 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c062a4ce-96e8-49c1-9d96-d3245382cd43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:15:13.093143 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c062a4ce-96e8-49c1-9d96-d3245382cd43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:15:13.094583 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c062a4ce-96e8-49c1-9d96-d3245382cd43 service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:15:13.104276 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1355/2717] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:15:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:15:16.286190 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77512e1-41d7-4f97-ae31-b70ed2e7d766 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:15:16.296914 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77512e1-41d7-4f97-ae31-b70ed2e7d766 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:15:16.301437 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c07db7-d3e1-44a9-be0b-17d1a54bbafc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a747e2a5684843a6ee9e3480badac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:15:16.302078 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c07db7-d3e1-44a9-be0b-17d1a54bbafc service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:15:16.302354 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c07db7-d3e1-44a9-be0b-17d1a54bbafc service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:15:16.302625 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c07db7-d3e1-44a9-be0b-17d1a54bbafc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:15:16.304758 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-e4c07db7-d3e1-44a9-be0b-17d1a54bbafc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:15:16.368389 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c07db7-d3e1-44a9-be0b-17d1a54bbafc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:15:16.369847 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c07db7-d3e1-44a9-be0b-17d1a54bbafc service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:15:16.379141 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1363/2718] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:15:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:15:22.618835 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c062a4ce-96e8-49c1-9d96-d3245382cd43 service cinder] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:15:22.694752 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c062a4ce-96e8-49c1-9d96-d3245382cd43 service cinder] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:15:22.700114 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6267f5-140a-43d9-ba72-21fe61df82f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:15:22.700991 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6267f5-140a-43d9-ba72-21fe61df82f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:15:22.701273 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6267f5-140a-43d9-ba72-21fe61df82f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:15:22.701551 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6267f5-140a-43d9-ba72-21fe61df82f6 admin admin] PATH_INFO: `/v3/users/90e1510156e442139483c727daf08f36` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:15:22.702799 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6267f5-140a-43d9-ba72-21fe61df82f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90e1510156e442139483c727daf08f36)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:15:22.704751 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6267f5-140a-43d9-ba72-21fe61df82f6 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:15:22.761643 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-af6267f5-140a-43d9-ba72-21fe61df82f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90e1510156e442139483c727daf08f36'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:15:22.769895 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-af6267f5-140a-43d9-ba72-21fe61df82f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90e1510156e442139483c727daf08f36'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:15:22.770607 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-af6267f5-140a-43d9-ba72-21fe61df82f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90e1510156e442139483c727daf08f36'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:15:22.771235 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-af6267f5-140a-43d9-ba72-21fe61df82f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90e1510156e442139483c727daf08f36'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:15:22.784510 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-af6267f5-140a-43d9-ba72-21fe61df82f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90e1510156e442139483c727daf08f36'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:15:22.798547 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1356/2719] 10.222.0.36 () {58 vars in 1223 bytes} [Fri Jun 24 23:15:22 2022] DELETE /identity/v3/users/90e1510156e442139483c727daf08f36 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 23:15:22.803388 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86295af4-8476-4514-bf66-ed7fe4f0c1f5 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:15:22.803928 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86295af4-8476-4514-bf66-ed7fe4f0c1f5 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:15:22.803928 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86295af4-8476-4514-bf66-ed7fe4f0c1f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:15:22.821147 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-86295af4-8476-4514-bf66-ed7fe4f0c1f5 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 23:15:22.822377 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-86295af4-8476-4514-bf66-ed7fe4f0c1f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:15:22.881275 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1364/2720] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 23:15:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 23:15:22.891102 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6267f5-140a-43d9-ba72-21fe61df82f6 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:15:22.892602 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-af6267f5-140a-43d9-ba72-21fe61df82f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:15:22.907171 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:15:22.953252 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6267f5-140a-43d9-ba72-21fe61df82f6 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:15:22.957396 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a418c62-a173-424b-a7e0-cf55c61b46c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:15:22.958039 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a418c62-a173-424b-a7e0-cf55c61b46c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:15:22.958314 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a418c62-a173-424b-a7e0-cf55c61b46c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:15:22.958587 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a418c62-a173-424b-a7e0-cf55c61b46c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:15:22.968052 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a418c62-a173-424b-a7e0-cf55c61b46c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:15:22.969488 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a418c62-a173-424b-a7e0-cf55c61b46c5 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:15:22.979767 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1357/2721] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:15:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:15:23.272804 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86295af4-8476-4514-bf66-ed7fe4f0c1f5 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:15:23.274239 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-86295af4-8476-4514-bf66-ed7fe4f0c1f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:15:23.286424 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86295af4-8476-4514-bf66-ed7fe4f0c1f5 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:15:23.291710 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31b6890-a4c1-484c-9e7e-f52f3e5ff645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:15:23.292589 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31b6890-a4c1-484c-9e7e-f52f3e5ff645 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:15:23.292873 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31b6890-a4c1-484c-9e7e-f52f3e5ff645 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:15:23.293158 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31b6890-a4c1-484c-9e7e-f52f3e5ff645 admin admin] PATH_INFO: `/v3/projects/e6edefdfdb984ccea657cdb83c9e3abf` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:15:23.294383 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31b6890-a4c1-484c-9e7e-f52f3e5ff645 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6edefdfdb984ccea657cdb83c9e3abf)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:15:23.296381 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31b6890-a4c1-484c-9e7e-f52f3e5ff645 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:15:23.335397 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:15:23.352151 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-a31b6890-a4c1-484c-9e7e-f52f3e5ff645 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6edefdfdb984ccea657cdb83c9e3abf', 'request_id': 'req-a31b6890-a4c1-484c-9e7e-f52f3e5ff645'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:15:23.358250 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-a31b6890-a4c1-484c-9e7e-f52f3e5ff645 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6edefdfdb984ccea657cdb83c9e3abf', 'request_id': 'req-a31b6890-a4c1-484c-9e7e-f52f3e5ff645'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:15:23.368529 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-a31b6890-a4c1-484c-9e7e-f52f3e5ff645 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6edefdfdb984ccea657cdb83c9e3abf', 'request_id': 'req-a31b6890-a4c1-484c-9e7e-f52f3e5ff645'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:15:23.379519 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-a31b6890-a4c1-484c-9e7e-f52f3e5ff645 admin admin] The token cache is being invalidate because project e6edefdfdb984ccea657cdb83c9e3abf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 23:15:23.379808 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-a31b6890-a4c1-484c-9e7e-f52f3e5ff645 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:15:23.380418 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-a31b6890-a4c1-484c-9e7e-f52f3e5ff645 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:15:23.382020 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1365/2722] 10.222.0.36 () {58 vars in 1232 bytes} [Fri Jun 24 23:15:23 2022] DELETE /identity/v3/projects/e6edefdfdb984ccea657cdb83c9e3abf => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 23:15:32.975227 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=21 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:15:33.376521 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=14,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:16:05.367062 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a418c62-a173-424b-a7e0-cf55c61b46c5 service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:16:05.368703 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-9a418c62-a173-424b-a7e0-cf55c61b46c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:16:05.445688 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a418c62-a173-424b-a7e0-cf55c61b46c5 service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:16:05.521762 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffed24af-bc97-4b08-ae1f-93b050ce81c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214d9071042c4bad886bf060a079b6e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:16:05.522334 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed24af-bc97-4b08-ae1f-93b050ce81c8 service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:16:05.522618 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed24af-bc97-4b08-ae1f-93b050ce81c8 service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:16:05.522896 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed24af-bc97-4b08-ae1f-93b050ce81c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:16:05.524930 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-ffed24af-bc97-4b08-ae1f-93b050ce81c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:16:05.590545 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffed24af-bc97-4b08-ae1f-93b050ce81c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:16:05.592303 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffed24af-bc97-4b08-ae1f-93b050ce81c8 service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:16:05.602071 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1358/2723] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:16:05 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:16:15.598139 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=84 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:16:37.535855 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31b6890-a4c1-484c-9e7e-f52f3e5ff645 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:16:37.537546 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-a31b6890-a4c1-484c-9e7e-f52f3e5ff645 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:16:37.620307 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31b6890-a4c1-484c-9e7e-f52f3e5ff645 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:16:37.624193 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64db9b96-0bce-40c5-b68d-c32cac9997bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:16:37.624847 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db9b96-0bce-40c5-b68d-c32cac9997bc service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:16:37.625128 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db9b96-0bce-40c5-b68d-c32cac9997bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:16:37.625402 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db9b96-0bce-40c5-b68d-c32cac9997bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:16:37.627540 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-64db9b96-0bce-40c5-b68d-c32cac9997bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:16:37.642465 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64db9b96-0bce-40c5-b68d-c32cac9997bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:16:37.644762 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64db9b96-0bce-40c5-b68d-c32cac9997bc service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:16:37.654406 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1366/2724] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:16:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:16:47.650693 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=35 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:17:25.997068 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffed24af-bc97-4b08-ae1f-93b050ce81c8 service nova] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:17:25.998789 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-ffed24af-bc97-4b08-ae1f-93b050ce81c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:17:26.050442 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffed24af-bc97-4b08-ae1f-93b050ce81c8 service nova] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:17:26.056130 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff30c590-3ade-4260-9b2c-afef03f4331b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214d9071042c4bad886bf060a079b6e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:17:26.056802 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff30c590-3ade-4260-9b2c-afef03f4331b service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:17:26.057085 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff30c590-3ade-4260-9b2c-afef03f4331b service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:17:26.057357 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff30c590-3ade-4260-9b2c-afef03f4331b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:17:26.059435 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-ff30c590-3ade-4260-9b2c-afef03f4331b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:17:26.076826 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff30c590-3ade-4260-9b2c-afef03f4331b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:17:26.078475 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff30c590-3ade-4260-9b2c-afef03f4331b service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:17:26.091907 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1359/2725] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:17:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:17:29.328102 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2199ab7c-e303-4f07-beed-6199fdace03c None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:17:29.328661 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2199ab7c-e303-4f07-beed-6199fdace03c None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:17:29.329162 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2199ab7c-e303-4f07-beed-6199fdace03c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:17:29.347893 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-2199ab7c-e303-4f07-beed-6199fdace03c None None] MFA Rules not processed for user `c0e2ea4fb58a478aa5a7c4d9409cfb70`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 23:17:29.349086 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-2199ab7c-e303-4f07-beed-6199fdace03c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:17:29.358293 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1367/2726] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 23:17:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 23:17:29.681975 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff30c590-3ade-4260-9b2c-afef03f4331b service nova] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:17:29.692565 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff30c590-3ade-4260-9b2c-afef03f4331b service nova] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:17:29.696566 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f4ef7d-e9d6-4a7f-8e19-62b33999baa0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:17:29.697205 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f4ef7d-e9d6-4a7f-8e19-62b33999baa0 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:17:29.697481 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f4ef7d-e9d6-4a7f-8e19-62b33999baa0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:17:29.697759 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f4ef7d-e9d6-4a7f-8e19-62b33999baa0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:17:29.700655 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-a6f4ef7d-e9d6-4a7f-8e19-62b33999baa0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:17:29.713542 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f4ef7d-e9d6-4a7f-8e19-62b33999baa0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:17:29.714984 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f4ef7d-e9d6-4a7f-8e19-62b33999baa0 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:17:29.723007 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1360/2727] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:17:29 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:17:30.068182 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2199ab7c-e303-4f07-beed-6199fdace03c None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:17:30.069654 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-2199ab7c-e303-4f07-beed-6199fdace03c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:17:30.155947 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2199ab7c-e303-4f07-beed-6199fdace03c None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:17:30.161317 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e9c0b7-bf9e-4919-a3c1-558196f16f75 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0233b357708643be94c0ade17ac1fb3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:17:30.161963 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e9c0b7-bf9e-4919-a3c1-558196f16f75 service placement] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:17:30.162245 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e9c0b7-bf9e-4919-a3c1-558196f16f75 service placement] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:17:30.163885 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e9c0b7-bf9e-4919-a3c1-558196f16f75 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:17:30.164268 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-c9e9c0b7-bf9e-4919-a3c1-558196f16f75 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:17:30.176683 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e9c0b7-bf9e-4919-a3c1-558196f16f75 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:17:30.178290 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e9c0b7-bf9e-4919-a3c1-558196f16f75 service placement] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:17:30.188530 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1368/2728] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:17:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:17:30.653335 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f4ef7d-e9d6-4a7f-8e19-62b33999baa0 service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:17:30.654889 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-a6f4ef7d-e9d6-4a7f-8e19-62b33999baa0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:17:30.670808 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f4ef7d-e9d6-4a7f-8e19-62b33999baa0 service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:17:30.676615 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b307aacd-0eb8-4502-bd3d-46c254aaec3d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0233b357708643be94c0ade17ac1fb3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:17:30.677265 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b307aacd-0eb8-4502-bd3d-46c254aaec3d service placement] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:17:30.677551 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b307aacd-0eb8-4502-bd3d-46c254aaec3d service placement] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:17:30.677848 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b307aacd-0eb8-4502-bd3d-46c254aaec3d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:17:30.679929 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-b307aacd-0eb8-4502-bd3d-46c254aaec3d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:17:30.692491 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b307aacd-0eb8-4502-bd3d-46c254aaec3d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:17:30.694054 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b307aacd-0eb8-4502-bd3d-46c254aaec3d service placement] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:17:30.704692 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1361/2729] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:17:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:17:38.185499 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e9c0b7-bf9e-4919-a3c1-558196f16f75 service placement] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:17:38.199001 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e9c0b7-bf9e-4919-a3c1-558196f16f75 service placement] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:17:38.204463 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07877440-e01b-427c-847c-538a4c613f86 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214d9071042c4bad886bf060a079b6e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:17:38.205112 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07877440-e01b-427c-847c-538a4c613f86 service nova] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:17:38.205390 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07877440-e01b-427c-847c-538a4c613f86 service nova] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:17:38.205661 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07877440-e01b-427c-847c-538a4c613f86 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:17:38.207485 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-07877440-e01b-427c-847c-538a4c613f86 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:17:38.219730 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07877440-e01b-427c-847c-538a4c613f86 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:17:38.221320 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07877440-e01b-427c-847c-538a4c613f86 service nova] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:17:38.232516 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1369/2730] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:17:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:17:40.700303 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=30 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:17:41.981894 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b307aacd-0eb8-4502-bd3d-46c254aaec3d service placement] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:17:41.983671 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-b307aacd-0eb8-4502-bd3d-46c254aaec3d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:17:42.001076 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b307aacd-0eb8-4502-bd3d-46c254aaec3d service placement] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:17:42.007752 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2459baa9-e427-4e73-9280-e7a1f6a0aec0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214d9071042c4bad886bf060a079b6e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:17:42.008728 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2459baa9-e427-4e73-9280-e7a1f6a0aec0 service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:17:42.009088 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2459baa9-e427-4e73-9280-e7a1f6a0aec0 service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:17:42.009422 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2459baa9-e427-4e73-9280-e7a1f6a0aec0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:17:42.011602 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-2459baa9-e427-4e73-9280-e7a1f6a0aec0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:17:42.025199 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2459baa9-e427-4e73-9280-e7a1f6a0aec0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:17:42.026937 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2459baa9-e427-4e73-9280-e7a1f6a0aec0 service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:17:42.037614 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1362/2731] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:17:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:17:48.228557 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=46 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:17:52.033825 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=6 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:19:18.127227 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07877440-e01b-427c-847c-538a4c613f86 service nova] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:19:18.129000 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-07877440-e01b-427c-847c-538a4c613f86 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:19:18.205190 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07877440-e01b-427c-847c-538a4c613f86 service nova] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:19:18.210521 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3fc19e-363c-4a56-8a95-d0197a5479a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a747e2a5684843a6ee9e3480badac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:19:18.211342 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3fc19e-363c-4a56-8a95-d0197a5479a1 service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:19:18.211628 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3fc19e-363c-4a56-8a95-d0197a5479a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:19:18.211948 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3fc19e-363c-4a56-8a95-d0197a5479a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:19:18.215182 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-3c3fc19e-363c-4a56-8a95-d0197a5479a1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:19:18.236067 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3fc19e-363c-4a56-8a95-d0197a5479a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:19:18.237461 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3fc19e-363c-4a56-8a95-d0197a5479a1 service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:19:18.249112 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1370/2732] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:19:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:19:21.173558 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2459baa9-e427-4e73-9280-e7a1f6a0aec0 service nova] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:19:21.183896 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2459baa9-e427-4e73-9280-e7a1f6a0aec0 service nova] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:19:21.189016 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb8992c-ce9b-4835-b668-541a4b3548a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:19:21.189663 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb8992c-ce9b-4835-b668-541a4b3548a5 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:19:21.189945 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb8992c-ce9b-4835-b668-541a4b3548a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:19:21.190212 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb8992c-ce9b-4835-b668-541a4b3548a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:19:21.192329 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-9fb8992c-ce9b-4835-b668-541a4b3548a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:19:21.206368 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb8992c-ce9b-4835-b668-541a4b3548a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:19:21.207864 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb8992c-ce9b-4835-b668-541a4b3548a5 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:19:21.219033 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1363/2733] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:19:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:19:28.111669 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3fc19e-363c-4a56-8a95-d0197a5479a1 service cinder] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:19:28.113173 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-3c3fc19e-363c-4a56-8a95-d0197a5479a1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:19:28.124734 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3fc19e-363c-4a56-8a95-d0197a5479a1 service cinder] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:19:28.128921 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9013c5eb-a00a-4ebf-8fc0-e63996faf931 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:19:28.129562 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9013c5eb-a00a-4ebf-8fc0-e63996faf931 service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:19:28.129846 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9013c5eb-a00a-4ebf-8fc0-e63996faf931 service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:19:28.130119 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9013c5eb-a00a-4ebf-8fc0-e63996faf931 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:19:28.131882 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-9013c5eb-a00a-4ebf-8fc0-e63996faf931 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:19:28.225267 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9013c5eb-a00a-4ebf-8fc0-e63996faf931 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:19:28.226760 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9013c5eb-a00a-4ebf-8fc0-e63996faf931 service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:19:28.247684 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1371/2734] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:19:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:19:31.213906 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=6 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:19:31.381562 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb8992c-ce9b-4835-b668-541a4b3548a5 service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:19:31.383091 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-9fb8992c-ce9b-4835-b668-541a4b3548a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:19:31.398377 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb8992c-ce9b-4835-b668-541a4b3548a5 service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:19:31.402956 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f25621-e632-4963-a66d-372901354e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:19:31.403869 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f25621-e632-4963-a66d-372901354e89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:19:31.404148 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f25621-e632-4963-a66d-372901354e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:19:31.404422 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f25621-e632-4963-a66d-372901354e89 admin admin] PATH_INFO: `/v3/users/c0e2ea4fb58a478aa5a7c4d9409cfb70` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:19:31.405591 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f25621-e632-4963-a66d-372901354e89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0e2ea4fb58a478aa5a7c4d9409cfb70)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:19:31.407547 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f25621-e632-4963-a66d-372901354e89 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:19:31.458270 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-a6f25621-e632-4963-a66d-372901354e89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0e2ea4fb58a478aa5a7c4d9409cfb70'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:19:31.465145 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-a6f25621-e632-4963-a66d-372901354e89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0e2ea4fb58a478aa5a7c4d9409cfb70'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:19:31.465905 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-a6f25621-e632-4963-a66d-372901354e89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0e2ea4fb58a478aa5a7c4d9409cfb70'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:19:31.466479 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-a6f25621-e632-4963-a66d-372901354e89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0e2ea4fb58a478aa5a7c4d9409cfb70'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:19:31.478419 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-a6f25621-e632-4963-a66d-372901354e89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0e2ea4fb58a478aa5a7c4d9409cfb70'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:19:31.492984 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1364/2735] 10.222.0.36 () {58 vars in 1223 bytes} [Fri Jun 24 23:19:31 2022] DELETE /identity/v3/users/c0e2ea4fb58a478aa5a7c4d9409cfb70 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 23:19:31.680873 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9013c5eb-a00a-4ebf-8fc0-e63996faf931 service neutron] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:19:31.691357 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9013c5eb-a00a-4ebf-8fc0-e63996faf931 service neutron] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:19:31.743956 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:19:31.750027 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250c2889-6453-460e-9c1f-e50949313086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:19:31.750894 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c2889-6453-460e-9c1f-e50949313086 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:19:31.751190 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c2889-6453-460e-9c1f-e50949313086 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:19:31.751473 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c2889-6453-460e-9c1f-e50949313086 admin admin] PATH_INFO: `/v3/projects/3528b61f20c64745834abd744f453257` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:19:31.752706 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250c2889-6453-460e-9c1f-e50949313086 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3528b61f20c64745834abd744f453257)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:19:31.754607 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250c2889-6453-460e-9c1f-e50949313086 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:19:31.802105 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-250c2889-6453-460e-9c1f-e50949313086 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3528b61f20c64745834abd744f453257', 'request_id': 'req-250c2889-6453-460e-9c1f-e50949313086'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:19:31.808128 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-250c2889-6453-460e-9c1f-e50949313086 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3528b61f20c64745834abd744f453257', 'request_id': 'req-250c2889-6453-460e-9c1f-e50949313086'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:19:31.816824 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-250c2889-6453-460e-9c1f-e50949313086 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3528b61f20c64745834abd744f453257', 'request_id': 'req-250c2889-6453-460e-9c1f-e50949313086'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:19:31.827763 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-250c2889-6453-460e-9c1f-e50949313086 admin admin] The token cache is being invalidate because project 3528b61f20c64745834abd744f453257 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 23:19:31.828053 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-250c2889-6453-460e-9c1f-e50949313086 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:19:31.828737 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-250c2889-6453-460e-9c1f-e50949313086 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:19:31.830361 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1372/2736] 10.222.0.36 () {58 vars in 1232 bytes} [Fri Jun 24 23:19:31 2022] DELETE /identity/v3/projects/3528b61f20c64745834abd744f453257 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 23:19:31.835622 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff9037-2910-421b-ab4a-f076d7787ae7 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:19:31.835913 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff9037-2910-421b-ab4a-f076d7787ae7 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:19:31.836194 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff9037-2910-421b-ab4a-f076d7787ae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:19:31.892884 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-e7ff9037-2910-421b-ab4a-f076d7787ae7 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 23:19:31.894091 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-e7ff9037-2910-421b-ab4a-f076d7787ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:19:31.965365 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1365/2737] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 23:19:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 23:19:31.973821 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fcff18-1ed9-4385-a3f2-09527e3dda8d None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:19:31.974112 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fcff18-1ed9-4385-a3f2-09527e3dda8d None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:19:31.974381 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fcff18-1ed9-4385-a3f2-09527e3dda8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:19:31.994144 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-00fcff18-1ed9-4385-a3f2-09527e3dda8d None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 23:19:31.995362 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-00fcff18-1ed9-4385-a3f2-09527e3dda8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:19:32.004165 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1373/2738] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 23:19:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 23:19:32.008428 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ff9037-2910-421b-ab4a-f076d7787ae7 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:19:32.018568 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ff9037-2910-421b-ab4a-f076d7787ae7 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:19:32.023883 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aec24d9-319b-4941-9b34-8c6f9f08c396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:19:32.024502 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aec24d9-319b-4941-9b34-8c6f9f08c396 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:19:32.024817 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aec24d9-319b-4941-9b34-8c6f9f08c396 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:19:32.025089 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aec24d9-319b-4941-9b34-8c6f9f08c396 admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:19:32.025809 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aec24d9-319b-4941-9b34-8c6f9f08c396 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 23:19:32.026115 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aec24d9-319b-4941-9b34-8c6f9f08c396 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:19:32.027769 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aec24d9-319b-4941-9b34-8c6f9f08c396 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:19:32.040491 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1366/2739] 10.222.0.36 () {58 vars in 1152 bytes} [Fri Jun 24 23:19:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 23:19:32.044838 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fcff18-1ed9-4385-a3f2-09527e3dda8d None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:19:32.054776 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fcff18-1ed9-4385-a3f2-09527e3dda8d None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:19:32.060375 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c7fa3c-fafb-428c-90de-32dd2c668bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:19:32.061017 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c7fa3c-fafb-428c-90de-32dd2c668bbd admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:19:32.061301 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c7fa3c-fafb-428c-90de-32dd2c668bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:19:32.061583 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c7fa3c-fafb-428c-90de-32dd2c668bbd admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:19:32.062247 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c7fa3c-fafb-428c-90de-32dd2c668bbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:19:32.064195 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c7fa3c-fafb-428c-90de-32dd2c668bbd admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:19:32.105329 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1374/2740] 10.222.0.36 () {60 vars in 1152 bytes} [Fri Jun 24 23:19:32 2022] POST /identity/v3/projects => generated 397 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 23:19:32.111609 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aec24d9-319b-4941-9b34-8c6f9f08c396 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:19:32.121775 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aec24d9-319b-4941-9b34-8c6f9f08c396 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:19:32.149920 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:19:32.181069 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f338ac49-306c-4d4d-aed4-f5fa97c3d139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:19:32.181740 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f338ac49-306c-4d4d-aed4-f5fa97c3d139 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:19:32.182025 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f338ac49-306c-4d4d-aed4-f5fa97c3d139 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:19:32.182299 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f338ac49-306c-4d4d-aed4-f5fa97c3d139 admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:19:32.182983 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f338ac49-306c-4d4d-aed4-f5fa97c3d139 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:19:32.184949 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f338ac49-306c-4d4d-aed4-f5fa97c3d139 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:19:32.206704 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1367/2741] 10.222.0.36 () {60 vars in 1143 bytes} [Fri Jun 24 23:19:32 2022] POST /identity/v3/users => generated 299 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 23:19:32.210928 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c7fa3c-fafb-428c-90de-32dd2c668bbd admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:19:32.221682 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c7fa3c-fafb-428c-90de-32dd2c668bbd admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:19:32.226506 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066c0a1b-bdf6-4c7d-97a5-bd9fbbf1f823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:19:32.227168 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066c0a1b-bdf6-4c7d-97a5-bd9fbbf1f823 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:19:32.227485 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066c0a1b-bdf6-4c7d-97a5-bd9fbbf1f823 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:19:32.227763 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066c0a1b-bdf6-4c7d-97a5-bd9fbbf1f823 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:19:32.228492 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066c0a1b-bdf6-4c7d-97a5-bd9fbbf1f823 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:19:32.230116 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066c0a1b-bdf6-4c7d-97a5-bd9fbbf1f823 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:19:32.240631 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1375/2742] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 23:19:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 23:19:32.244543 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f338ac49-306c-4d4d-aed4-f5fa97c3d139 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:19:32.254886 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f338ac49-306c-4d4d-aed4-f5fa97c3d139 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:19:32.259994 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997ad7b0-4aeb-4fb0-9ed8-e2e28097c06c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:19:32.262039 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997ad7b0-4aeb-4fb0-9ed8-e2e28097c06c admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:19:32.262345 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997ad7b0-4aeb-4fb0-9ed8-e2e28097c06c admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:19:32.262620 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997ad7b0-4aeb-4fb0-9ed8-e2e28097c06c admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:19:32.263406 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997ad7b0-4aeb-4fb0-9ed8-e2e28097c06c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:19:32.265059 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997ad7b0-4aeb-4fb0-9ed8-e2e28097c06c admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:19:32.276049 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1368/2743] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 23:19:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 23:19:32.280465 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066c0a1b-bdf6-4c7d-97a5-bd9fbbf1f823 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:19:32.291353 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066c0a1b-bdf6-4c7d-97a5-bd9fbbf1f823 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:19:32.297615 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04191c2-da1f-4390-9d57-3c5b818301bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:19:32.298484 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04191c2-da1f-4390-9d57-3c5b818301bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:19:32.299137 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04191c2-da1f-4390-9d57-3c5b818301bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:19:32.299137 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04191c2-da1f-4390-9d57-3c5b818301bd admin admin] PATH_INFO: `/v3/projects/76608187278b4a059d87646900d953e1/users/91b80f23ddba4ac5a62e112cab14fe9c/roles/1928787bfcc745419829cd315900ac44` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:19:32.314298 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04191c2-da1f-4390-9d57-3c5b818301bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=76608187278b4a059d87646900d953e1, user_id=91b80f23ddba4ac5a62e112cab14fe9c, role_id=1928787bfcc745419829cd315900ac44)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:19:32.317098 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04191c2-da1f-4390-9d57-3c5b818301bd admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:19:32.331839 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1376/2744] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 23:19:32 2022] PUT /identity/v3/projects/76608187278b4a059d87646900d953e1/users/91b80f23ddba4ac5a62e112cab14fe9c/roles/1928787bfcc745419829cd315900ac44 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 23:19:32.347004 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d5cbb0-c82b-470a-9f42-c6e8abaffbdf None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:19:32.347365 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d5cbb0-c82b-470a-9f42-c6e8abaffbdf None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:19:32.348113 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d5cbb0-c82b-470a-9f42-c6e8abaffbdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:19:32.374813 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-06d5cbb0-c82b-470a-9f42-c6e8abaffbdf None None] MFA Rules not processed for user `91b80f23ddba4ac5a62e112cab14fe9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 23:19:32.376060 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-06d5cbb0-c82b-470a-9f42-c6e8abaffbdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:19:32.440314 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1369/2745] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 23:19:32 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 23:19:32.445071 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04191c2-da1f-4390-9d57-3c5b818301bd admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:19:32.507750 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04191c2-da1f-4390-9d57-3c5b818301bd admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:19:32.514122 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a8374c-c40b-4851-9a62-666054e442af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:19:32.515069 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a8374c-c40b-4851-9a62-666054e442af admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:19:32.515467 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a8374c-c40b-4851-9a62-666054e442af admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:19:32.515827 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a8374c-c40b-4851-9a62-666054e442af admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:19:32.516887 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a8374c-c40b-4851-9a62-666054e442af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:19:32.519926 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a8374c-c40b-4851-9a62-666054e442af admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:19:32.544175 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:19:32.555782 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1377/2746] 10.222.0.36 () {60 vars in 1152 bytes} [Fri Jun 24 23:19:32 2022] POST /identity/v3/projects => generated 401 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 23:19:32.557344 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d5cbb0-c82b-470a-9f42-c6e8abaffbdf None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:19:32.574395 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d5cbb0-c82b-470a-9f42-c6e8abaffbdf None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:19:32.634275 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ce5a7e-0d36-4f2d-9cba-c854d8cad0a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:19:32.634948 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ce5a7e-0d36-4f2d-9cba-c854d8cad0a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:19:32.635232 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ce5a7e-0d36-4f2d-9cba-c854d8cad0a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:19:32.635542 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ce5a7e-0d36-4f2d-9cba-c854d8cad0a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:19:32.636237 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ce5a7e-0d36-4f2d-9cba-c854d8cad0a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:19:32.638183 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ce5a7e-0d36-4f2d-9cba-c854d8cad0a6 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:19:32.662535 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1370/2747] 10.222.0.36 () {60 vars in 1143 bytes} [Fri Jun 24 23:19:32 2022] POST /identity/v3/users => generated 307 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 23:19:32.667221 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a8374c-c40b-4851-9a62-666054e442af admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:19:32.682030 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a8374c-c40b-4851-9a62-666054e442af admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:19:32.691383 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d87997-8eb6-4949-b37f-14043512ac5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:19:32.692539 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d87997-8eb6-4949-b37f-14043512ac5d admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:19:32.692962 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d87997-8eb6-4949-b37f-14043512ac5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:19:32.693398 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d87997-8eb6-4949-b37f-14043512ac5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:19:32.694582 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d87997-8eb6-4949-b37f-14043512ac5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:19:32.697286 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d87997-8eb6-4949-b37f-14043512ac5d admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:19:32.712075 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1378/2748] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 23:19:32 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 23:19:32.716402 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ce5a7e-0d36-4f2d-9cba-c854d8cad0a6 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:19:32.727045 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ce5a7e-0d36-4f2d-9cba-c854d8cad0a6 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:19:32.732364 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5574cffb-56a6-4ffb-b1d5-261e44626f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:19:32.733280 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5574cffb-56a6-4ffb-b1d5-261e44626f71 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:19:32.733562 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5574cffb-56a6-4ffb-b1d5-261e44626f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:19:32.733833 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5574cffb-56a6-4ffb-b1d5-261e44626f71 admin admin] PATH_INFO: `/v3/projects/cb0c22ae59334297af25337414c4c163/users/b877529611744b80a3adf69d87969d48/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:19:32.749658 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5574cffb-56a6-4ffb-b1d5-261e44626f71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb0c22ae59334297af25337414c4c163, user_id=b877529611744b80a3adf69d87969d48, role_id=1a1c43cc97a0407eb7a7c7a1333a9d4a)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:19:32.752446 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5574cffb-56a6-4ffb-b1d5-261e44626f71 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:19:32.767351 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1371/2749] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 23:19:32 2022] PUT /identity/v3/projects/cb0c22ae59334297af25337414c4c163/users/b877529611744b80a3adf69d87969d48/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 23:19:32.771409 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d87997-8eb6-4949-b37f-14043512ac5d admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:19:32.781551 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d87997-8eb6-4949-b37f-14043512ac5d admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:19:32.850484 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fb47b5-6d70-41e3-ab88-ace5b14dc583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:19:32.851182 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fb47b5-6d70-41e3-ab88-ace5b14dc583 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:19:32.851501 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fb47b5-6d70-41e3-ab88-ace5b14dc583 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:19:32.851771 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fb47b5-6d70-41e3-ab88-ace5b14dc583 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:19:32.852497 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fb47b5-6d70-41e3-ab88-ace5b14dc583 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:19:32.854120 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fb47b5-6d70-41e3-ab88-ace5b14dc583 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:19:32.864231 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1379/2750] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 23:19:32 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 23:19:32.868590 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5574cffb-56a6-4ffb-b1d5-261e44626f71 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:19:32.874241 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:19:32.881007 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5574cffb-56a6-4ffb-b1d5-261e44626f71 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:19:32.886352 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eb9659-2c39-4110-acc4-83f4bb2c4d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:19:32.887231 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb9659-2c39-4110-acc4-83f4bb2c4d6a admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:19:32.887556 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb9659-2c39-4110-acc4-83f4bb2c4d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:19:32.887831 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb9659-2c39-4110-acc4-83f4bb2c4d6a admin admin] PATH_INFO: `/v3/projects/cb0c22ae59334297af25337414c4c163/users/b877529611744b80a3adf69d87969d48/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:19:32.889852 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eb9659-2c39-4110-acc4-83f4bb2c4d6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb0c22ae59334297af25337414c4c163, user_id=b877529611744b80a3adf69d87969d48, role_id=1a1c43cc97a0407eb7a7c7a1333a9d4a)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:19:32.892622 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eb9659-2c39-4110-acc4-83f4bb2c4d6a admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:19:32.902955 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1372/2751] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 23:19:32 2022] PUT /identity/v3/projects/cb0c22ae59334297af25337414c4c163/users/b877529611744b80a3adf69d87969d48/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 23:19:32.914518 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706660dd-57fa-41d7-bf2f-dd2a1a2d2494 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:19:32.914811 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706660dd-57fa-41d7-bf2f-dd2a1a2d2494 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:19:32.915106 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706660dd-57fa-41d7-bf2f-dd2a1a2d2494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:19:32.943601 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-706660dd-57fa-41d7-bf2f-dd2a1a2d2494 None None] MFA Rules not processed for user `b877529611744b80a3adf69d87969d48`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 23:19:32.944722 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-706660dd-57fa-41d7-bf2f-dd2a1a2d2494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:19:33.014771 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1380/2752] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 23:19:32 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 23:19:33.029798 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eb9659-2c39-4110-acc4-83f4bb2c4d6a admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:19:33.032839 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-d9eb9659-2c39-4110-acc4-83f4bb2c4d6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:19:33.090750 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eb9659-2c39-4110-acc4-83f4bb2c4d6a admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:19:33.095015 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff9f38e-27dd-4b13-b3ad-bad58a5beb3f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a747e2a5684843a6ee9e3480badac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:19:33.095767 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff9f38e-27dd-4b13-b3ad-bad58a5beb3f service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:19:33.096419 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff9f38e-27dd-4b13-b3ad-bad58a5beb3f service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:19:33.096419 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff9f38e-27dd-4b13-b3ad-bad58a5beb3f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:19:33.105995 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff9f38e-27dd-4b13-b3ad-bad58a5beb3f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:19:33.107474 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff9f38e-27dd-4b13-b3ad-bad58a5beb3f service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:19:33.117834 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1373/2753] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:19:33 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:19:33.193571 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706660dd-57fa-41d7-bf2f-dd2a1a2d2494 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:19:33.203634 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706660dd-57fa-41d7-bf2f-dd2a1a2d2494 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:19:33.207530 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e56723-33d2-4352-912c-1c0c0c0b91ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a747e2a5684843a6ee9e3480badac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:19:33.208184 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e56723-33d2-4352-912c-1c0c0c0b91ce service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:19:33.208471 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e56723-33d2-4352-912c-1c0c0c0b91ce service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:19:33.208752 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e56723-33d2-4352-912c-1c0c0c0b91ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:19:33.269873 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e56723-33d2-4352-912c-1c0c0c0b91ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:19:33.271382 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e56723-33d2-4352-912c-1c0c0c0b91ce service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:19:33.280564 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1381/2754] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:19:33 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:19:37.382758 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff9f38e-27dd-4b13-b3ad-bad58a5beb3f service cinder] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:19:37.450545 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff9f38e-27dd-4b13-b3ad-bad58a5beb3f service cinder] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:19:37.455757 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f688a09-fcb9-4d2a-91de-03fe29e98a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:19:37.456661 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f688a09-fcb9-4d2a-91de-03fe29e98a92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:19:37.456949 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f688a09-fcb9-4d2a-91de-03fe29e98a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:19:37.457224 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f688a09-fcb9-4d2a-91de-03fe29e98a92 admin admin] PATH_INFO: `/v3/users/91b80f23ddba4ac5a62e112cab14fe9c` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:19:37.458442 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f688a09-fcb9-4d2a-91de-03fe29e98a92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91b80f23ddba4ac5a62e112cab14fe9c)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:19:37.460433 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f688a09-fcb9-4d2a-91de-03fe29e98a92 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:19:37.510693 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-9f688a09-fcb9-4d2a-91de-03fe29e98a92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91b80f23ddba4ac5a62e112cab14fe9c'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:19:37.518350 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-9f688a09-fcb9-4d2a-91de-03fe29e98a92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91b80f23ddba4ac5a62e112cab14fe9c'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:19:37.519272 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-9f688a09-fcb9-4d2a-91de-03fe29e98a92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91b80f23ddba4ac5a62e112cab14fe9c'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:19:37.520020 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-9f688a09-fcb9-4d2a-91de-03fe29e98a92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91b80f23ddba4ac5a62e112cab14fe9c'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:19:37.532605 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-9f688a09-fcb9-4d2a-91de-03fe29e98a92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91b80f23ddba4ac5a62e112cab14fe9c'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:19:37.546114 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1374/2755] 10.222.0.36 () {58 vars in 1223 bytes} [Fri Jun 24 23:19:37 2022] DELETE /identity/v3/users/91b80f23ddba4ac5a62e112cab14fe9c => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 23:19:37.550925 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bdd6c7-b831-4fac-9e03-d5ad3d76a8ab None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:19:37.551407 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bdd6c7-b831-4fac-9e03-d5ad3d76a8ab None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:19:37.551543 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bdd6c7-b831-4fac-9e03-d5ad3d76a8ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:19:37.569053 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-e2bdd6c7-b831-4fac-9e03-d5ad3d76a8ab None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 23:19:37.570248 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-e2bdd6c7-b831-4fac-9e03-d5ad3d76a8ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:19:37.574205 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:19:37.633023 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1382/2756] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 23:19:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 23:19:37.642842 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f688a09-fcb9-4d2a-91de-03fe29e98a92 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:19:37.644509 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-9f688a09-fcb9-4d2a-91de-03fe29e98a92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:19:37.658140 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:19:37.704148 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f688a09-fcb9-4d2a-91de-03fe29e98a92 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:19:37.708600 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6123ab1-01ba-4fa4-827c-e89eb64de12e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:19:37.709254 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6123ab1-01ba-4fa4-827c-e89eb64de12e service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:19:37.709538 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6123ab1-01ba-4fa4-827c-e89eb64de12e service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:19:37.709816 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6123ab1-01ba-4fa4-827c-e89eb64de12e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:19:37.719698 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6123ab1-01ba-4fa4-827c-e89eb64de12e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:19:37.721160 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6123ab1-01ba-4fa4-827c-e89eb64de12e service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:19:37.731281 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1375/2757] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:19:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:19:38.016403 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bdd6c7-b831-4fac-9e03-d5ad3d76a8ab None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:19:38.017853 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-e2bdd6c7-b831-4fac-9e03-d5ad3d76a8ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:19:38.033504 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bdd6c7-b831-4fac-9e03-d5ad3d76a8ab None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:19:38.039264 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b5bfec-a083-4507-b0ff-6c316014b3a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:19:38.040168 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b5bfec-a083-4507-b0ff-6c316014b3a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:19:38.040453 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b5bfec-a083-4507-b0ff-6c316014b3a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:19:38.040729 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b5bfec-a083-4507-b0ff-6c316014b3a1 admin admin] PATH_INFO: `/v3/projects/76608187278b4a059d87646900d953e1` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:19:38.043329 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b5bfec-a083-4507-b0ff-6c316014b3a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76608187278b4a059d87646900d953e1)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:19:38.045211 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b5bfec-a083-4507-b0ff-6c316014b3a1 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:19:38.104339 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-55b5bfec-a083-4507-b0ff-6c316014b3a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76608187278b4a059d87646900d953e1', 'request_id': 'req-55b5bfec-a083-4507-b0ff-6c316014b3a1'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:19:38.111509 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-55b5bfec-a083-4507-b0ff-6c316014b3a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76608187278b4a059d87646900d953e1', 'request_id': 'req-55b5bfec-a083-4507-b0ff-6c316014b3a1'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:19:38.121827 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-55b5bfec-a083-4507-b0ff-6c316014b3a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76608187278b4a059d87646900d953e1', 'request_id': 'req-55b5bfec-a083-4507-b0ff-6c316014b3a1'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:19:38.132998 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-55b5bfec-a083-4507-b0ff-6c316014b3a1 admin admin] The token cache is being invalidate because project 76608187278b4a059d87646900d953e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 23:19:38.133205 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-55b5bfec-a083-4507-b0ff-6c316014b3a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:19:38.133832 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-55b5bfec-a083-4507-b0ff-6c316014b3a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:19:38.135458 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1383/2758] 10.222.0.36 () {58 vars in 1232 bytes} [Fri Jun 24 23:19:38 2022] DELETE /identity/v3/projects/76608187278b4a059d87646900d953e1 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 23:19:38.139576 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6123ab1-01ba-4fa4-827c-e89eb64de12e service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:19:38.149519 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6123ab1-01ba-4fa4-827c-e89eb64de12e service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:19:38.210533 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307f6b92-89d1-4b80-81ff-3e029dc733ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:19:38.211460 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307f6b92-89d1-4b80-81ff-3e029dc733ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:19:38.211739 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307f6b92-89d1-4b80-81ff-3e029dc733ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:19:38.212012 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307f6b92-89d1-4b80-81ff-3e029dc733ab admin admin] PATH_INFO: `/v3/users/b877529611744b80a3adf69d87969d48` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:19:38.213276 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307f6b92-89d1-4b80-81ff-3e029dc733ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=b877529611744b80a3adf69d87969d48)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:19:38.215308 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307f6b92-89d1-4b80-81ff-3e029dc733ab admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:19:38.267525 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-307f6b92-89d1-4b80-81ff-3e029dc733ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b877529611744b80a3adf69d87969d48'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:19:38.274796 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-307f6b92-89d1-4b80-81ff-3e029dc733ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b877529611744b80a3adf69d87969d48'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:19:38.275492 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-307f6b92-89d1-4b80-81ff-3e029dc733ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b877529611744b80a3adf69d87969d48'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:19:38.276103 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-307f6b92-89d1-4b80-81ff-3e029dc733ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b877529611744b80a3adf69d87969d48'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:19:38.288690 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-307f6b92-89d1-4b80-81ff-3e029dc733ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b877529611744b80a3adf69d87969d48'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:19:38.309121 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1376/2759] 10.222.0.36 () {58 vars in 1223 bytes} [Fri Jun 24 23:19:38 2022] DELETE /identity/v3/users/b877529611744b80a3adf69d87969d48 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 23:19:38.592264 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b5bfec-a083-4507-b0ff-6c316014b3a1 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:19:38.593904 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-55b5bfec-a083-4507-b0ff-6c316014b3a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:19:38.610594 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b5bfec-a083-4507-b0ff-6c316014b3a1 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:19:38.671794 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3013e9c0-b121-4322-81bb-383af6559a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:19:38.672689 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3013e9c0-b121-4322-81bb-383af6559a38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:19:38.672968 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3013e9c0-b121-4322-81bb-383af6559a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:19:38.673245 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3013e9c0-b121-4322-81bb-383af6559a38 admin admin] PATH_INFO: `/v3/projects/cb0c22ae59334297af25337414c4c163` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:19:38.674521 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3013e9c0-b121-4322-81bb-383af6559a38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb0c22ae59334297af25337414c4c163)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:19:38.676909 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3013e9c0-b121-4322-81bb-383af6559a38 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:19:38.717383 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:19:38.727855 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-3013e9c0-b121-4322-81bb-383af6559a38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb0c22ae59334297af25337414c4c163', 'request_id': 'req-3013e9c0-b121-4322-81bb-383af6559a38'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:19:38.734154 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-3013e9c0-b121-4322-81bb-383af6559a38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb0c22ae59334297af25337414c4c163', 'request_id': 'req-3013e9c0-b121-4322-81bb-383af6559a38'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:19:38.744327 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-3013e9c0-b121-4322-81bb-383af6559a38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb0c22ae59334297af25337414c4c163', 'request_id': 'req-3013e9c0-b121-4322-81bb-383af6559a38'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:19:38.755134 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-3013e9c0-b121-4322-81bb-383af6559a38 admin admin] The token cache is being invalidate because project cb0c22ae59334297af25337414c4c163 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 23:19:38.755440 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-3013e9c0-b121-4322-81bb-383af6559a38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:19:38.756194 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-3013e9c0-b121-4322-81bb-383af6559a38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:19:38.758610 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1384/2760] 10.222.0.36 () {58 vars in 1232 bytes} [Fri Jun 24 23:19:38 2022] DELETE /identity/v3/projects/cb0c22ae59334297af25337414c4c163 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 23:19:38.763829 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2c6a7c-4f61-4ab3-baaf-22a3c4ee5478 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:19:38.764326 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2c6a7c-4f61-4ab3-baaf-22a3c4ee5478 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:19:38.764414 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2c6a7c-4f61-4ab3-baaf-22a3c4ee5478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:19:38.783075 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-2b2c6a7c-4f61-4ab3-baaf-22a3c4ee5478 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 23:19:38.784342 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-2b2c6a7c-4f61-4ab3-baaf-22a3c4ee5478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:19:38.815264 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:19:38.851410 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1377/2761] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 23:19:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 23:19:38.859391 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaab6952-5332-47ab-b464-2d7414f91faf None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:19:38.859683 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaab6952-5332-47ab-b464-2d7414f91faf None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:19:38.859959 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaab6952-5332-47ab-b464-2d7414f91faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:19:38.878786 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-aaab6952-5332-47ab-b464-2d7414f91faf None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 23:19:38.880021 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-aaab6952-5332-47ab-b464-2d7414f91faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:19:38.889114 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1385/2762] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 23:19:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 23:19:38.893443 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2c6a7c-4f61-4ab3-baaf-22a3c4ee5478 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:19:38.903564 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2c6a7c-4f61-4ab3-baaf-22a3c4ee5478 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:19:38.908992 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38df24d4-73aa-4ae3-a5af-927b9d70eae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:19:38.909654 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38df24d4-73aa-4ae3-a5af-927b9d70eae1 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:19:38.909937 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38df24d4-73aa-4ae3-a5af-927b9d70eae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:19:38.910216 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38df24d4-73aa-4ae3-a5af-927b9d70eae1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:19:38.910947 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38df24d4-73aa-4ae3-a5af-927b9d70eae1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 23:19:38.911287 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38df24d4-73aa-4ae3-a5af-927b9d70eae1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:19:38.912924 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38df24d4-73aa-4ae3-a5af-927b9d70eae1 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:19:38.931656 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1378/2763] 10.222.0.36 () {58 vars in 1152 bytes} [Fri Jun 24 23:19:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 23:19:38.936622 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaab6952-5332-47ab-b464-2d7414f91faf None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:19:38.947921 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaab6952-5332-47ab-b464-2d7414f91faf None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:19:38.953428 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784743b6-1472-49c9-b68e-874fd82eff5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:19:38.954097 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784743b6-1472-49c9-b68e-874fd82eff5e admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:19:38.954380 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784743b6-1472-49c9-b68e-874fd82eff5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:19:38.954655 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784743b6-1472-49c9-b68e-874fd82eff5e admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:19:38.955390 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784743b6-1472-49c9-b68e-874fd82eff5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:19:38.957364 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784743b6-1472-49c9-b68e-874fd82eff5e admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:19:38.985854 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1386/2764] 10.222.0.36 () {60 vars in 1152 bytes} [Fri Jun 24 23:19:38 2022] POST /identity/v3/projects => generated 381 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 23:19:38.990098 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38df24d4-73aa-4ae3-a5af-927b9d70eae1 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:19:39.000753 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38df24d4-73aa-4ae3-a5af-927b9d70eae1 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:19:39.058564 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac8d3e5-f6fa-4e31-b209-1d77a54018d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:19:39.059228 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac8d3e5-f6fa-4e31-b209-1d77a54018d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:19:39.059544 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac8d3e5-f6fa-4e31-b209-1d77a54018d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:19:39.059815 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac8d3e5-f6fa-4e31-b209-1d77a54018d1 admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:19:39.060497 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac8d3e5-f6fa-4e31-b209-1d77a54018d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:19:39.062421 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac8d3e5-f6fa-4e31-b209-1d77a54018d1 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:19:39.085630 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1379/2765] 10.222.0.36 () {60 vars in 1143 bytes} [Fri Jun 24 23:19:38 2022] POST /identity/v3/users => generated 291 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 23:19:39.089889 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784743b6-1472-49c9-b68e-874fd82eff5e admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:19:39.101020 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784743b6-1472-49c9-b68e-874fd82eff5e admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:19:39.107691 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aeef0f-2f26-4038-808a-cde09ce98809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:19:39.108450 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aeef0f-2f26-4038-808a-cde09ce98809 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:19:39.108643 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aeef0f-2f26-4038-808a-cde09ce98809 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:19:39.108909 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aeef0f-2f26-4038-808a-cde09ce98809 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:19:39.109638 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aeef0f-2f26-4038-808a-cde09ce98809 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:19:39.111661 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aeef0f-2f26-4038-808a-cde09ce98809 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:19:39.122591 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1387/2766] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 23:19:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 23:19:39.126919 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac8d3e5-f6fa-4e31-b209-1d77a54018d1 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:19:39.137761 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac8d3e5-f6fa-4e31-b209-1d77a54018d1 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:19:39.142735 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af79db29-7f7b-4e3b-8eab-4fd28faa547e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:19:39.143436 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af79db29-7f7b-4e3b-8eab-4fd28faa547e admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:19:39.143720 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af79db29-7f7b-4e3b-8eab-4fd28faa547e admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:19:39.143994 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af79db29-7f7b-4e3b-8eab-4fd28faa547e admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:19:39.144727 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af79db29-7f7b-4e3b-8eab-4fd28faa547e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:19:39.146363 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af79db29-7f7b-4e3b-8eab-4fd28faa547e admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:19:39.156458 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1380/2767] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 23:19:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 23:19:39.160939 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aeef0f-2f26-4038-808a-cde09ce98809 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:19:39.171382 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aeef0f-2f26-4038-808a-cde09ce98809 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:19:39.177605 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15cd605-b9f8-43fb-b12a-16460bc99db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:19:39.178486 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15cd605-b9f8-43fb-b12a-16460bc99db5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:19:39.178765 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15cd605-b9f8-43fb-b12a-16460bc99db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:19:39.179035 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15cd605-b9f8-43fb-b12a-16460bc99db5 admin admin] PATH_INFO: `/v3/projects/4b3c2f0b345c459eb42335c1349f4872/users/1a766122be5947808f44c8513f51d2f3/roles/1928787bfcc745419829cd315900ac44` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:19:39.199302 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15cd605-b9f8-43fb-b12a-16460bc99db5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b3c2f0b345c459eb42335c1349f4872, user_id=1a766122be5947808f44c8513f51d2f3, role_id=1928787bfcc745419829cd315900ac44)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:19:39.201932 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15cd605-b9f8-43fb-b12a-16460bc99db5 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:19:39.221971 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1388/2768] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 23:19:39 2022] PUT /identity/v3/projects/4b3c2f0b345c459eb42335c1349f4872/users/1a766122be5947808f44c8513f51d2f3/roles/1928787bfcc745419829cd315900ac44 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 23:19:39.232707 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa12165-e454-47d0-b168-f695bc1a458d None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:19:39.232986 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa12165-e454-47d0-b168-f695bc1a458d None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:19:39.233273 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa12165-e454-47d0-b168-f695bc1a458d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:19:39.261747 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-1fa12165-e454-47d0-b168-f695bc1a458d None None] MFA Rules not processed for user `1a766122be5947808f44c8513f51d2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 23:19:39.262974 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-1fa12165-e454-47d0-b168-f695bc1a458d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:19:39.328423 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1381/2769] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 23:19:39 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 23:19:39.333140 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15cd605-b9f8-43fb-b12a-16460bc99db5 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:19:39.395379 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15cd605-b9f8-43fb-b12a-16460bc99db5 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:19:39.400490 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76766bea-cfb9-4464-a57e-56551d04f84c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:19:39.401150 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76766bea-cfb9-4464-a57e-56551d04f84c admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:19:39.401447 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76766bea-cfb9-4464-a57e-56551d04f84c admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:19:39.401697 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76766bea-cfb9-4464-a57e-56551d04f84c admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:19:39.402379 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76766bea-cfb9-4464-a57e-56551d04f84c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:19:39.404342 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76766bea-cfb9-4464-a57e-56551d04f84c admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:19:39.431605 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1389/2770] 10.222.0.36 () {60 vars in 1152 bytes} [Fri Jun 24 23:19:39 2022] POST /identity/v3/projects => generated 383 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 23:19:39.435868 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa12165-e454-47d0-b168-f695bc1a458d None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:19:39.447144 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa12165-e454-47d0-b168-f695bc1a458d None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:19:39.476017 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:19:39.512108 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74de4785-08f7-4060-8d4e-badb5a29bf53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:19:39.512782 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74de4785-08f7-4060-8d4e-badb5a29bf53 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:19:39.513076 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74de4785-08f7-4060-8d4e-badb5a29bf53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:19:39.513350 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74de4785-08f7-4060-8d4e-badb5a29bf53 admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:19:39.514047 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74de4785-08f7-4060-8d4e-badb5a29bf53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:19:39.516034 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74de4785-08f7-4060-8d4e-badb5a29bf53 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:19:39.537461 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1382/2771] 10.222.0.36 () {60 vars in 1143 bytes} [Fri Jun 24 23:19:39 2022] POST /identity/v3/users => generated 298 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 23:19:39.541498 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76766bea-cfb9-4464-a57e-56551d04f84c admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:19:39.552728 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76766bea-cfb9-4464-a57e-56551d04f84c admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:19:39.559398 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29840413-2bfa-47a9-883c-f626ff8915fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:19:39.560278 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29840413-2bfa-47a9-883c-f626ff8915fa admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:19:39.560704 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29840413-2bfa-47a9-883c-f626ff8915fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:19:39.561039 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29840413-2bfa-47a9-883c-f626ff8915fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:19:39.561899 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29840413-2bfa-47a9-883c-f626ff8915fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:19:39.563793 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29840413-2bfa-47a9-883c-f626ff8915fa admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:19:39.574977 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1390/2772] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 23:19:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 23:19:39.579939 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74de4785-08f7-4060-8d4e-badb5a29bf53 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:19:39.594466 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74de4785-08f7-4060-8d4e-badb5a29bf53 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:19:39.603003 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d897c7-06f9-4e8d-a10d-54cfe9d1174f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:19:39.604283 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d897c7-06f9-4e8d-a10d-54cfe9d1174f admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:19:39.604619 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d897c7-06f9-4e8d-a10d-54cfe9d1174f admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:19:39.604891 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d897c7-06f9-4e8d-a10d-54cfe9d1174f admin admin] PATH_INFO: `/v3/projects/7ff9df988e5c40b5a16cf514cc769650/users/957897e335614e758c0813e80d323f80/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:19:39.622531 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d897c7-06f9-4e8d-a10d-54cfe9d1174f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ff9df988e5c40b5a16cf514cc769650, user_id=957897e335614e758c0813e80d323f80, role_id=1a1c43cc97a0407eb7a7c7a1333a9d4a)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:19:39.625253 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d897c7-06f9-4e8d-a10d-54cfe9d1174f admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:19:39.641188 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1383/2773] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 23:19:39 2022] PUT /identity/v3/projects/7ff9df988e5c40b5a16cf514cc769650/users/957897e335614e758c0813e80d323f80/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 23:19:39.645309 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29840413-2bfa-47a9-883c-f626ff8915fa admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:19:39.655576 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29840413-2bfa-47a9-883c-f626ff8915fa admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:19:39.693990 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:19:39.723273 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcff46d2-7cdb-4bd3-8a1f-1958f21733fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:19:39.723988 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff46d2-7cdb-4bd3-8a1f-1958f21733fd admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:19:39.724250 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff46d2-7cdb-4bd3-8a1f-1958f21733fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:19:39.724532 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff46d2-7cdb-4bd3-8a1f-1958f21733fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:19:39.725269 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcff46d2-7cdb-4bd3-8a1f-1958f21733fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:19:39.726968 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcff46d2-7cdb-4bd3-8a1f-1958f21733fd admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:19:39.737532 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1391/2774] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 23:19:39 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 23:19:39.741743 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d897c7-06f9-4e8d-a10d-54cfe9d1174f admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:19:39.753322 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d897c7-06f9-4e8d-a10d-54cfe9d1174f admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:19:39.757293 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fe05a3-ec19-485b-81a0-f889ac8251d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:19:39.758186 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe05a3-ec19-485b-81a0-f889ac8251d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:19:39.758477 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe05a3-ec19-485b-81a0-f889ac8251d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:19:39.758760 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe05a3-ec19-485b-81a0-f889ac8251d0 admin admin] PATH_INFO: `/v3/projects/7ff9df988e5c40b5a16cf514cc769650/users/957897e335614e758c0813e80d323f80/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:19:39.761098 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fe05a3-ec19-485b-81a0-f889ac8251d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ff9df988e5c40b5a16cf514cc769650, user_id=957897e335614e758c0813e80d323f80, role_id=1a1c43cc97a0407eb7a7c7a1333a9d4a)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:19:39.763821 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fe05a3-ec19-485b-81a0-f889ac8251d0 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:19:39.774093 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1384/2775] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 23:19:39 2022] PUT /identity/v3/projects/7ff9df988e5c40b5a16cf514cc769650/users/957897e335614e758c0813e80d323f80/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 23:19:39.833804 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c88ad89-db29-4f71-851d-3676b3f7d8eb None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:19:39.834106 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c88ad89-db29-4f71-851d-3676b3f7d8eb None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:19:39.834403 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c88ad89-db29-4f71-851d-3676b3f7d8eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:19:39.861796 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-2c88ad89-db29-4f71-851d-3676b3f7d8eb None None] MFA Rules not processed for user `957897e335614e758c0813e80d323f80`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 23:19:39.863052 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-2c88ad89-db29-4f71-851d-3676b3f7d8eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:19:39.934810 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1392/2776] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 23:19:39 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 23:19:39.947509 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fe05a3-ec19-485b-81a0-f889ac8251d0 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:19:39.949388 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-e2fe05a3-ec19-485b-81a0-f889ac8251d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:19:40.009590 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fe05a3-ec19-485b-81a0-f889ac8251d0 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:19:40.013439 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae70340-c83a-4013-98a9-2078487cf435 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a747e2a5684843a6ee9e3480badac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:19:40.014091 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae70340-c83a-4013-98a9-2078487cf435 service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:19:40.014372 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae70340-c83a-4013-98a9-2078487cf435 service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:19:40.014648 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae70340-c83a-4013-98a9-2078487cf435 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:19:40.024063 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae70340-c83a-4013-98a9-2078487cf435 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:19:40.025512 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae70340-c83a-4013-98a9-2078487cf435 service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:19:40.034927 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1385/2777] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:19:39 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:19:40.107387 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c88ad89-db29-4f71-851d-3676b3f7d8eb None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:19:40.117627 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c88ad89-db29-4f71-851d-3676b3f7d8eb None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:19:40.121504 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93694a81-ce9b-451f-b3f4-90b5af67572e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a747e2a5684843a6ee9e3480badac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:19:40.122173 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93694a81-ce9b-451f-b3f4-90b5af67572e service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:19:40.122454 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93694a81-ce9b-451f-b3f4-90b5af67572e service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:19:40.122724 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93694a81-ce9b-451f-b3f4-90b5af67572e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:19:40.179714 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93694a81-ce9b-451f-b3f4-90b5af67572e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:19:40.181169 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93694a81-ce9b-451f-b3f4-90b5af67572e service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:19:40.190277 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1393/2778] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:19:40 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:19:40.457782 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae70340-c83a-4013-98a9-2078487cf435 service cinder] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:19:40.524695 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae70340-c83a-4013-98a9-2078487cf435 service cinder] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:19:40.529445 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc60ddf-faf4-48a0-a367-5ea3c586a620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:19:40.530328 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc60ddf-faf4-48a0-a367-5ea3c586a620 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:19:40.530611 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc60ddf-faf4-48a0-a367-5ea3c586a620 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:19:40.530885 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc60ddf-faf4-48a0-a367-5ea3c586a620 admin admin] PATH_INFO: `/v3/users/1a766122be5947808f44c8513f51d2f3` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:19:40.532182 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc60ddf-faf4-48a0-a367-5ea3c586a620 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a766122be5947808f44c8513f51d2f3)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:19:40.534334 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc60ddf-faf4-48a0-a367-5ea3c586a620 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:19:40.563815 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:19:40.586465 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-3fc60ddf-faf4-48a0-a367-5ea3c586a620 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a766122be5947808f44c8513f51d2f3'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:19:40.593749 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-3fc60ddf-faf4-48a0-a367-5ea3c586a620 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a766122be5947808f44c8513f51d2f3'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:19:40.594455 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-3fc60ddf-faf4-48a0-a367-5ea3c586a620 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a766122be5947808f44c8513f51d2f3'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:19:40.595109 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-3fc60ddf-faf4-48a0-a367-5ea3c586a620 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a766122be5947808f44c8513f51d2f3'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:19:40.608584 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-3fc60ddf-faf4-48a0-a367-5ea3c586a620 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a766122be5947808f44c8513f51d2f3'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:19:40.623660 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1386/2779] 10.222.0.36 () {58 vars in 1223 bytes} [Fri Jun 24 23:19:40 2022] DELETE /identity/v3/users/1a766122be5947808f44c8513f51d2f3 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 23:19:40.628428 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9708c36-7cf8-4a65-9af5-c90bc46051ff None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:19:40.628713 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9708c36-7cf8-4a65-9af5-c90bc46051ff None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:19:40.628991 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9708c36-7cf8-4a65-9af5-c90bc46051ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:19:40.647675 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-e9708c36-7cf8-4a65-9af5-c90bc46051ff None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 23:19:40.648880 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-e9708c36-7cf8-4a65-9af5-c90bc46051ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:19:40.700721 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:19:40.719033 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1394/2780] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 23:19:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 23:19:40.729214 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc60ddf-faf4-48a0-a367-5ea3c586a620 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:19:40.730805 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-3fc60ddf-faf4-48a0-a367-5ea3c586a620 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:19:40.790477 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc60ddf-faf4-48a0-a367-5ea3c586a620 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:19:40.794315 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2327cb-f831-436b-b512-bf639d246eac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:19:40.794947 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2327cb-f831-436b-b512-bf639d246eac service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:19:40.795222 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2327cb-f831-436b-b512-bf639d246eac service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:19:40.795550 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2327cb-f831-436b-b512-bf639d246eac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:19:40.805412 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2327cb-f831-436b-b512-bf639d246eac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:19:40.806893 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2327cb-f831-436b-b512-bf639d246eac service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:19:40.816522 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1387/2781] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:19:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:19:41.097178 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9708c36-7cf8-4a65-9af5-c90bc46051ff None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:19:41.098727 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-e9708c36-7cf8-4a65-9af5-c90bc46051ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:19:41.112034 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9708c36-7cf8-4a65-9af5-c90bc46051ff None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:19:41.117779 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767ed0c6-773e-4597-8908-ef50c525dde9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:19:41.118647 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ed0c6-773e-4597-8908-ef50c525dde9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:19:41.118939 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ed0c6-773e-4597-8908-ef50c525dde9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:19:41.119218 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ed0c6-773e-4597-8908-ef50c525dde9 admin admin] PATH_INFO: `/v3/projects/4b3c2f0b345c459eb42335c1349f4872` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:19:41.120541 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767ed0c6-773e-4597-8908-ef50c525dde9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b3c2f0b345c459eb42335c1349f4872)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:19:41.122510 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767ed0c6-773e-4597-8908-ef50c525dde9 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:19:41.179098 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-767ed0c6-773e-4597-8908-ef50c525dde9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b3c2f0b345c459eb42335c1349f4872', 'request_id': 'req-767ed0c6-773e-4597-8908-ef50c525dde9'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:19:41.185557 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-767ed0c6-773e-4597-8908-ef50c525dde9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b3c2f0b345c459eb42335c1349f4872', 'request_id': 'req-767ed0c6-773e-4597-8908-ef50c525dde9'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:19:41.195830 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-767ed0c6-773e-4597-8908-ef50c525dde9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b3c2f0b345c459eb42335c1349f4872', 'request_id': 'req-767ed0c6-773e-4597-8908-ef50c525dde9'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:19:41.206344 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-767ed0c6-773e-4597-8908-ef50c525dde9 admin admin] The token cache is being invalidate because project 4b3c2f0b345c459eb42335c1349f4872 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 23:19:41.206616 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-767ed0c6-773e-4597-8908-ef50c525dde9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:19:41.207327 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-767ed0c6-773e-4597-8908-ef50c525dde9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:19:41.208873 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1395/2782] 10.222.0.36 () {58 vars in 1232 bytes} [Fri Jun 24 23:19:41 2022] DELETE /identity/v3/projects/4b3c2f0b345c459eb42335c1349f4872 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 23:19:41.214415 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2327cb-f831-436b-b512-bf639d246eac service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:19:41.224378 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2327cb-f831-436b-b512-bf639d246eac service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:19:41.281222 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2d81b3-2d5a-4a60-be74-b31b0a8fba8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:19:41.282134 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2d81b3-2d5a-4a60-be74-b31b0a8fba8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:19:41.282452 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2d81b3-2d5a-4a60-be74-b31b0a8fba8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:19:41.282732 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2d81b3-2d5a-4a60-be74-b31b0a8fba8a admin admin] PATH_INFO: `/v3/users/957897e335614e758c0813e80d323f80` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:19:41.284092 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2d81b3-2d5a-4a60-be74-b31b0a8fba8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=957897e335614e758c0813e80d323f80)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:19:41.286097 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2d81b3-2d5a-4a60-be74-b31b0a8fba8a admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:19:41.334789 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-cd2d81b3-2d5a-4a60-be74-b31b0a8fba8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '957897e335614e758c0813e80d323f80'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:19:41.336131 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:19:41.343490 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-cd2d81b3-2d5a-4a60-be74-b31b0a8fba8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '957897e335614e758c0813e80d323f80'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:19:41.344314 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-cd2d81b3-2d5a-4a60-be74-b31b0a8fba8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '957897e335614e758c0813e80d323f80'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:19:41.344984 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-cd2d81b3-2d5a-4a60-be74-b31b0a8fba8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '957897e335614e758c0813e80d323f80'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:19:41.357199 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-cd2d81b3-2d5a-4a60-be74-b31b0a8fba8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '957897e335614e758c0813e80d323f80'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:19:41.375194 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1388/2783] 10.222.0.36 () {58 vars in 1223 bytes} [Fri Jun 24 23:19:41 2022] DELETE /identity/v3/users/957897e335614e758c0813e80d323f80 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 23:19:41.658130 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767ed0c6-773e-4597-8908-ef50c525dde9 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:19:41.660737 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-767ed0c6-773e-4597-8908-ef50c525dde9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:19:41.675457 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767ed0c6-773e-4597-8908-ef50c525dde9 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:19:41.733964 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72ae008-3f7b-4de3-8029-10dd0ed908fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:19:41.734843 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72ae008-3f7b-4de3-8029-10dd0ed908fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:19:41.735499 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72ae008-3f7b-4de3-8029-10dd0ed908fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:19:41.735769 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72ae008-3f7b-4de3-8029-10dd0ed908fc admin admin] PATH_INFO: `/v3/projects/7ff9df988e5c40b5a16cf514cc769650` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:19:41.737000 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72ae008-3f7b-4de3-8029-10dd0ed908fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ff9df988e5c40b5a16cf514cc769650)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:19:41.738930 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72ae008-3f7b-4de3-8029-10dd0ed908fc admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:19:41.785839 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-b72ae008-3f7b-4de3-8029-10dd0ed908fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ff9df988e5c40b5a16cf514cc769650', 'request_id': 'req-b72ae008-3f7b-4de3-8029-10dd0ed908fc'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:19:41.791794 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-b72ae008-3f7b-4de3-8029-10dd0ed908fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ff9df988e5c40b5a16cf514cc769650', 'request_id': 'req-b72ae008-3f7b-4de3-8029-10dd0ed908fc'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:19:41.801427 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-b72ae008-3f7b-4de3-8029-10dd0ed908fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ff9df988e5c40b5a16cf514cc769650', 'request_id': 'req-b72ae008-3f7b-4de3-8029-10dd0ed908fc'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:19:41.812571 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-b72ae008-3f7b-4de3-8029-10dd0ed908fc admin admin] The token cache is being invalidate because project 7ff9df988e5c40b5a16cf514cc769650 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 23:19:41.812939 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-b72ae008-3f7b-4de3-8029-10dd0ed908fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:19:41.813599 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-b72ae008-3f7b-4de3-8029-10dd0ed908fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:19:41.816060 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1396/2784] 10.222.0.36 () {58 vars in 1232 bytes} [Fri Jun 24 23:19:41 2022] DELETE /identity/v3/projects/7ff9df988e5c40b5a16cf514cc769650 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 23:19:41.821024 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09500db-087c-4e54-9fe9-e54f600d1330 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:19:41.821506 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09500db-087c-4e54-9fe9-e54f600d1330 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:19:41.821584 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09500db-087c-4e54-9fe9-e54f600d1330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:19:41.839897 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-c09500db-087c-4e54-9fe9-e54f600d1330 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 23:19:41.841103 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-c09500db-087c-4e54-9fe9-e54f600d1330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:19:41.902505 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1389/2785] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 23:19:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 23:19:41.910729 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98264db-52a4-45a4-8faa-2e519d058d8a None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:19:41.911020 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98264db-52a4-45a4-8faa-2e519d058d8a None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:19:41.911315 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98264db-52a4-45a4-8faa-2e519d058d8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:19:41.928213 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:19:41.935632 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-d98264db-52a4-45a4-8faa-2e519d058d8a None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 23:19:41.937597 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-d98264db-52a4-45a4-8faa-2e519d058d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:19:41.947515 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1397/2786] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 23:19:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 23:19:41.951818 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09500db-087c-4e54-9fe9-e54f600d1330 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:19:41.962556 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09500db-087c-4e54-9fe9-e54f600d1330 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:19:41.967782 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44816b4f-ebf8-4eed-a867-7e8fde7cec76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:19:41.968442 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44816b4f-ebf8-4eed-a867-7e8fde7cec76 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:19:41.968726 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44816b4f-ebf8-4eed-a867-7e8fde7cec76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:19:41.969009 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44816b4f-ebf8-4eed-a867-7e8fde7cec76 admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:19:41.969740 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44816b4f-ebf8-4eed-a867-7e8fde7cec76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 23:19:41.970049 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44816b4f-ebf8-4eed-a867-7e8fde7cec76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:19:41.972309 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44816b4f-ebf8-4eed-a867-7e8fde7cec76 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:19:41.984908 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1390/2787] 10.222.0.36 () {58 vars in 1152 bytes} [Fri Jun 24 23:19:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 23:19:41.990096 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98264db-52a4-45a4-8faa-2e519d058d8a None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:19:41.999867 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98264db-52a4-45a4-8faa-2e519d058d8a None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:19:42.005786 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5946589-2e89-4687-879e-d43dabde707a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:19:42.006447 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5946589-2e89-4687-879e-d43dabde707a admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:19:42.006736 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5946589-2e89-4687-879e-d43dabde707a admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:19:42.007011 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5946589-2e89-4687-879e-d43dabde707a admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:19:42.007744 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5946589-2e89-4687-879e-d43dabde707a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:19:42.009682 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5946589-2e89-4687-879e-d43dabde707a admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:19:42.038934 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1398/2788] 10.222.0.36 () {60 vars in 1152 bytes} [Fri Jun 24 23:19:41 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 23:19:42.043133 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44816b4f-ebf8-4eed-a867-7e8fde7cec76 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:19:42.053365 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44816b4f-ebf8-4eed-a867-7e8fde7cec76 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:19:42.114708 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b11606-c7e0-4b28-8f45-3c78cfeb146b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:19:42.115435 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b11606-c7e0-4b28-8f45-3c78cfeb146b admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:19:42.115725 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b11606-c7e0-4b28-8f45-3c78cfeb146b admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:19:42.116012 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b11606-c7e0-4b28-8f45-3c78cfeb146b admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:19:42.116704 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b11606-c7e0-4b28-8f45-3c78cfeb146b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:19:42.118641 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b11606-c7e0-4b28-8f45-3c78cfeb146b admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:19:42.140557 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1391/2789] 10.222.0.36 () {60 vars in 1143 bytes} [Fri Jun 24 23:19:42 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 23:19:42.145504 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5946589-2e89-4687-879e-d43dabde707a admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:19:42.155958 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5946589-2e89-4687-879e-d43dabde707a admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:19:42.161502 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4714f00-5160-47f2-8520-d9f7d0280eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:19:42.162163 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4714f00-5160-47f2-8520-d9f7d0280eef admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:19:42.162446 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4714f00-5160-47f2-8520-d9f7d0280eef admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:19:42.162736 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4714f00-5160-47f2-8520-d9f7d0280eef admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:19:42.163469 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4714f00-5160-47f2-8520-d9f7d0280eef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:19:42.165062 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4714f00-5160-47f2-8520-d9f7d0280eef admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:19:42.176642 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1399/2790] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 23:19:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 23:19:42.182231 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b11606-c7e0-4b28-8f45-3c78cfeb146b admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:19:42.193296 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b11606-c7e0-4b28-8f45-3c78cfeb146b admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:19:42.199243 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3d9870-c6d1-476a-908b-2332be040c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:19:42.199943 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d9870-c6d1-476a-908b-2332be040c91 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:19:42.200235 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d9870-c6d1-476a-908b-2332be040c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:19:42.200511 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d9870-c6d1-476a-908b-2332be040c91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:19:42.201240 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3d9870-c6d1-476a-908b-2332be040c91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:19:42.202844 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3d9870-c6d1-476a-908b-2332be040c91 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:19:42.214312 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1392/2791] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 23:19:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 23:19:42.218577 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4714f00-5160-47f2-8520-d9f7d0280eef admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:19:42.229029 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4714f00-5160-47f2-8520-d9f7d0280eef admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:19:42.235500 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213ee4c6-ab0d-4aa0-a0d6-2387b043ee11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:19:42.236518 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213ee4c6-ab0d-4aa0-a0d6-2387b043ee11 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:19:42.236793 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213ee4c6-ab0d-4aa0-a0d6-2387b043ee11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:19:42.237091 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213ee4c6-ab0d-4aa0-a0d6-2387b043ee11 admin admin] PATH_INFO: `/v3/projects/fa76b2d777db41cc93e9840a267b4d52/users/419a8f043e934d1399c4e5a1ec6604e2/roles/1928787bfcc745419829cd315900ac44` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:19:42.254064 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213ee4c6-ab0d-4aa0-a0d6-2387b043ee11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa76b2d777db41cc93e9840a267b4d52, user_id=419a8f043e934d1399c4e5a1ec6604e2, role_id=1928787bfcc745419829cd315900ac44)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:19:42.256811 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213ee4c6-ab0d-4aa0-a0d6-2387b043ee11 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:19:42.274990 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1400/2792] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 23:19:42 2022] PUT /identity/v3/projects/fa76b2d777db41cc93e9840a267b4d52/users/419a8f043e934d1399c4e5a1ec6604e2/roles/1928787bfcc745419829cd315900ac44 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 23:19:42.285570 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d8b6d0-55b0-4827-b7fd-d4c19f131053 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:19:42.285859 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d8b6d0-55b0-4827-b7fd-d4c19f131053 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:19:42.286134 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d8b6d0-55b0-4827-b7fd-d4c19f131053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:19:42.314053 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-00d8b6d0-55b0-4827-b7fd-d4c19f131053 None None] MFA Rules not processed for user `419a8f043e934d1399c4e5a1ec6604e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 23:19:42.315261 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-00d8b6d0-55b0-4827-b7fd-d4c19f131053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:19:42.334285 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:19:42.384009 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1393/2793] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 23:19:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 23:19:42.395666 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213ee4c6-ab0d-4aa0-a0d6-2387b043ee11 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:19:42.397519 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-213ee4c6-ab0d-4aa0-a0d6-2387b043ee11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:19:42.458396 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213ee4c6-ab0d-4aa0-a0d6-2387b043ee11 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:19:42.462698 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99b1349-ad48-4b50-bfbb-16fa6f2ec3e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a747e2a5684843a6ee9e3480badac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:19:42.463511 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99b1349-ad48-4b50-bfbb-16fa6f2ec3e5 service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:19:42.463792 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99b1349-ad48-4b50-bfbb-16fa6f2ec3e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:19:42.464057 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99b1349-ad48-4b50-bfbb-16fa6f2ec3e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:19:42.472981 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99b1349-ad48-4b50-bfbb-16fa6f2ec3e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:19:42.474588 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99b1349-ad48-4b50-bfbb-16fa6f2ec3e5 service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:19:42.488310 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1401/2794] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:19:42 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:19:42.512336 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d8b6d0-55b0-4827-b7fd-d4c19f131053 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:19:42.579102 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d8b6d0-55b0-4827-b7fd-d4c19f131053 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:19:42.584553 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c85c79-6bbf-4454-b4a1-b0f7f4f88fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:19:42.585410 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c85c79-6bbf-4454-b4a1-b0f7f4f88fe7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:19:42.585694 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c85c79-6bbf-4454-b4a1-b0f7f4f88fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:19:42.585966 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c85c79-6bbf-4454-b4a1-b0f7f4f88fe7 admin admin] PATH_INFO: `/v3/users/419a8f043e934d1399c4e5a1ec6604e2` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:19:42.587290 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c85c79-6bbf-4454-b4a1-b0f7f4f88fe7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=419a8f043e934d1399c4e5a1ec6604e2)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:19:42.589253 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c85c79-6bbf-4454-b4a1-b0f7f4f88fe7 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:19:42.649411 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-80c85c79-6bbf-4454-b4a1-b0f7f4f88fe7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '419a8f043e934d1399c4e5a1ec6604e2'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:19:42.656549 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-80c85c79-6bbf-4454-b4a1-b0f7f4f88fe7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '419a8f043e934d1399c4e5a1ec6604e2'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:19:42.657231 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-80c85c79-6bbf-4454-b4a1-b0f7f4f88fe7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '419a8f043e934d1399c4e5a1ec6604e2'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:19:42.657850 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-80c85c79-6bbf-4454-b4a1-b0f7f4f88fe7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '419a8f043e934d1399c4e5a1ec6604e2'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:19:42.669932 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-80c85c79-6bbf-4454-b4a1-b0f7f4f88fe7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '419a8f043e934d1399c4e5a1ec6604e2'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:19:42.685833 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1394/2795] 10.222.0.36 () {58 vars in 1223 bytes} [Fri Jun 24 23:19:42 2022] DELETE /identity/v3/users/419a8f043e934d1399c4e5a1ec6604e2 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 23:19:42.690907 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2338e2a1-b56b-47a1-8899-d065a5110b93 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:19:42.691406 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2338e2a1-b56b-47a1-8899-d065a5110b93 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:19:42.691557 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2338e2a1-b56b-47a1-8899-d065a5110b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:19:42.710235 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-2338e2a1-b56b-47a1-8899-d065a5110b93 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 23:19:42.711767 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-2338e2a1-b56b-47a1-8899-d065a5110b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:19:42.778080 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1402/2796] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 23:19:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 23:19:42.788207 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c85c79-6bbf-4454-b4a1-b0f7f4f88fe7 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:19:42.789765 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-80c85c79-6bbf-4454-b4a1-b0f7f4f88fe7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:19:42.833064 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:19:42.853954 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c85c79-6bbf-4454-b4a1-b0f7f4f88fe7 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:19:42.859746 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc548574-a506-4c69-9909-1984f202754f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:19:42.861113 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc548574-a506-4c69-9909-1984f202754f service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:19:42.861490 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc548574-a506-4c69-9909-1984f202754f service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:19:42.861867 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc548574-a506-4c69-9909-1984f202754f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:19:42.872774 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc548574-a506-4c69-9909-1984f202754f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:19:42.874315 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc548574-a506-4c69-9909-1984f202754f service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:19:42.885707 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1395/2797] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:19:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:19:43.178213 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2338e2a1-b56b-47a1-8899-d065a5110b93 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:19:43.179930 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-2338e2a1-b56b-47a1-8899-d065a5110b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:19:43.192894 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2338e2a1-b56b-47a1-8899-d065a5110b93 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:19:43.197748 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d1f809-d1e8-4986-b0c2-851a396d5eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:19:43.198628 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d1f809-d1e8-4986-b0c2-851a396d5eb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:19:43.198878 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d1f809-d1e8-4986-b0c2-851a396d5eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:19:43.199186 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d1f809-d1e8-4986-b0c2-851a396d5eb0 admin admin] PATH_INFO: `/v3/projects/fa76b2d777db41cc93e9840a267b4d52` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:19:43.200424 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d1f809-d1e8-4986-b0c2-851a396d5eb0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa76b2d777db41cc93e9840a267b4d52)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:19:43.202359 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d1f809-d1e8-4986-b0c2-851a396d5eb0 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:19:43.249052 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:19:43.256010 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-94d1f809-d1e8-4986-b0c2-851a396d5eb0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa76b2d777db41cc93e9840a267b4d52', 'request_id': 'req-94d1f809-d1e8-4986-b0c2-851a396d5eb0'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:19:43.265979 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-94d1f809-d1e8-4986-b0c2-851a396d5eb0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa76b2d777db41cc93e9840a267b4d52', 'request_id': 'req-94d1f809-d1e8-4986-b0c2-851a396d5eb0'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:19:43.276292 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-94d1f809-d1e8-4986-b0c2-851a396d5eb0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa76b2d777db41cc93e9840a267b4d52', 'request_id': 'req-94d1f809-d1e8-4986-b0c2-851a396d5eb0'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:19:43.286880 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-94d1f809-d1e8-4986-b0c2-851a396d5eb0 admin admin] The token cache is being invalidate because project fa76b2d777db41cc93e9840a267b4d52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 23:19:43.287180 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-94d1f809-d1e8-4986-b0c2-851a396d5eb0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:19:43.287815 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-94d1f809-d1e8-4986-b0c2-851a396d5eb0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:19:43.289324 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1403/2798] 10.222.0.36 () {58 vars in 1232 bytes} [Fri Jun 24 23:19:43 2022] DELETE /identity/v3/projects/fa76b2d777db41cc93e9840a267b4d52 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 23:19:43.294499 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9aecf0-146d-421b-89a0-07aa754d58f2 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:19:43.294794 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9aecf0-146d-421b-89a0-07aa754d58f2 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:19:43.295101 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9aecf0-146d-421b-89a0-07aa754d58f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:19:43.313986 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-3d9aecf0-146d-421b-89a0-07aa754d58f2 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 23:19:43.315506 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-3d9aecf0-146d-421b-89a0-07aa754d58f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:19:43.386718 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1396/2799] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 23:19:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 23:19:43.398372 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13656bf2-1e8c-4ed7-aa04-e99ab11166de None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:19:43.398662 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13656bf2-1e8c-4ed7-aa04-e99ab11166de None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:19:43.398945 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13656bf2-1e8c-4ed7-aa04-e99ab11166de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:19:43.419063 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-13656bf2-1e8c-4ed7-aa04-e99ab11166de None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 23:19:43.420236 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-13656bf2-1e8c-4ed7-aa04-e99ab11166de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:19:43.429736 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1404/2800] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 23:19:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 23:19:43.434593 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9aecf0-146d-421b-89a0-07aa754d58f2 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:19:43.445498 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9aecf0-146d-421b-89a0-07aa754d58f2 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:19:43.451207 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5ae0f8-e156-470d-8175-f244ba51ad0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:19:43.451902 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5ae0f8-e156-470d-8175-f244ba51ad0f admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:19:43.452179 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5ae0f8-e156-470d-8175-f244ba51ad0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:19:43.452454 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5ae0f8-e156-470d-8175-f244ba51ad0f admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:19:43.453183 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5ae0f8-e156-470d-8175-f244ba51ad0f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 23:19:43.453483 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5ae0f8-e156-470d-8175-f244ba51ad0f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:19:43.455087 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5ae0f8-e156-470d-8175-f244ba51ad0f admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:19:43.467567 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1397/2801] 10.222.0.36 () {58 vars in 1152 bytes} [Fri Jun 24 23:19:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 23:19:43.472290 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13656bf2-1e8c-4ed7-aa04-e99ab11166de None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:19:43.481878 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13656bf2-1e8c-4ed7-aa04-e99ab11166de None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:19:43.487173 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2885606c-3d18-4ff7-b0e3-66602d5575d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:19:43.487855 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2885606c-3d18-4ff7-b0e3-66602d5575d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:19:43.488133 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2885606c-3d18-4ff7-b0e3-66602d5575d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:19:43.488404 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2885606c-3d18-4ff7-b0e3-66602d5575d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:19:43.489092 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2885606c-3d18-4ff7-b0e3-66602d5575d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:19:43.491003 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2885606c-3d18-4ff7-b0e3-66602d5575d0 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:19:43.520268 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1405/2802] 10.222.0.36 () {60 vars in 1152 bytes} [Fri Jun 24 23:19:43 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 23:19:43.524732 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5ae0f8-e156-470d-8175-f244ba51ad0f admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:19:43.535344 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5ae0f8-e156-470d-8175-f244ba51ad0f admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:19:43.593177 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab122a9-5cae-491a-80f6-c3263bec8d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:19:43.593837 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab122a9-5cae-491a-80f6-c3263bec8d73 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:19:43.594144 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab122a9-5cae-491a-80f6-c3263bec8d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:19:43.594418 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab122a9-5cae-491a-80f6-c3263bec8d73 admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:19:43.595105 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab122a9-5cae-491a-80f6-c3263bec8d73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:19:43.597271 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab122a9-5cae-491a-80f6-c3263bec8d73 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:19:43.621292 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1398/2803] 10.222.0.36 () {60 vars in 1143 bytes} [Fri Jun 24 23:19:43 2022] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 23:19:43.625760 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2885606c-3d18-4ff7-b0e3-66602d5575d0 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:19:43.636231 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2885606c-3d18-4ff7-b0e3-66602d5575d0 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:19:43.641084 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab106aa5-4029-4354-913f-1f78672f4997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:19:43.641756 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab106aa5-4029-4354-913f-1f78672f4997 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:19:43.642041 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab106aa5-4029-4354-913f-1f78672f4997 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:19:43.642316 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab106aa5-4029-4354-913f-1f78672f4997 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:19:43.643080 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab106aa5-4029-4354-913f-1f78672f4997 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:19:43.644724 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab106aa5-4029-4354-913f-1f78672f4997 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:19:43.656162 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1406/2804] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 23:19:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 23:19:43.660793 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab122a9-5cae-491a-80f6-c3263bec8d73 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:19:43.670897 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab122a9-5cae-491a-80f6-c3263bec8d73 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:19:43.675634 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb0a446-7834-49db-ab8a-50adfb33662e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:19:43.676285 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb0a446-7834-49db-ab8a-50adfb33662e admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:19:43.676567 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb0a446-7834-49db-ab8a-50adfb33662e admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:19:43.676838 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb0a446-7834-49db-ab8a-50adfb33662e admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:19:43.677569 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb0a446-7834-49db-ab8a-50adfb33662e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:19:43.679164 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb0a446-7834-49db-ab8a-50adfb33662e admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:19:43.689223 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1399/2805] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 23:19:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 23:19:43.693857 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab106aa5-4029-4354-913f-1f78672f4997 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:19:43.710088 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab106aa5-4029-4354-913f-1f78672f4997 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:19:43.717001 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a62e6e-fefd-4cc8-9ac1-4021377f13dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:19:43.717937 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a62e6e-fefd-4cc8-9ac1-4021377f13dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:19:43.718217 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a62e6e-fefd-4cc8-9ac1-4021377f13dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:19:43.718491 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a62e6e-fefd-4cc8-9ac1-4021377f13dd admin admin] PATH_INFO: `/v3/projects/96d106a806404b54805479d17b5e0381/users/2e342a7070c043ceb4de68c9051111cf/roles/1928787bfcc745419829cd315900ac44` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:19:43.735419 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a62e6e-fefd-4cc8-9ac1-4021377f13dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=96d106a806404b54805479d17b5e0381, user_id=2e342a7070c043ceb4de68c9051111cf, role_id=1928787bfcc745419829cd315900ac44)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:19:43.738208 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a62e6e-fefd-4cc8-9ac1-4021377f13dd admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:19:43.754202 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1407/2806] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 23:19:43 2022] PUT /identity/v3/projects/96d106a806404b54805479d17b5e0381/users/2e342a7070c043ceb4de68c9051111cf/roles/1928787bfcc745419829cd315900ac44 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 23:19:43.759461 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bdd85c-94a9-457c-8bbc-220dcab096a4 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:19:43.759758 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bdd85c-94a9-457c-8bbc-220dcab096a4 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:19:43.760041 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bdd85c-94a9-457c-8bbc-220dcab096a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:19:43.779109 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-f7bdd85c-94a9-457c-8bbc-220dcab096a4 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 23:19:43.780364 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-f7bdd85c-94a9-457c-8bbc-220dcab096a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:19:43.830031 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:19:43.846968 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1400/2807] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 23:19:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 23:19:43.856665 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a62e6e-fefd-4cc8-9ac1-4021377f13dd admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:19:43.858447 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-39a62e6e-fefd-4cc8-9ac1-4021377f13dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:19:43.924429 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a62e6e-fefd-4cc8-9ac1-4021377f13dd admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:19:43.928816 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d41d796-935f-4ab0-b1cf-385f17891d23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:19:43.929629 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d41d796-935f-4ab0-b1cf-385f17891d23 service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:19:43.929910 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d41d796-935f-4ab0-b1cf-385f17891d23 service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:19:43.930190 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d41d796-935f-4ab0-b1cf-385f17891d23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:19:43.939989 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d41d796-935f-4ab0-b1cf-385f17891d23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:19:43.941469 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d41d796-935f-4ab0-b1cf-385f17891d23 service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:19:43.952149 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1408/2808] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:19:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:19:44.596610 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67335e6a-bb47-4a62-b30d-173d2287079d None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:19:44.596918 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67335e6a-bb47-4a62-b30d-173d2287079d None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:19:44.597198 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67335e6a-bb47-4a62-b30d-173d2287079d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:19:44.624635 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-67335e6a-bb47-4a62-b30d-173d2287079d None None] MFA Rules not processed for user `2e342a7070c043ceb4de68c9051111cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 23:19:44.625860 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-67335e6a-bb47-4a62-b30d-173d2287079d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:19:44.694110 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1401/2809] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 23:19:44 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 23:19:44.704974 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d41d796-935f-4ab0-b1cf-385f17891d23 service neutron] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:19:44.707322 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-2d41d796-935f-4ab0-b1cf-385f17891d23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:19:44.767059 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d41d796-935f-4ab0-b1cf-385f17891d23 service neutron] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:19:44.771519 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38184d2-ae6a-488b-a107-78de748ea406 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a747e2a5684843a6ee9e3480badac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:19:44.772184 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38184d2-ae6a-488b-a107-78de748ea406 service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:19:44.772469 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38184d2-ae6a-488b-a107-78de748ea406 service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:19:44.772741 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38184d2-ae6a-488b-a107-78de748ea406 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:19:44.780948 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38184d2-ae6a-488b-a107-78de748ea406 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:19:44.782418 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38184d2-ae6a-488b-a107-78de748ea406 service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:19:44.792722 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1409/2810] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:19:44 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:19:46.156114 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e8c53-98c2-4498-ba96-a0d5c072fb00 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:19:46.156657 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e8c53-98c2-4498-ba96-a0d5c072fb00 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:19:46.156657 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e8c53-98c2-4498-ba96-a0d5c072fb00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:19:46.176787 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-096e8c53-98c2-4498-ba96-a0d5c072fb00 None None] MFA Rules not processed for user `2e342a7070c043ceb4de68c9051111cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 23:19:46.178002 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-096e8c53-98c2-4498-ba96-a0d5c072fb00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:19:46.186203 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1402/2811] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 23:19:46 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 23:19:54.789195 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=88,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:19:56.169934 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=40 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:20:01.648950 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d3d9d6-8914-4c06-9b4c-33963bde550a None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:20:01.649540 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d3d9d6-8914-4c06-9b4c-33963bde550a None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:20:01.649540 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d3d9d6-8914-4c06-9b4c-33963bde550a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:20:01.667860 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-b5d3d9d6-8914-4c06-9b4c-33963bde550a None None] MFA Rules not processed for user `2e342a7070c043ceb4de68c9051111cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 23:20:01.669149 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-b5d3d9d6-8914-4c06-9b4c-33963bde550a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:20:01.677004 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1410/2812] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 23:20:01 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 23:20:11.662482 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=3 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:20:16.780055 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e8c53-98c2-4498-ba96-a0d5c072fb00 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:20:16.781816 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-096e8c53-98c2-4498-ba96-a0d5c072fb00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:20:16.798015 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e8c53-98c2-4498-ba96-a0d5c072fb00 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:20:16.801827 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f487844-8724-4a27-8cd4-cc481ca26ede service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a747e2a5684843a6ee9e3480badac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:20:16.802488 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f487844-8724-4a27-8cd4-cc481ca26ede service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:20:16.802790 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f487844-8724-4a27-8cd4-cc481ca26ede service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:20:16.803062 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f487844-8724-4a27-8cd4-cc481ca26ede service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:20:16.805014 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-5f487844-8724-4a27-8cd4-cc481ca26ede service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:20:16.883209 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f487844-8724-4a27-8cd4-cc481ca26ede service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:20:16.884792 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f487844-8724-4a27-8cd4-cc481ca26ede service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:20:16.895235 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1403/2813] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:20:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 23:20:22.681801 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b5bfd3-51fd-4eec-814b-4b94d5a48d4c None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:20:22.682303 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b5bfd3-51fd-4eec-814b-4b94d5a48d4c None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:20:22.682478 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b5bfd3-51fd-4eec-814b-4b94d5a48d4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:20:22.744042 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-18b5bfd3-51fd-4eec-814b-4b94d5a48d4c None None] MFA Rules not processed for user `542ea2e5a8114792836d0cdfd36b4c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 23:20:22.745179 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-18b5bfd3-51fd-4eec-814b-4b94d5a48d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:20:22.818218 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1411/2814] 10.222.0.36 () {58 vars in 1009 bytes} [Fri Jun 24 23:20:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 23:20:22.868996 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f487844-8724-4a27-8cd4-cc481ca26ede service cinder] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:20:22.870467 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-5f487844-8724-4a27-8cd4-cc481ca26ede service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:20:22.972527 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f487844-8724-4a27-8cd4-cc481ca26ede service cinder] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:20:22.979906 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c263deb6-9b35-4227-b4ec-1e1b77d9aba4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b95846f7f2a453f85ddb41a5d3327f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:20:22.980914 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c263deb6-9b35-4227-b4ec-1e1b77d9aba4 service swift] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:20:22.981346 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c263deb6-9b35-4227-b4ec-1e1b77d9aba4 service swift] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:20:22.981747 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c263deb6-9b35-4227-b4ec-1e1b77d9aba4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:20:22.991595 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c263deb6-9b35-4227-b4ec-1e1b77d9aba4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:20:22.993202 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c263deb6-9b35-4227-b4ec-1e1b77d9aba4 service swift] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:20:23.001812 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1404/2815] 10.222.0.36 () {60 vars in 1384 bytes} [Fri Jun 24 23:20:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 23:20:32.814946 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=44 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:20:32.998330 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=74 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:20:32.999872 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b5bfd3-51fd-4eec-814b-4b94d5a48d4c None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:20:33.001630 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-18b5bfd3-51fd-4eec-814b-4b94d5a48d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:20:33.014473 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b5bfd3-51fd-4eec-814b-4b94d5a48d4c None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:20:33.018723 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98876404-34c0-4443-b374-7faf3de823e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:20:33.019520 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98876404-34c0-4443-b374-7faf3de823e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:20:33.019866 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98876404-34c0-4443-b374-7faf3de823e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:20:33.020207 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98876404-34c0-4443-b374-7faf3de823e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:20:33.022049 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-98876404-34c0-4443-b374-7faf3de823e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:20:33.038781 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98876404-34c0-4443-b374-7faf3de823e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:20:33.040388 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98876404-34c0-4443-b374-7faf3de823e5 service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:20:33.054639 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1412/2816] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:20:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:20:36.589367 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c263deb6-9b35-4227-b4ec-1e1b77d9aba4 service swift] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:20:36.598952 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-c263deb6-9b35-4227-b4ec-1e1b77d9aba4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:20:36.657556 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98876404-34c0-4443-b374-7faf3de823e5 service neutron] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:20:36.658992 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-98876404-34c0-4443-b374-7faf3de823e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:20:36.672051 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98876404-34c0-4443-b374-7faf3de823e5 service neutron] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:20:36.676833 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834fe246-2241-49d0-941c-9062ae82bd89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:20:36.677831 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834fe246-2241-49d0-941c-9062ae82bd89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:20:36.678213 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834fe246-2241-49d0-941c-9062ae82bd89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:20:36.678551 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834fe246-2241-49d0-941c-9062ae82bd89 admin admin] PATH_INFO: `/v3/users/d38e573b57c147afa87ba5aceb21f73b` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:20:36.680000 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834fe246-2241-49d0-941c-9062ae82bd89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d38e573b57c147afa87ba5aceb21f73b)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:20:36.681949 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834fe246-2241-49d0-941c-9062ae82bd89 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:20:36.687401 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c263deb6-9b35-4227-b4ec-1e1b77d9aba4 service swift] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:20:36.693123 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ca9233-0a73-4269-9dad-d1f14408a3da service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0233b357708643be94c0ade17ac1fb3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:20:36.693785 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ca9233-0a73-4269-9dad-d1f14408a3da service placement] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:20:36.694072 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ca9233-0a73-4269-9dad-d1f14408a3da service placement] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:20:36.694380 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ca9233-0a73-4269-9dad-d1f14408a3da service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:20:36.696237 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-e3ca9233-0a73-4269-9dad-d1f14408a3da service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:20:36.708898 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ca9233-0a73-4269-9dad-d1f14408a3da service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:20:36.710647 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ca9233-0a73-4269-9dad-d1f14408a3da service placement] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:20:36.722631 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1405/2817] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:20:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:20:36.730946 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-834fe246-2241-49d0-941c-9062ae82bd89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd38e573b57c147afa87ba5aceb21f73b'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:20:36.739334 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-834fe246-2241-49d0-941c-9062ae82bd89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd38e573b57c147afa87ba5aceb21f73b'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:20:36.740044 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-834fe246-2241-49d0-941c-9062ae82bd89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd38e573b57c147afa87ba5aceb21f73b'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:20:36.740955 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-834fe246-2241-49d0-941c-9062ae82bd89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd38e573b57c147afa87ba5aceb21f73b'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:20:36.753606 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-834fe246-2241-49d0-941c-9062ae82bd89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd38e573b57c147afa87ba5aceb21f73b'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:20:36.769400 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1413/2818] 10.222.0.36 () {58 vars in 1223 bytes} [Fri Jun 24 23:20:36 2022] DELETE /identity/v3/users/d38e573b57c147afa87ba5aceb21f73b => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 23:20:36.958457 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ca9233-0a73-4269-9dad-d1f14408a3da service placement] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:20:36.974849 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ca9233-0a73-4269-9dad-d1f14408a3da service placement] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:20:37.033224 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3792affb-94a0-48db-b3c5-570b1c074aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:20:37.034101 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3792affb-94a0-48db-b3c5-570b1c074aea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:20:37.034382 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3792affb-94a0-48db-b3c5-570b1c074aea admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:20:37.034653 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3792affb-94a0-48db-b3c5-570b1c074aea admin admin] PATH_INFO: `/v3/projects/3cf68a4d73974192b73fb0b7495d4821` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:20:37.045269 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3792affb-94a0-48db-b3c5-570b1c074aea admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cf68a4d73974192b73fb0b7495d4821)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:20:37.047209 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3792affb-94a0-48db-b3c5-570b1c074aea admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:20:37.096843 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-3792affb-94a0-48db-b3c5-570b1c074aea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cf68a4d73974192b73fb0b7495d4821', 'request_id': 'req-3792affb-94a0-48db-b3c5-570b1c074aea'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:20:37.106414 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-3792affb-94a0-48db-b3c5-570b1c074aea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cf68a4d73974192b73fb0b7495d4821', 'request_id': 'req-3792affb-94a0-48db-b3c5-570b1c074aea'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:20:37.116817 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-3792affb-94a0-48db-b3c5-570b1c074aea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cf68a4d73974192b73fb0b7495d4821', 'request_id': 'req-3792affb-94a0-48db-b3c5-570b1c074aea'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:20:37.129153 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-3792affb-94a0-48db-b3c5-570b1c074aea admin admin] The token cache is being invalidate because project 3cf68a4d73974192b73fb0b7495d4821 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 23:20:37.129442 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-3792affb-94a0-48db-b3c5-570b1c074aea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:20:37.130107 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-3792affb-94a0-48db-b3c5-570b1c074aea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:20:37.131992 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1406/2819] 10.222.0.36 () {58 vars in 1232 bytes} [Fri Jun 24 23:20:36 2022] DELETE /identity/v3/projects/3cf68a4d73974192b73fb0b7495d4821 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 23:20:37.142073 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0fdd6d-3403-4c49-946f-fd8f0f3ec4ba None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:20:37.142374 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0fdd6d-3403-4c49-946f-fd8f0f3ec4ba None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:20:37.142651 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0fdd6d-3403-4c49-946f-fd8f0f3ec4ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:20:37.161754 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-de0fdd6d-3403-4c49-946f-fd8f0f3ec4ba None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 23:20:37.162979 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-de0fdd6d-3403-4c49-946f-fd8f0f3ec4ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:20:37.226908 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1414/2820] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 23:20:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 23:20:37.235358 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db67aee1-3659-40da-b7da-17763d4dbd87 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:20:37.235652 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db67aee1-3659-40da-b7da-17763d4dbd87 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:20:37.235930 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db67aee1-3659-40da-b7da-17763d4dbd87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:20:37.254551 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-db67aee1-3659-40da-b7da-17763d4dbd87 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 23:20:37.255830 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-db67aee1-3659-40da-b7da-17763d4dbd87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:20:37.268132 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1407/2821] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 23:20:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 23:20:37.269513 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0fdd6d-3403-4c49-946f-fd8f0f3ec4ba None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:20:37.279706 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0fdd6d-3403-4c49-946f-fd8f0f3ec4ba None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:20:37.284323 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ca817b-313a-4c28-9a7e-ee0e92d1a334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:20:37.284986 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca817b-313a-4c28-9a7e-ee0e92d1a334 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:20:37.285273 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca817b-313a-4c28-9a7e-ee0e92d1a334 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:20:37.285553 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca817b-313a-4c28-9a7e-ee0e92d1a334 admin admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:20:37.286286 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ca817b-313a-4c28-9a7e-ee0e92d1a334 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 23:20:37.286601 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ca817b-313a-4c28-9a7e-ee0e92d1a334 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:20:37.288271 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ca817b-313a-4c28-9a7e-ee0e92d1a334 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:20:37.299922 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1415/2822] 10.222.0.36 () {58 vars in 1152 bytes} [Fri Jun 24 23:20:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 23:20:37.304300 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db67aee1-3659-40da-b7da-17763d4dbd87 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:20:37.310144 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:20:37.314836 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db67aee1-3659-40da-b7da-17763d4dbd87 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:20:37.321812 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ade195-d610-4d61-a45a-e60a3ef167b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:20:37.322479 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ade195-d610-4d61-a45a-e60a3ef167b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:20:37.322762 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ade195-d610-4d61-a45a-e60a3ef167b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:20:37.323042 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ade195-d610-4d61-a45a-e60a3ef167b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:20:37.323996 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ade195-d610-4d61-a45a-e60a3ef167b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:20:37.326499 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ade195-d610-4d61-a45a-e60a3ef167b9 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:20:37.354673 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1408/2823] 10.222.0.36 () {60 vars in 1152 bytes} [Fri Jun 24 23:20:37 2022] POST /identity/v3/projects => generated 367 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 23:20:37.359099 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ca817b-313a-4c28-9a7e-ee0e92d1a334 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:20:37.369716 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ca817b-313a-4c28-9a7e-ee0e92d1a334 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:20:37.414323 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:20:37.429914 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8277c7e1-b43e-4e94-b552-6a00a9212079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:20:37.430627 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8277c7e1-b43e-4e94-b552-6a00a9212079 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:20:37.430912 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8277c7e1-b43e-4e94-b552-6a00a9212079 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:20:37.431191 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8277c7e1-b43e-4e94-b552-6a00a9212079 admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:20:37.431964 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8277c7e1-b43e-4e94-b552-6a00a9212079 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:20:37.433908 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8277c7e1-b43e-4e94-b552-6a00a9212079 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:20:37.458621 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1416/2824] 10.222.0.36 () {60 vars in 1143 bytes} [Fri Jun 24 23:20:37 2022] POST /identity/v3/users => generated 284 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 23:20:37.460235 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ade195-d610-4d61-a45a-e60a3ef167b9 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:20:37.470660 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ade195-d610-4d61-a45a-e60a3ef167b9 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:20:37.475547 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b590e791-73f1-4324-99be-020682d926f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:20:37.476206 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b590e791-73f1-4324-99be-020682d926f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:20:37.476492 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b590e791-73f1-4324-99be-020682d926f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:20:37.476768 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b590e791-73f1-4324-99be-020682d926f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:20:37.477505 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b590e791-73f1-4324-99be-020682d926f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:20:37.479214 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b590e791-73f1-4324-99be-020682d926f2 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:20:37.489671 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1409/2825] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 23:20:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 23:20:37.493566 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8277c7e1-b43e-4e94-b552-6a00a9212079 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:20:37.504917 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8277c7e1-b43e-4e94-b552-6a00a9212079 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:20:37.510714 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720aa822-0b8d-4670-9465-bceda0c1214e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:20:37.511630 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720aa822-0b8d-4670-9465-bceda0c1214e admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:20:37.511920 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720aa822-0b8d-4670-9465-bceda0c1214e admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:20:37.512222 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720aa822-0b8d-4670-9465-bceda0c1214e admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:20:37.512985 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720aa822-0b8d-4670-9465-bceda0c1214e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:20:37.514873 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720aa822-0b8d-4670-9465-bceda0c1214e admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:20:37.526528 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1417/2826] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 23:20:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 23:20:37.531132 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b590e791-73f1-4324-99be-020682d926f2 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:20:37.541384 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b590e791-73f1-4324-99be-020682d926f2 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:20:37.546642 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a728d0-bb2c-4473-b486-9f5eeb58e195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:20:37.547573 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a728d0-bb2c-4473-b486-9f5eeb58e195 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:20:37.547852 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a728d0-bb2c-4473-b486-9f5eeb58e195 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:20:37.548123 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a728d0-bb2c-4473-b486-9f5eeb58e195 admin admin] PATH_INFO: `/v3/projects/b5d928638dbd49ef80f4401b5b705c0a/users/e389a617365e44079648928fa1917497/roles/1928787bfcc745419829cd315900ac44` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:20:37.565272 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a728d0-bb2c-4473-b486-9f5eeb58e195 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5d928638dbd49ef80f4401b5b705c0a, user_id=e389a617365e44079648928fa1917497, role_id=1928787bfcc745419829cd315900ac44)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:20:37.568356 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a728d0-bb2c-4473-b486-9f5eeb58e195 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:20:37.583009 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1410/2827] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 23:20:37 2022] PUT /identity/v3/projects/b5d928638dbd49ef80f4401b5b705c0a/users/e389a617365e44079648928fa1917497/roles/1928787bfcc745419829cd315900ac44 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 23:20:37.593638 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27acb0ae-3a26-43cd-8119-5099badea405 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:20:37.593931 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27acb0ae-3a26-43cd-8119-5099badea405 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:20:37.594210 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27acb0ae-3a26-43cd-8119-5099badea405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:20:37.618167 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c526ea93-4213-4212-aac2-984875acb903 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:20:37.618650 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c526ea93-4213-4212-aac2-984875acb903 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:20:37.618825 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c526ea93-4213-4212-aac2-984875acb903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:20:37.620629 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-27acb0ae-3a26-43cd-8119-5099badea405 None None] MFA Rules not processed for user `e389a617365e44079648928fa1917497`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 23:20:37.621834 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-27acb0ae-3a26-43cd-8119-5099badea405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:20:37.636646 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-c526ea93-4213-4212-aac2-984875acb903 None None] MFA Rules not processed for user `542ea2e5a8114792836d0cdfd36b4c51`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 23:20:37.637823 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-c526ea93-4213-4212-aac2-984875acb903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:20:37.688130 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1418/2828] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 23:20:37 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 23:20:37.692509 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1411/2829] 10.222.0.36 () {58 vars in 967 bytes} [Fri Jun 24 23:20:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 23:20:37.692674 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27acb0ae-3a26-43cd-8119-5099badea405 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:20:37.705503 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c526ea93-4213-4212-aac2-984875acb903 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:20:37.706867 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-c526ea93-4213-4212-aac2-984875acb903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:20:37.756083 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27acb0ae-3a26-43cd-8119-5099badea405 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:20:37.760635 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d95de0f-08a5-4765-a487-ecea7f9b74db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:20:37.761316 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d95de0f-08a5-4765-a487-ecea7f9b74db admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:20:37.761602 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d95de0f-08a5-4765-a487-ecea7f9b74db admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:20:37.761874 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d95de0f-08a5-4765-a487-ecea7f9b74db admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:20:37.762555 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d95de0f-08a5-4765-a487-ecea7f9b74db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:20:37.764590 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d95de0f-08a5-4765-a487-ecea7f9b74db admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:20:37.776912 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c526ea93-4213-4212-aac2-984875acb903 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:20:37.782646 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73c20a9-8185-410d-9544-8856e47436c8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b95846f7f2a453f85ddb41a5d3327f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:20:37.783338 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c20a9-8185-410d-9544-8856e47436c8 service swift] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:20:37.783622 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c20a9-8185-410d-9544-8856e47436c8 service swift] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:20:37.783898 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c20a9-8185-410d-9544-8856e47436c8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:20:37.792049 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1419/2830] 10.222.0.36 () {60 vars in 1152 bytes} [Fri Jun 24 23:20:37 2022] POST /identity/v3/projects => generated 367 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 23:20:37.793463 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73c20a9-8185-410d-9544-8856e47436c8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:20:37.795548 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73c20a9-8185-410d-9544-8856e47436c8 service swift] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:20:37.796168 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d95de0f-08a5-4765-a487-ecea7f9b74db admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:20:37.804403 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1412/2831] 10.222.0.36 () {60 vars in 1384 bytes} [Fri Jun 24 23:20:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 24 23:20:37.839080 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:20:37.860761 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d95de0f-08a5-4765-a487-ecea7f9b74db admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:20:37.865710 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5520e3b9-42f5-4034-a00e-4702fda50295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:20:37.866506 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520e3b9-42f5-4034-a00e-4702fda50295 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:20:37.866659 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520e3b9-42f5-4034-a00e-4702fda50295 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:20:37.866931 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520e3b9-42f5-4034-a00e-4702fda50295 admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:20:37.867715 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5520e3b9-42f5-4034-a00e-4702fda50295 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:20:37.869692 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5520e3b9-42f5-4034-a00e-4702fda50295 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:20:37.895014 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1420/2832] 10.222.0.36 () {60 vars in 1143 bytes} [Fri Jun 24 23:20:37 2022] POST /identity/v3/users => generated 290 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 23:20:37.898965 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73c20a9-8185-410d-9544-8856e47436c8 service swift] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:20:37.910796 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73c20a9-8185-410d-9544-8856e47436c8 service swift] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:20:37.915955 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96bebff-d264-4a59-ac3b-a8f67591f3cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:20:37.916628 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96bebff-d264-4a59-ac3b-a8f67591f3cd admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:20:37.916914 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96bebff-d264-4a59-ac3b-a8f67591f3cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:20:37.917189 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96bebff-d264-4a59-ac3b-a8f67591f3cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:20:37.917919 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96bebff-d264-4a59-ac3b-a8f67591f3cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:20:37.919936 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96bebff-d264-4a59-ac3b-a8f67591f3cd admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:20:37.931270 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1413/2833] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 23:20:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 23:20:37.935983 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5520e3b9-42f5-4034-a00e-4702fda50295 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:20:37.946364 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5520e3b9-42f5-4034-a00e-4702fda50295 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:20:37.951137 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbadd781-09a8-402c-a921-ee973fab4de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:20:37.952070 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbadd781-09a8-402c-a921-ee973fab4de8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:20:37.952358 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbadd781-09a8-402c-a921-ee973fab4de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:20:37.952654 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbadd781-09a8-402c-a921-ee973fab4de8 admin admin] PATH_INFO: `/v3/projects/8a131b1d32ca4256a4903f882a8c2682/users/436bfc334ecb495b8295fd6dfa4ff0a6/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:20:37.968562 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbadd781-09a8-402c-a921-ee973fab4de8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a131b1d32ca4256a4903f882a8c2682, user_id=436bfc334ecb495b8295fd6dfa4ff0a6, role_id=1a1c43cc97a0407eb7a7c7a1333a9d4a)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:20:37.971382 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbadd781-09a8-402c-a921-ee973fab4de8 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:20:37.987449 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1421/2834] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 23:20:37 2022] PUT /identity/v3/projects/8a131b1d32ca4256a4903f882a8c2682/users/436bfc334ecb495b8295fd6dfa4ff0a6/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 23:20:37.992082 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96bebff-d264-4a59-ac3b-a8f67591f3cd admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:20:38.003109 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96bebff-d264-4a59-ac3b-a8f67591f3cd admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:20:38.036608 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:20:38.069651 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783c5b6c-dc20-4b60-bf0e-08122478b2c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:20:38.070418 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783c5b6c-dc20-4b60-bf0e-08122478b2c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:20:38.070798 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783c5b6c-dc20-4b60-bf0e-08122478b2c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:20:38.071082 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783c5b6c-dc20-4b60-bf0e-08122478b2c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:20:38.071862 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783c5b6c-dc20-4b60-bf0e-08122478b2c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:20:38.073827 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783c5b6c-dc20-4b60-bf0e-08122478b2c2 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:20:38.084645 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1414/2835] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 23:20:37 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 23:20:38.088985 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbadd781-09a8-402c-a921-ee973fab4de8 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:20:38.100442 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbadd781-09a8-402c-a921-ee973fab4de8 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:20:38.113167 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c978f270-5271-4c9a-9656-10c808c2e215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:20:38.114079 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c978f270-5271-4c9a-9656-10c808c2e215 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:20:38.114356 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c978f270-5271-4c9a-9656-10c808c2e215 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:20:38.114666 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c978f270-5271-4c9a-9656-10c808c2e215 admin admin] PATH_INFO: `/v3/projects/8a131b1d32ca4256a4903f882a8c2682/users/436bfc334ecb495b8295fd6dfa4ff0a6/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:20:38.116649 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c978f270-5271-4c9a-9656-10c808c2e215 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a131b1d32ca4256a4903f882a8c2682, user_id=436bfc334ecb495b8295fd6dfa4ff0a6, role_id=1a1c43cc97a0407eb7a7c7a1333a9d4a)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:20:38.119360 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c978f270-5271-4c9a-9656-10c808c2e215 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:20:38.130477 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1422/2836] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 23:20:38 2022] PUT /identity/v3/projects/8a131b1d32ca4256a4903f882a8c2682/users/436bfc334ecb495b8295fd6dfa4ff0a6/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 23:20:38.142477 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076aa8ba-7558-4d59-9024-41429141de9f None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:20:38.142864 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076aa8ba-7558-4d59-9024-41429141de9f None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:20:38.143146 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076aa8ba-7558-4d59-9024-41429141de9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:20:38.175922 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-076aa8ba-7558-4d59-9024-41429141de9f None None] MFA Rules not processed for user `436bfc334ecb495b8295fd6dfa4ff0a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 23:20:38.177146 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-076aa8ba-7558-4d59-9024-41429141de9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:20:38.257537 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1415/2837] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 23:20:38 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 23:20:38.273578 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c978f270-5271-4c9a-9656-10c808c2e215 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:20:38.275860 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-c978f270-5271-4c9a-9656-10c808c2e215 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:20:38.344309 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c978f270-5271-4c9a-9656-10c808c2e215 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:20:38.348302 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0e9fd8-fb63-44d8-9cc9-fefce70b7137 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a747e2a5684843a6ee9e3480badac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:20:38.348950 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0e9fd8-fb63-44d8-9cc9-fefce70b7137 service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:20:38.349233 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0e9fd8-fb63-44d8-9cc9-fefce70b7137 service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:20:38.349499 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0e9fd8-fb63-44d8-9cc9-fefce70b7137 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:20:38.359096 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0e9fd8-fb63-44d8-9cc9-fefce70b7137 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:20:38.360982 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0e9fd8-fb63-44d8-9cc9-fefce70b7137 service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:20:38.370707 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1423/2838] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:20:38 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:20:38.415988 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076aa8ba-7558-4d59-9024-41429141de9f None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:20:38.417664 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-076aa8ba-7558-4d59-9024-41429141de9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:20:38.430708 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076aa8ba-7558-4d59-9024-41429141de9f None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:20:38.435898 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31d0658-5514-4dfa-9894-2572ac1e30b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a747e2a5684843a6ee9e3480badac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:20:38.436570 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31d0658-5514-4dfa-9894-2572ac1e30b1 service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:20:38.436838 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31d0658-5514-4dfa-9894-2572ac1e30b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:20:38.437168 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31d0658-5514-4dfa-9894-2572ac1e30b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:20:38.503155 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31d0658-5514-4dfa-9894-2572ac1e30b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:20:38.504660 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31d0658-5514-4dfa-9894-2572ac1e30b1 service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:20:38.514288 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1416/2839] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:20:38 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:20:39.984886 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0e9fd8-fb63-44d8-9cc9-fefce70b7137 service cinder] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:20:39.987045 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-5f0e9fd8-fb63-44d8-9cc9-fefce70b7137 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:20:40.058689 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0e9fd8-fb63-44d8-9cc9-fefce70b7137 service cinder] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:20:40.064452 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ad9439-5646-4a4c-baa3-5e95734bdbde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:20:40.065352 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ad9439-5646-4a4c-baa3-5e95734bdbde admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:20:40.065633 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ad9439-5646-4a4c-baa3-5e95734bdbde admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:20:40.065905 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ad9439-5646-4a4c-baa3-5e95734bdbde admin admin] PATH_INFO: `/v3/users/2e342a7070c043ceb4de68c9051111cf` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:20:40.067202 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ad9439-5646-4a4c-baa3-5e95734bdbde admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e342a7070c043ceb4de68c9051111cf)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:20:40.069191 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ad9439-5646-4a4c-baa3-5e95734bdbde admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:20:40.114784 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:20:40.125302 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-b3ad9439-5646-4a4c-baa3-5e95734bdbde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e342a7070c043ceb4de68c9051111cf'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:20:40.133130 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-b3ad9439-5646-4a4c-baa3-5e95734bdbde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e342a7070c043ceb4de68c9051111cf'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:20:40.133819 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-b3ad9439-5646-4a4c-baa3-5e95734bdbde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e342a7070c043ceb4de68c9051111cf'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:20:40.134461 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-b3ad9439-5646-4a4c-baa3-5e95734bdbde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e342a7070c043ceb4de68c9051111cf'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:20:40.147090 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-b3ad9439-5646-4a4c-baa3-5e95734bdbde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e342a7070c043ceb4de68c9051111cf'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:20:40.160540 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1424/2840] 10.222.0.36 () {58 vars in 1223 bytes} [Fri Jun 24 23:20:39 2022] DELETE /identity/v3/users/2e342a7070c043ceb4de68c9051111cf => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 23:20:40.344687 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31d0658-5514-4dfa-9894-2572ac1e30b1 service cinder] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:20:40.361331 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31d0658-5514-4dfa-9894-2572ac1e30b1 service cinder] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:20:40.408390 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=100 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:20:40.418764 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb2593d-6f37-499b-862c-634efd88b7e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:20:40.419721 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb2593d-6f37-499b-862c-634efd88b7e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:20:40.420004 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb2593d-6f37-499b-862c-634efd88b7e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:20:40.420276 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb2593d-6f37-499b-862c-634efd88b7e8 admin admin] PATH_INFO: `/v3/projects/96d106a806404b54805479d17b5e0381` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:20:40.421500 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb2593d-6f37-499b-862c-634efd88b7e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96d106a806404b54805479d17b5e0381)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:20:40.423493 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb2593d-6f37-499b-862c-634efd88b7e8 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:20:40.472702 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-dfb2593d-6f37-499b-862c-634efd88b7e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96d106a806404b54805479d17b5e0381', 'request_id': 'req-dfb2593d-6f37-499b-862c-634efd88b7e8'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:20:40.478696 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-dfb2593d-6f37-499b-862c-634efd88b7e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96d106a806404b54805479d17b5e0381', 'request_id': 'req-dfb2593d-6f37-499b-862c-634efd88b7e8'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:20:40.489541 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-dfb2593d-6f37-499b-862c-634efd88b7e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96d106a806404b54805479d17b5e0381', 'request_id': 'req-dfb2593d-6f37-499b-862c-634efd88b7e8'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:20:40.502589 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-dfb2593d-6f37-499b-862c-634efd88b7e8 admin admin] The token cache is being invalidate because project 96d106a806404b54805479d17b5e0381 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 23:20:40.502878 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-dfb2593d-6f37-499b-862c-634efd88b7e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:20:40.503547 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-dfb2593d-6f37-499b-862c-634efd88b7e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:20:40.505129 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1417/2841] 10.222.0.36 () {58 vars in 1232 bytes} [Fri Jun 24 23:20:40 2022] DELETE /identity/v3/projects/96d106a806404b54805479d17b5e0381 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 23:20:40.510130 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8ebfeb-35d0-4d30-bb51-54d0873c4f4f None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:20:40.510422 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8ebfeb-35d0-4d30-bb51-54d0873c4f4f None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:20:40.510748 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8ebfeb-35d0-4d30-bb51-54d0873c4f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:20:40.528561 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-5e8ebfeb-35d0-4d30-bb51-54d0873c4f4f None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 23:20:40.529826 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-5e8ebfeb-35d0-4d30-bb51-54d0873c4f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:20:40.591174 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1425/2842] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 23:20:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 23:20:40.599632 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f58708-8b3e-4324-9e9b-59bbb60246b6 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:20:40.599995 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f58708-8b3e-4324-9e9b-59bbb60246b6 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:20:40.600335 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f58708-8b3e-4324-9e9b-59bbb60246b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:20:40.619690 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-46f58708-8b3e-4324-9e9b-59bbb60246b6 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 23:20:40.620900 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-46f58708-8b3e-4324-9e9b-59bbb60246b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:20:40.629611 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1418/2843] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 23:20:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 23:20:40.634446 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8ebfeb-35d0-4d30-bb51-54d0873c4f4f None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:20:40.649473 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8ebfeb-35d0-4d30-bb51-54d0873c4f4f None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:20:40.655762 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2813f8-b5d5-4254-b9bd-7527f6b0af82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:20:40.656422 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2813f8-b5d5-4254-b9bd-7527f6b0af82 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:20:40.656700 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2813f8-b5d5-4254-b9bd-7527f6b0af82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:20:40.656968 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2813f8-b5d5-4254-b9bd-7527f6b0af82 admin admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:20:40.657693 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2813f8-b5d5-4254-b9bd-7527f6b0af82 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 23:20:40.657996 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2813f8-b5d5-4254-b9bd-7527f6b0af82 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:20:40.659638 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2813f8-b5d5-4254-b9bd-7527f6b0af82 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:20:40.671485 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1426/2844] 10.222.0.36 () {58 vars in 1152 bytes} [Fri Jun 24 23:20:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 23:20:40.675776 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f58708-8b3e-4324-9e9b-59bbb60246b6 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:20:40.685718 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f58708-8b3e-4324-9e9b-59bbb60246b6 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:20:40.692554 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8134501-1e26-4bc0-9429-bb4a4d198282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:20:40.693531 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8134501-1e26-4bc0-9429-bb4a4d198282 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:20:40.693836 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8134501-1e26-4bc0-9429-bb4a4d198282 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:20:40.694218 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8134501-1e26-4bc0-9429-bb4a4d198282 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:20:40.695354 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8134501-1e26-4bc0-9429-bb4a4d198282 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:20:40.698502 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8134501-1e26-4bc0-9429-bb4a4d198282 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:20:40.736891 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1419/2845] 10.222.0.36 () {60 vars in 1152 bytes} [Fri Jun 24 23:20:40 2022] POST /identity/v3/projects => generated 385 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 23:20:40.740336 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2813f8-b5d5-4254-b9bd-7527f6b0af82 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:20:40.751267 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2813f8-b5d5-4254-b9bd-7527f6b0af82 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:20:40.809841 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b1ae27-7567-4f06-be3a-2c820e7fa481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:20:40.810568 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b1ae27-7567-4f06-be3a-2c820e7fa481 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:20:40.810867 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b1ae27-7567-4f06-be3a-2c820e7fa481 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:20:40.811230 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b1ae27-7567-4f06-be3a-2c820e7fa481 admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:20:40.811945 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b1ae27-7567-4f06-be3a-2c820e7fa481 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:20:40.813881 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b1ae27-7567-4f06-be3a-2c820e7fa481 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:20:40.835704 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1427/2846] 10.222.0.36 () {60 vars in 1143 bytes} [Fri Jun 24 23:20:40 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 23:20:40.839875 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8134501-1e26-4bc0-9429-bb4a4d198282 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:20:40.851032 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8134501-1e26-4bc0-9429-bb4a4d198282 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:20:40.856306 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0510fc-b7a0-4983-a6e3-40a1a065bf79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:20:40.856972 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0510fc-b7a0-4983-a6e3-40a1a065bf79 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:20:40.857272 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0510fc-b7a0-4983-a6e3-40a1a065bf79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:20:40.857546 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0510fc-b7a0-4983-a6e3-40a1a065bf79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:20:40.858277 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0510fc-b7a0-4983-a6e3-40a1a065bf79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:20:40.860288 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0510fc-b7a0-4983-a6e3-40a1a065bf79 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:20:40.871409 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1420/2847] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 23:20:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 23:20:40.875894 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b1ae27-7567-4f06-be3a-2c820e7fa481 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:20:40.887211 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b1ae27-7567-4f06-be3a-2c820e7fa481 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:20:40.893566 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59ae141-bb1d-4e51-bcff-89238f3d998b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:20:40.894226 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ae141-bb1d-4e51-bcff-89238f3d998b admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:20:40.894508 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ae141-bb1d-4e51-bcff-89238f3d998b admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:20:40.894775 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ae141-bb1d-4e51-bcff-89238f3d998b admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:20:40.895603 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59ae141-bb1d-4e51-bcff-89238f3d998b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:20:40.897276 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59ae141-bb1d-4e51-bcff-89238f3d998b admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:20:40.908184 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1428/2848] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 23:20:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 23:20:40.912531 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0510fc-b7a0-4983-a6e3-40a1a065bf79 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:20:40.923131 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0510fc-b7a0-4983-a6e3-40a1a065bf79 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:20:40.928024 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7a5611-6ab1-4432-bd9c-497e3714630d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:20:40.928909 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7a5611-6ab1-4432-bd9c-497e3714630d admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:20:40.929190 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7a5611-6ab1-4432-bd9c-497e3714630d admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:20:40.929463 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7a5611-6ab1-4432-bd9c-497e3714630d admin admin] PATH_INFO: `/v3/projects/ea05327b63d94c3281e1debfda85059e/users/4d6f88e536a04c6eb76c9c2f523e3e68/roles/1928787bfcc745419829cd315900ac44` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:20:40.945451 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7a5611-6ab1-4432-bd9c-497e3714630d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea05327b63d94c3281e1debfda85059e, user_id=4d6f88e536a04c6eb76c9c2f523e3e68, role_id=1928787bfcc745419829cd315900ac44)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:20:40.949713 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7a5611-6ab1-4432-bd9c-497e3714630d admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:20:40.971761 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1421/2849] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 23:20:40 2022] PUT /identity/v3/projects/ea05327b63d94c3281e1debfda85059e/users/4d6f88e536a04c6eb76c9c2f523e3e68/roles/1928787bfcc745419829cd315900ac44 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 23:20:40.982735 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fab7d6e-6436-4a0f-b01b-9943cd5f8215 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:20:40.983017 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fab7d6e-6436-4a0f-b01b-9943cd5f8215 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:20:40.983341 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fab7d6e-6436-4a0f-b01b-9943cd5f8215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:20:41.014214 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-3fab7d6e-6436-4a0f-b01b-9943cd5f8215 None None] MFA Rules not processed for user `4d6f88e536a04c6eb76c9c2f523e3e68`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 23:20:41.015381 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-3fab7d6e-6436-4a0f-b01b-9943cd5f8215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:20:41.023872 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:20:41.085383 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1429/2850] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 23:20:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 23:20:41.097459 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7a5611-6ab1-4432-bd9c-497e3714630d admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:20:41.099683 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-ca7a5611-6ab1-4432-bd9c-497e3714630d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:20:41.162992 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7a5611-6ab1-4432-bd9c-497e3714630d admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:20:41.167191 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25392bac-9cab-453c-886d-a24e2bf82f31 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a747e2a5684843a6ee9e3480badac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:20:41.167872 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25392bac-9cab-453c-886d-a24e2bf82f31 service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:20:41.168155 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25392bac-9cab-453c-886d-a24e2bf82f31 service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:20:41.168429 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25392bac-9cab-453c-886d-a24e2bf82f31 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:20:41.177123 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25392bac-9cab-453c-886d-a24e2bf82f31 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:20:41.178574 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25392bac-9cab-453c-886d-a24e2bf82f31 service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:20:41.188393 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1422/2851] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:20:41 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:20:41.881378 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fab7d6e-6436-4a0f-b01b-9943cd5f8215 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:20:41.882994 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-3fab7d6e-6436-4a0f-b01b-9943cd5f8215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:20:41.951897 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fab7d6e-6436-4a0f-b01b-9943cd5f8215 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:20:41.957119 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3312c874-164e-4e63-a86a-f89903860959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:20:41.958015 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3312c874-164e-4e63-a86a-f89903860959 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:20:41.958299 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3312c874-164e-4e63-a86a-f89903860959 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:20:41.958576 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3312c874-164e-4e63-a86a-f89903860959 admin admin] PATH_INFO: `/v3/users/e389a617365e44079648928fa1917497` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:20:41.959909 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3312c874-164e-4e63-a86a-f89903860959 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e389a617365e44079648928fa1917497)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:20:41.961850 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3312c874-164e-4e63-a86a-f89903860959 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:20:42.014045 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-3312c874-164e-4e63-a86a-f89903860959 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e389a617365e44079648928fa1917497'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:20:42.021773 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-3312c874-164e-4e63-a86a-f89903860959 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e389a617365e44079648928fa1917497'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:20:42.022520 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-3312c874-164e-4e63-a86a-f89903860959 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e389a617365e44079648928fa1917497'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:20:42.023228 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-3312c874-164e-4e63-a86a-f89903860959 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e389a617365e44079648928fa1917497'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:20:42.035985 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-3312c874-164e-4e63-a86a-f89903860959 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e389a617365e44079648928fa1917497'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:20:42.050954 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1430/2852] 10.222.0.36 () {58 vars in 1223 bytes} [Fri Jun 24 23:20:41 2022] DELETE /identity/v3/users/e389a617365e44079648928fa1917497 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 23:20:42.055598 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c90a8-617b-4a38-bedd-f5ae834fac9c None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:20:42.056088 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c90a8-617b-4a38-bedd-f5ae834fac9c None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:20:42.056198 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c90a8-617b-4a38-bedd-f5ae834fac9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:20:42.073895 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-d56c90a8-617b-4a38-bedd-f5ae834fac9c None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 23:20:42.075132 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-d56c90a8-617b-4a38-bedd-f5ae834fac9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:20:42.088703 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:20:42.140775 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1423/2853] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 23:20:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 23:20:42.151216 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3312c874-164e-4e63-a86a-f89903860959 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:20:42.153100 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-3312c874-164e-4e63-a86a-f89903860959 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:20:42.187716 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:20:42.219563 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3312c874-164e-4e63-a86a-f89903860959 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:20:42.223830 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bc405b-5a49-4834-b8e0-fdf6cd40c7cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:20:42.224498 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc405b-5a49-4834-b8e0-fdf6cd40c7cd service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:20:42.224809 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc405b-5a49-4834-b8e0-fdf6cd40c7cd service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:20:42.225103 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc405b-5a49-4834-b8e0-fdf6cd40c7cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:20:42.236258 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bc405b-5a49-4834-b8e0-fdf6cd40c7cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:20:42.237730 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bc405b-5a49-4834-b8e0-fdf6cd40c7cd service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:20:42.247418 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1431/2854] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:20:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:20:42.536243 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56c90a8-617b-4a38-bedd-f5ae834fac9c None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:20:42.537831 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-d56c90a8-617b-4a38-bedd-f5ae834fac9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:20:42.550492 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56c90a8-617b-4a38-bedd-f5ae834fac9c None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:20:42.567060 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa968c11-deb4-4639-8c77-8819d4fff0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:20:42.576221 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa968c11-deb4-4639-8c77-8819d4fff0c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:20:42.576513 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa968c11-deb4-4639-8c77-8819d4fff0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:20:42.576797 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa968c11-deb4-4639-8c77-8819d4fff0c1 admin admin] PATH_INFO: `/v3/projects/b5d928638dbd49ef80f4401b5b705c0a` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:20:42.578906 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa968c11-deb4-4639-8c77-8819d4fff0c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5d928638dbd49ef80f4401b5b705c0a)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:20:42.581014 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa968c11-deb4-4639-8c77-8819d4fff0c1 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:20:42.633525 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-aa968c11-deb4-4639-8c77-8819d4fff0c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5d928638dbd49ef80f4401b5b705c0a', 'request_id': 'req-aa968c11-deb4-4639-8c77-8819d4fff0c1'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:20:42.640025 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-aa968c11-deb4-4639-8c77-8819d4fff0c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5d928638dbd49ef80f4401b5b705c0a', 'request_id': 'req-aa968c11-deb4-4639-8c77-8819d4fff0c1'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:20:42.650236 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-aa968c11-deb4-4639-8c77-8819d4fff0c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5d928638dbd49ef80f4401b5b705c0a', 'request_id': 'req-aa968c11-deb4-4639-8c77-8819d4fff0c1'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:20:42.660643 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-aa968c11-deb4-4639-8c77-8819d4fff0c1 admin admin] The token cache is being invalidate because project b5d928638dbd49ef80f4401b5b705c0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 23:20:42.660958 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-aa968c11-deb4-4639-8c77-8819d4fff0c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:20:42.661566 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-aa968c11-deb4-4639-8c77-8819d4fff0c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:20:42.663146 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1424/2855] 10.222.0.36 () {58 vars in 1232 bytes} [Fri Jun 24 23:20:42 2022] DELETE /identity/v3/projects/b5d928638dbd49ef80f4401b5b705c0a => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 23:20:42.667669 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bc405b-5a49-4834-b8e0-fdf6cd40c7cd service neutron] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:20:42.677751 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bc405b-5a49-4834-b8e0-fdf6cd40c7cd service neutron] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:20:42.750825 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6d1901-08b1-447d-9a7a-d555cdbe6db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:20:42.751756 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d1901-08b1-447d-9a7a-d555cdbe6db4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:20:42.752035 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d1901-08b1-447d-9a7a-d555cdbe6db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:20:42.752303 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d1901-08b1-447d-9a7a-d555cdbe6db4 admin admin] PATH_INFO: `/v3/users/436bfc334ecb495b8295fd6dfa4ff0a6` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:20:42.753513 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6d1901-08b1-447d-9a7a-d555cdbe6db4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=436bfc334ecb495b8295fd6dfa4ff0a6)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:20:42.755501 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6d1901-08b1-447d-9a7a-d555cdbe6db4 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:20:42.809538 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-6e6d1901-08b1-447d-9a7a-d555cdbe6db4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '436bfc334ecb495b8295fd6dfa4ff0a6'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:20:42.816581 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-6e6d1901-08b1-447d-9a7a-d555cdbe6db4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '436bfc334ecb495b8295fd6dfa4ff0a6'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:20:42.817288 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-6e6d1901-08b1-447d-9a7a-d555cdbe6db4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '436bfc334ecb495b8295fd6dfa4ff0a6'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:20:42.817900 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-6e6d1901-08b1-447d-9a7a-d555cdbe6db4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '436bfc334ecb495b8295fd6dfa4ff0a6'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:20:42.830007 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-6e6d1901-08b1-447d-9a7a-d555cdbe6db4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '436bfc334ecb495b8295fd6dfa4ff0a6'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:20:42.844574 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1432/2856] 10.222.0.36 () {58 vars in 1223 bytes} [Fri Jun 24 23:20:42 2022] DELETE /identity/v3/users/436bfc334ecb495b8295fd6dfa4ff0a6 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 23:20:43.129872 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa968c11-deb4-4639-8c77-8819d4fff0c1 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:20:43.131381 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-aa968c11-deb4-4639-8c77-8819d4fff0c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:20:43.149686 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa968c11-deb4-4639-8c77-8819d4fff0c1 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:20:43.210199 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a8d8fa-01db-4321-a70d-d2ff04ea8906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:20:43.210965 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a8d8fa-01db-4321-a70d-d2ff04ea8906 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:20:43.211240 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a8d8fa-01db-4321-a70d-d2ff04ea8906 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:20:43.211539 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a8d8fa-01db-4321-a70d-d2ff04ea8906 admin admin] PATH_INFO: `/v3/projects/8a131b1d32ca4256a4903f882a8c2682` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:20:43.212810 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a8d8fa-01db-4321-a70d-d2ff04ea8906 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a131b1d32ca4256a4903f882a8c2682)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:20:43.214801 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a8d8fa-01db-4321-a70d-d2ff04ea8906 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:20:43.260751 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:20:43.264088 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-a7a8d8fa-01db-4321-a70d-d2ff04ea8906 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a131b1d32ca4256a4903f882a8c2682', 'request_id': 'req-a7a8d8fa-01db-4321-a70d-d2ff04ea8906'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:20:43.273899 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-a7a8d8fa-01db-4321-a70d-d2ff04ea8906 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a131b1d32ca4256a4903f882a8c2682', 'request_id': 'req-a7a8d8fa-01db-4321-a70d-d2ff04ea8906'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:20:43.284525 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-a7a8d8fa-01db-4321-a70d-d2ff04ea8906 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a131b1d32ca4256a4903f882a8c2682', 'request_id': 'req-a7a8d8fa-01db-4321-a70d-d2ff04ea8906'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:20:43.295448 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-a7a8d8fa-01db-4321-a70d-d2ff04ea8906 admin admin] The token cache is being invalidate because project 8a131b1d32ca4256a4903f882a8c2682 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 23:20:43.295730 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-a7a8d8fa-01db-4321-a70d-d2ff04ea8906 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:20:43.296403 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-a7a8d8fa-01db-4321-a70d-d2ff04ea8906 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:20:43.298019 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1425/2857] 10.222.0.36 () {58 vars in 1232 bytes} [Fri Jun 24 23:20:43 2022] DELETE /identity/v3/projects/8a131b1d32ca4256a4903f882a8c2682 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 23:20:43.303119 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a85f1c2-0065-41f3-b8d5-226fa329d17c None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:20:43.303625 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a85f1c2-0065-41f3-b8d5-226fa329d17c None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:20:43.303713 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a85f1c2-0065-41f3-b8d5-226fa329d17c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:20:43.322135 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-5a85f1c2-0065-41f3-b8d5-226fa329d17c None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 23:20:43.323391 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-5a85f1c2-0065-41f3-b8d5-226fa329d17c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:20:43.370066 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:20:43.386837 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1433/2858] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 23:20:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 23:20:43.394925 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5e4dbc-e4c6-4170-8aa6-8cee18bf06a2 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:20:43.395215 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5e4dbc-e4c6-4170-8aa6-8cee18bf06a2 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:20:43.395545 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5e4dbc-e4c6-4170-8aa6-8cee18bf06a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:20:43.416567 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-1a5e4dbc-e4c6-4170-8aa6-8cee18bf06a2 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 23:20:43.417785 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-1a5e4dbc-e4c6-4170-8aa6-8cee18bf06a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:20:43.427634 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1426/2859] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 23:20:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 23:20:43.431955 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a85f1c2-0065-41f3-b8d5-226fa329d17c None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:20:43.444110 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a85f1c2-0065-41f3-b8d5-226fa329d17c None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:20:43.449775 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7c3c79-4e81-41e1-a0ec-b3f2d9d74bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:20:43.450443 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7c3c79-4e81-41e1-a0ec-b3f2d9d74bc3 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:20:43.450730 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7c3c79-4e81-41e1-a0ec-b3f2d9d74bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:20:43.451009 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7c3c79-4e81-41e1-a0ec-b3f2d9d74bc3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:20:43.451804 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7c3c79-4e81-41e1-a0ec-b3f2d9d74bc3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 23:20:43.452102 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7c3c79-4e81-41e1-a0ec-b3f2d9d74bc3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:20:43.454433 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7c3c79-4e81-41e1-a0ec-b3f2d9d74bc3 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:20:43.466430 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1434/2860] 10.222.0.36 () {58 vars in 1152 bytes} [Fri Jun 24 23:20:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 23:20:43.470782 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5e4dbc-e4c6-4170-8aa6-8cee18bf06a2 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:20:43.480521 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5e4dbc-e4c6-4170-8aa6-8cee18bf06a2 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:20:43.486130 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1162c63-32c1-41c2-8693-352d4aa0836a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:20:43.486782 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1162c63-32c1-41c2-8693-352d4aa0836a admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:20:43.487062 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1162c63-32c1-41c2-8693-352d4aa0836a admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:20:43.487373 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1162c63-32c1-41c2-8693-352d4aa0836a admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:20:43.488056 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1162c63-32c1-41c2-8693-352d4aa0836a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:20:43.490014 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1162c63-32c1-41c2-8693-352d4aa0836a admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:20:43.519671 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1427/2861] 10.222.0.36 () {60 vars in 1152 bytes} [Fri Jun 24 23:20:43 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 23:20:43.525434 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7c3c79-4e81-41e1-a0ec-b3f2d9d74bc3 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:20:43.536219 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7c3c79-4e81-41e1-a0ec-b3f2d9d74bc3 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:20:43.600619 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f57c7f5-569b-4ed6-85c8-fecdb45caf1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:20:43.601260 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f57c7f5-569b-4ed6-85c8-fecdb45caf1a admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:20:43.601549 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f57c7f5-569b-4ed6-85c8-fecdb45caf1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:20:43.601842 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f57c7f5-569b-4ed6-85c8-fecdb45caf1a admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:20:43.602539 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f57c7f5-569b-4ed6-85c8-fecdb45caf1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:20:43.604581 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f57c7f5-569b-4ed6-85c8-fecdb45caf1a admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:20:43.627979 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1435/2862] 10.222.0.36 () {60 vars in 1143 bytes} [Fri Jun 24 23:20:43 2022] POST /identity/v3/users => generated 292 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 23:20:43.631854 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1162c63-32c1-41c2-8693-352d4aa0836a admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:20:43.642949 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1162c63-32c1-41c2-8693-352d4aa0836a admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:20:43.647776 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce578dce-a891-45e4-bbdc-067cdb823d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:20:43.648436 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce578dce-a891-45e4-bbdc-067cdb823d50 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:20:43.648717 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce578dce-a891-45e4-bbdc-067cdb823d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:20:43.648990 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce578dce-a891-45e4-bbdc-067cdb823d50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:20:43.649744 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce578dce-a891-45e4-bbdc-067cdb823d50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:20:43.651383 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce578dce-a891-45e4-bbdc-067cdb823d50 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:20:43.661902 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1428/2863] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 23:20:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 23:20:43.666495 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f57c7f5-569b-4ed6-85c8-fecdb45caf1a admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:20:43.683090 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f57c7f5-569b-4ed6-85c8-fecdb45caf1a admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:20:43.690467 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630221d5-888e-480c-a2ff-9f2d60749139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:20:43.691129 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630221d5-888e-480c-a2ff-9f2d60749139 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:20:43.691439 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630221d5-888e-480c-a2ff-9f2d60749139 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:20:43.691709 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630221d5-888e-480c-a2ff-9f2d60749139 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:20:43.692438 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630221d5-888e-480c-a2ff-9f2d60749139 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:20:43.694052 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630221d5-888e-480c-a2ff-9f2d60749139 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:20:43.704886 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1436/2864] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 23:20:43 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 23:20:43.709128 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce578dce-a891-45e4-bbdc-067cdb823d50 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:20:43.719698 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce578dce-a891-45e4-bbdc-067cdb823d50 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:20:43.724550 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e8c382-caf9-4a27-a867-d5a7b8e961c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:20:43.725453 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e8c382-caf9-4a27-a867-d5a7b8e961c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:20:43.725738 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e8c382-caf9-4a27-a867-d5a7b8e961c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:20:43.726013 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e8c382-caf9-4a27-a867-d5a7b8e961c7 admin admin] PATH_INFO: `/v3/projects/cea1595bb1554d7d9c6bd54ac1d2aef2/users/d73f00597c4a4b01abffff8dc2cba51c/roles/1928787bfcc745419829cd315900ac44` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:20:43.742117 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e8c382-caf9-4a27-a867-d5a7b8e961c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cea1595bb1554d7d9c6bd54ac1d2aef2, user_id=d73f00597c4a4b01abffff8dc2cba51c, role_id=1928787bfcc745419829cd315900ac44)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:20:43.744901 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e8c382-caf9-4a27-a867-d5a7b8e961c7 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:20:43.759170 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630221d5-888e-480c-a2ff-9f2d60749139 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:20:43.760412 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1429/2865] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 23:20:43 2022] PUT /identity/v3/projects/cea1595bb1554d7d9c6bd54ac1d2aef2/users/d73f00597c4a4b01abffff8dc2cba51c/roles/1928787bfcc745419829cd315900ac44 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 23:20:43.761274 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-630221d5-888e-480c-a2ff-9f2d60749139 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:20:43.770732 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70adf78a-329c-45b7-a1c6-2ef443ff14f1 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:20:43.771027 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70adf78a-329c-45b7-a1c6-2ef443ff14f1 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:20:43.771343 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70adf78a-329c-45b7-a1c6-2ef443ff14f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:20:43.774810 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630221d5-888e-480c-a2ff-9f2d60749139 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:20:43.798283 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-70adf78a-329c-45b7-a1c6-2ef443ff14f1 None None] MFA Rules not processed for user `d73f00597c4a4b01abffff8dc2cba51c`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 23:20:43.799510 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-70adf78a-329c-45b7-a1c6-2ef443ff14f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:20:43.832514 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef4d779-a366-471b-97c8-b0532dabc66d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:20:43.833432 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef4d779-a366-471b-97c8-b0532dabc66d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:20:43.833736 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef4d779-a366-471b-97c8-b0532dabc66d admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:20:43.834038 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef4d779-a366-471b-97c8-b0532dabc66d admin admin] PATH_INFO: `/v3/users/4d6f88e536a04c6eb76c9c2f523e3e68` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:20:43.835275 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef4d779-a366-471b-97c8-b0532dabc66d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d6f88e536a04c6eb76c9c2f523e3e68)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:20:43.837207 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef4d779-a366-471b-97c8-b0532dabc66d admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:20:43.865327 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1430/2866] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 23:20:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 23:20:43.870277 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70adf78a-329c-45b7-a1c6-2ef443ff14f1 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:20:43.881020 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70adf78a-329c-45b7-a1c6-2ef443ff14f1 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:20:43.885844 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c52da98-4324-4f3d-862d-0f1924809c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:20:43.886497 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c52da98-4324-4f3d-862d-0f1924809c36 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:20:43.886787 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c52da98-4324-4f3d-862d-0f1924809c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:20:43.887064 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c52da98-4324-4f3d-862d-0f1924809c36 admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:20:43.887802 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c52da98-4324-4f3d-862d-0f1924809c36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:20:43.889745 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c52da98-4324-4f3d-862d-0f1924809c36 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:20:43.889943 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-fef4d779-a366-471b-97c8-b0532dabc66d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d6f88e536a04c6eb76c9c2f523e3e68'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:20:43.901862 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-fef4d779-a366-471b-97c8-b0532dabc66d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d6f88e536a04c6eb76c9c2f523e3e68'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:20:43.902648 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-fef4d779-a366-471b-97c8-b0532dabc66d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d6f88e536a04c6eb76c9c2f523e3e68'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:20:43.903310 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-fef4d779-a366-471b-97c8-b0532dabc66d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d6f88e536a04c6eb76c9c2f523e3e68'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:20:43.905329 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:20:43.919509 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-fef4d779-a366-471b-97c8-b0532dabc66d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d6f88e536a04c6eb76c9c2f523e3e68'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:20:43.924581 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1431/2867] 10.222.0.36 () {60 vars in 1152 bytes} [Fri Jun 24 23:20:43 2022] POST /identity/v3/projects => generated 381 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 23:20:43.925582 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c52da98-4324-4f3d-862d-0f1924809c36 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:20:43.927166 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-4c52da98-4324-4f3d-862d-0f1924809c36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:20:43.938887 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1437/2868] 10.222.0.36 () {58 vars in 1223 bytes} [Fri Jun 24 23:20:43 2022] DELETE /identity/v3/users/4d6f88e536a04c6eb76c9c2f523e3e68 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 23:20:43.943536 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c78841-6917-4e88-b3e3-e50a47939885 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:20:43.943823 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c78841-6917-4e88-b3e3-e50a47939885 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:20:43.944097 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c78841-6917-4e88-b3e3-e50a47939885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:20:43.962859 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-38c78841-6917-4e88-b3e3-e50a47939885 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 23:20:43.964107 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-38c78841-6917-4e88-b3e3-e50a47939885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:20:43.972862 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:20:43.997313 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c52da98-4324-4f3d-862d-0f1924809c36 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:20:44.028158 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1438/2869] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 23:20:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 23:20:44.038433 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c78841-6917-4e88-b3e3-e50a47939885 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:20:44.039891 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-38c78841-6917-4e88-b3e3-e50a47939885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:20:44.054800 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079c55eb-8c9d-4762-8f5f-46a78cf1d22a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:20:44.055525 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079c55eb-8c9d-4762-8f5f-46a78cf1d22a admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:20:44.055811 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079c55eb-8c9d-4762-8f5f-46a78cf1d22a admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:20:44.056090 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079c55eb-8c9d-4762-8f5f-46a78cf1d22a admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:20:44.056786 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079c55eb-8c9d-4762-8f5f-46a78cf1d22a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:20:44.058748 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079c55eb-8c9d-4762-8f5f-46a78cf1d22a admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:20:44.084786 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1432/2870] 10.222.0.36 () {60 vars in 1143 bytes} [Fri Jun 24 23:20:43 2022] POST /identity/v3/users => generated 297 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 23:20:44.085956 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079c55eb-8c9d-4762-8f5f-46a78cf1d22a admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:20:44.097187 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079c55eb-8c9d-4762-8f5f-46a78cf1d22a admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:20:44.102035 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6860c5-cea4-4b20-88a7-bc3c6af8af36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:20:44.102694 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6860c5-cea4-4b20-88a7-bc3c6af8af36 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:20:44.102985 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6860c5-cea4-4b20-88a7-bc3c6af8af36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:20:44.103275 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6860c5-cea4-4b20-88a7-bc3c6af8af36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:20:44.104033 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6860c5-cea4-4b20-88a7-bc3c6af8af36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:20:44.105650 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6860c5-cea4-4b20-88a7-bc3c6af8af36 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:20:44.105779 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c78841-6917-4e88-b3e3-e50a47939885 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:20:44.110342 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c51cd84-bd51-4f88-9338-2535a52c9ebe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:20:44.110994 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c51cd84-bd51-4f88-9338-2535a52c9ebe service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:20:44.111747 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c51cd84-bd51-4f88-9338-2535a52c9ebe service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:20:44.111747 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c51cd84-bd51-4f88-9338-2535a52c9ebe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:20:44.116455 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1433/2871] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 23:20:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 23:20:44.120633 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6860c5-cea4-4b20-88a7-bc3c6af8af36 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:20:44.121732 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c51cd84-bd51-4f88-9338-2535a52c9ebe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:20:44.123296 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c51cd84-bd51-4f88-9338-2535a52c9ebe service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:20:44.130594 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6860c5-cea4-4b20-88a7-bc3c6af8af36 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:20:44.135153 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1439/2872] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:20:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:20:44.137524 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee81d9de-8fdc-4efe-b32e-d869187666aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:20:44.138450 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee81d9de-8fdc-4efe-b32e-d869187666aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:20:44.138723 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee81d9de-8fdc-4efe-b32e-d869187666aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:20:44.139011 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee81d9de-8fdc-4efe-b32e-d869187666aa admin admin] PATH_INFO: `/v3/projects/1f964c1a58fa4e8aa7733ea8dfff22b4/users/5c46053c03ab4f1f8b09da8c9b20ae23/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:20:44.155183 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee81d9de-8fdc-4efe-b32e-d869187666aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f964c1a58fa4e8aa7733ea8dfff22b4, user_id=5c46053c03ab4f1f8b09da8c9b20ae23, role_id=1a1c43cc97a0407eb7a7c7a1333a9d4a)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:20:44.157974 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee81d9de-8fdc-4efe-b32e-d869187666aa admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:20:44.173972 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1434/2873] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 23:20:44 2022] PUT /identity/v3/projects/1f964c1a58fa4e8aa7733ea8dfff22b4/users/5c46053c03ab4f1f8b09da8c9b20ae23/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 23:20:44.178069 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c51cd84-bd51-4f88-9338-2535a52c9ebe service neutron] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:20:44.188974 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c51cd84-bd51-4f88-9338-2535a52c9ebe service neutron] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:20:44.262651 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ab1b49-2381-4813-baa2-bb1fdc401eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:20:44.263469 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ab1b49-2381-4813-baa2-bb1fdc401eb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:20:44.263762 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ab1b49-2381-4813-baa2-bb1fdc401eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:20:44.264043 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ab1b49-2381-4813-baa2-bb1fdc401eb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:20:44.264837 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ab1b49-2381-4813-baa2-bb1fdc401eb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:20:44.266844 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ab1b49-2381-4813-baa2-bb1fdc401eb6 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:20:44.283988 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1440/2874] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 23:20:44 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 23:20:44.287466 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee81d9de-8fdc-4efe-b32e-d869187666aa admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:20:44.308120 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee81d9de-8fdc-4efe-b32e-d869187666aa admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:20:44.313065 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bede536f-4686-49c6-b097-52521bc58d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:20:44.313956 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bede536f-4686-49c6-b097-52521bc58d69 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:20:44.314234 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bede536f-4686-49c6-b097-52521bc58d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:20:44.314507 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bede536f-4686-49c6-b097-52521bc58d69 admin admin] PATH_INFO: `/v3/projects/1f964c1a58fa4e8aa7733ea8dfff22b4/users/5c46053c03ab4f1f8b09da8c9b20ae23/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:20:44.316648 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bede536f-4686-49c6-b097-52521bc58d69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f964c1a58fa4e8aa7733ea8dfff22b4, user_id=5c46053c03ab4f1f8b09da8c9b20ae23, role_id=1a1c43cc97a0407eb7a7c7a1333a9d4a)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:20:44.319364 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bede536f-4686-49c6-b097-52521bc58d69 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:20:44.330178 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1435/2875] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 23:20:44 2022] PUT /identity/v3/projects/1f964c1a58fa4e8aa7733ea8dfff22b4/users/5c46053c03ab4f1f8b09da8c9b20ae23/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 23:20:44.390988 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc5eb9-014d-4e5a-9f4f-577d5a536aa3 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:20:44.391589 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc5eb9-014d-4e5a-9f4f-577d5a536aa3 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:20:44.391589 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc5eb9-014d-4e5a-9f4f-577d5a536aa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:20:44.421271 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bede536f-4686-49c6-b097-52521bc58d69 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:20:44.423220 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-9bdc5eb9-014d-4e5a-9f4f-577d5a536aa3 None None] MFA Rules not processed for user `5c46053c03ab4f1f8b09da8c9b20ae23`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 23:20:44.424551 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-bede536f-4686-49c6-b097-52521bc58d69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:20:44.425372 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-9bdc5eb9-014d-4e5a-9f4f-577d5a536aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:20:44.431566 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:20:44.504080 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bede536f-4686-49c6-b097-52521bc58d69 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:20:44.507936 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1441/2876] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 23:20:44 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 23:20:44.509755 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f590e5-2b78-4c27-bfe6-4a9a957b5a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:20:44.510679 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f590e5-2b78-4c27-bfe6-4a9a957b5a49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:20:44.511005 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f590e5-2b78-4c27-bfe6-4a9a957b5a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:20:44.511519 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f590e5-2b78-4c27-bfe6-4a9a957b5a49 admin admin] PATH_INFO: `/v3/projects/ea05327b63d94c3281e1debfda85059e` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:20:44.512807 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f590e5-2b78-4c27-bfe6-4a9a957b5a49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea05327b63d94c3281e1debfda85059e)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:20:44.514994 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f590e5-2b78-4c27-bfe6-4a9a957b5a49 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:20:44.518933 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdc5eb9-014d-4e5a-9f4f-577d5a536aa3 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:20:44.520381 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-9bdc5eb9-014d-4e5a-9f4f-577d5a536aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:20:44.548495 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:20:44.566980 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-94f590e5-2b78-4c27-bfe6-4a9a957b5a49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea05327b63d94c3281e1debfda85059e', 'request_id': 'req-94f590e5-2b78-4c27-bfe6-4a9a957b5a49'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:20:44.573831 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-94f590e5-2b78-4c27-bfe6-4a9a957b5a49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea05327b63d94c3281e1debfda85059e', 'request_id': 'req-94f590e5-2b78-4c27-bfe6-4a9a957b5a49'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:20:44.579777 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdc5eb9-014d-4e5a-9f4f-577d5a536aa3 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:20:44.582445 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-94f590e5-2b78-4c27-bfe6-4a9a957b5a49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea05327b63d94c3281e1debfda85059e', 'request_id': 'req-94f590e5-2b78-4c27-bfe6-4a9a957b5a49'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:20:44.594063 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-94f590e5-2b78-4c27-bfe6-4a9a957b5a49 admin admin] The token cache is being invalidate because project ea05327b63d94c3281e1debfda85059e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 23:20:44.594567 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-94f590e5-2b78-4c27-bfe6-4a9a957b5a49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:20:44.595225 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-94f590e5-2b78-4c27-bfe6-4a9a957b5a49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:20:44.596842 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1436/2877] 10.222.0.36 () {58 vars in 1232 bytes} [Fri Jun 24 23:20:44 2022] DELETE /identity/v3/projects/ea05327b63d94c3281e1debfda85059e => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 23:20:44.641995 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbbdb55-6ae6-42fa-9f2c-1ed5e03290de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a747e2a5684843a6ee9e3480badac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:20:44.642693 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbbdb55-6ae6-42fa-9f2c-1ed5e03290de service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:20:44.642953 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbbdb55-6ae6-42fa-9f2c-1ed5e03290de service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:20:44.643433 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbbdb55-6ae6-42fa-9f2c-1ed5e03290de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:20:44.645751 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-ccbbdb55-6ae6-42fa-9f2c-1ed5e03290de service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:20:44.717148 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbbdb55-6ae6-42fa-9f2c-1ed5e03290de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:20:44.718746 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbbdb55-6ae6-42fa-9f2c-1ed5e03290de service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:20:44.729565 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1442/2878] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:20:44 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 23:20:44.837860 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f590e5-2b78-4c27-bfe6-4a9a957b5a49 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:20:44.839513 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-94f590e5-2b78-4c27-bfe6-4a9a957b5a49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:20:44.852280 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f590e5-2b78-4c27-bfe6-4a9a957b5a49 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:20:44.855979 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a629d06-d7f5-4737-8475-bb92237a44c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a747e2a5684843a6ee9e3480badac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:20:44.856641 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a629d06-d7f5-4737-8475-bb92237a44c2 service cinder] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:20:44.856927 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a629d06-d7f5-4737-8475-bb92237a44c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:20:44.857232 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a629d06-d7f5-4737-8475-bb92237a44c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:20:44.859567 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-2a629d06-d7f5-4737-8475-bb92237a44c2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:20:44.929726 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a629d06-d7f5-4737-8475-bb92237a44c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:20:44.931181 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a629d06-d7f5-4737-8475-bb92237a44c2 service cinder] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:20:44.940466 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1437/2879] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:20:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:20:47.539395 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbbdb55-6ae6-42fa-9f2c-1ed5e03290de service cinder] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:20:47.541083 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-ccbbdb55-6ae6-42fa-9f2c-1ed5e03290de service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:20:47.552014 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=100 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:20:47.610086 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbbdb55-6ae6-42fa-9f2c-1ed5e03290de service cinder] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:20:47.615130 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54933df5-1b81-4d27-9415-8722d8885516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:20:47.616076 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54933df5-1b81-4d27-9415-8722d8885516 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:20:47.616365 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54933df5-1b81-4d27-9415-8722d8885516 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:20:47.616637 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54933df5-1b81-4d27-9415-8722d8885516 admin admin] PATH_INFO: `/v3/users/d73f00597c4a4b01abffff8dc2cba51c` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:20:47.617803 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54933df5-1b81-4d27-9415-8722d8885516 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d73f00597c4a4b01abffff8dc2cba51c)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:20:47.619794 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54933df5-1b81-4d27-9415-8722d8885516 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:20:47.672785 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-54933df5-1b81-4d27-9415-8722d8885516 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd73f00597c4a4b01abffff8dc2cba51c'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:20:47.679658 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-54933df5-1b81-4d27-9415-8722d8885516 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd73f00597c4a4b01abffff8dc2cba51c'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:20:47.680312 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-54933df5-1b81-4d27-9415-8722d8885516 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd73f00597c4a4b01abffff8dc2cba51c'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:20:47.680919 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-54933df5-1b81-4d27-9415-8722d8885516 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd73f00597c4a4b01abffff8dc2cba51c'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:20:47.692540 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-54933df5-1b81-4d27-9415-8722d8885516 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd73f00597c4a4b01abffff8dc2cba51c'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:20:47.706689 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1443/2880] 10.222.0.36 () {58 vars in 1223 bytes} [Fri Jun 24 23:20:47 2022] DELETE /identity/v3/users/d73f00597c4a4b01abffff8dc2cba51c => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 23:20:47.711511 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e05b3b-0f23-4162-a7ee-6c813c27179c None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:20:47.712050 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e05b3b-0f23-4162-a7ee-6c813c27179c None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:20:47.712050 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e05b3b-0f23-4162-a7ee-6c813c27179c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:20:47.730323 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-41e05b3b-0f23-4162-a7ee-6c813c27179c None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 23:20:47.731566 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-41e05b3b-0f23-4162-a7ee-6c813c27179c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:20:47.796199 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1438/2881] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 23:20:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 23:20:47.806118 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54933df5-1b81-4d27-9415-8722d8885516 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:20:47.807677 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-54933df5-1b81-4d27-9415-8722d8885516 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:20:47.867972 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54933df5-1b81-4d27-9415-8722d8885516 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:20:47.871920 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b413b1ed-addb-4c04-a41f-f8515adf3aa0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:20:47.872559 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413b1ed-addb-4c04-a41f-f8515adf3aa0 service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:20:47.872839 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413b1ed-addb-4c04-a41f-f8515adf3aa0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:20:47.873115 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413b1ed-addb-4c04-a41f-f8515adf3aa0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:20:47.882450 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b413b1ed-addb-4c04-a41f-f8515adf3aa0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:20:47.883944 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b413b1ed-addb-4c04-a41f-f8515adf3aa0 service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:20:47.894143 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1444/2882] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:20:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:20:48.194411 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e05b3b-0f23-4162-a7ee-6c813c27179c None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:20:48.195942 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-41e05b3b-0f23-4162-a7ee-6c813c27179c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:20:48.210067 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e05b3b-0f23-4162-a7ee-6c813c27179c None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:20:48.215613 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a9fdac-9a14-4393-b9e5-04e8544c756b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:20:48.216619 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a9fdac-9a14-4393-b9e5-04e8544c756b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:20:48.216764 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a9fdac-9a14-4393-b9e5-04e8544c756b admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:20:48.217017 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a9fdac-9a14-4393-b9e5-04e8544c756b admin admin] PATH_INFO: `/v3/projects/cea1595bb1554d7d9c6bd54ac1d2aef2` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:20:48.218520 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a9fdac-9a14-4393-b9e5-04e8544c756b admin admin] RBAC: Authorizing `identity:delete_project(project_id=cea1595bb1554d7d9c6bd54ac1d2aef2)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:20:48.220730 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a9fdac-9a14-4393-b9e5-04e8544c756b admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:20:48.270561 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-45a9fdac-9a14-4393-b9e5-04e8544c756b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cea1595bb1554d7d9c6bd54ac1d2aef2', 'request_id': 'req-45a9fdac-9a14-4393-b9e5-04e8544c756b'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:20:48.271612 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:20:48.277362 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-45a9fdac-9a14-4393-b9e5-04e8544c756b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cea1595bb1554d7d9c6bd54ac1d2aef2', 'request_id': 'req-45a9fdac-9a14-4393-b9e5-04e8544c756b'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:20:48.289289 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-45a9fdac-9a14-4393-b9e5-04e8544c756b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cea1595bb1554d7d9c6bd54ac1d2aef2', 'request_id': 'req-45a9fdac-9a14-4393-b9e5-04e8544c756b'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:20:48.301963 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-45a9fdac-9a14-4393-b9e5-04e8544c756b admin admin] The token cache is being invalidate because project cea1595bb1554d7d9c6bd54ac1d2aef2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 23:20:48.302254 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-45a9fdac-9a14-4393-b9e5-04e8544c756b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:20:48.302962 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-45a9fdac-9a14-4393-b9e5-04e8544c756b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:20:48.304544 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1439/2883] 10.222.0.36 () {58 vars in 1232 bytes} [Fri Jun 24 23:20:48 2022] DELETE /identity/v3/projects/cea1595bb1554d7d9c6bd54ac1d2aef2 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 23:20:48.309065 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b413b1ed-addb-4c04-a41f-f8515adf3aa0 service neutron] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:20:48.319832 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b413b1ed-addb-4c04-a41f-f8515adf3aa0 service neutron] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:20:48.349308 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:20:48.384261 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2974f2-3911-43a4-a134-6a17ff2b469e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:20:48.385154 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2974f2-3911-43a4-a134-6a17ff2b469e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:20:48.385432 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2974f2-3911-43a4-a134-6a17ff2b469e admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:20:48.385701 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2974f2-3911-43a4-a134-6a17ff2b469e admin admin] PATH_INFO: `/v3/users/5c46053c03ab4f1f8b09da8c9b20ae23` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:20:48.387010 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2974f2-3911-43a4-a134-6a17ff2b469e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c46053c03ab4f1f8b09da8c9b20ae23)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:20:48.389057 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2974f2-3911-43a4-a134-6a17ff2b469e admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:20:48.439977 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-3e2974f2-3911-43a4-a134-6a17ff2b469e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c46053c03ab4f1f8b09da8c9b20ae23'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:20:48.449103 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-3e2974f2-3911-43a4-a134-6a17ff2b469e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c46053c03ab4f1f8b09da8c9b20ae23'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:20:48.450174 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-3e2974f2-3911-43a4-a134-6a17ff2b469e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c46053c03ab4f1f8b09da8c9b20ae23'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:20:48.451190 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-3e2974f2-3911-43a4-a134-6a17ff2b469e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c46053c03ab4f1f8b09da8c9b20ae23'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:20:48.464790 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-3e2974f2-3911-43a4-a134-6a17ff2b469e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c46053c03ab4f1f8b09da8c9b20ae23'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:20:48.485467 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1445/2884] 10.222.0.36 () {58 vars in 1223 bytes} [Fri Jun 24 23:20:48 2022] DELETE /identity/v3/users/5c46053c03ab4f1f8b09da8c9b20ae23 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 23:20:48.773421 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a9fdac-9a14-4393-b9e5-04e8544c756b admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:20:48.774892 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-45a9fdac-9a14-4393-b9e5-04e8544c756b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:20:48.787959 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a9fdac-9a14-4393-b9e5-04e8544c756b admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:20:48.845662 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21760eb3-71d8-4362-986c-56facfea9f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:20:48.846618 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21760eb3-71d8-4362-986c-56facfea9f18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:20:48.846893 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21760eb3-71d8-4362-986c-56facfea9f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:20:48.847391 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21760eb3-71d8-4362-986c-56facfea9f18 admin admin] PATH_INFO: `/v3/projects/1f964c1a58fa4e8aa7733ea8dfff22b4` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:20:48.848595 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21760eb3-71d8-4362-986c-56facfea9f18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f964c1a58fa4e8aa7733ea8dfff22b4)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:20:48.850516 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21760eb3-71d8-4362-986c-56facfea9f18 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:20:48.898612 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-21760eb3-71d8-4362-986c-56facfea9f18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f964c1a58fa4e8aa7733ea8dfff22b4', 'request_id': 'req-21760eb3-71d8-4362-986c-56facfea9f18'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:20:48.904779 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-21760eb3-71d8-4362-986c-56facfea9f18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f964c1a58fa4e8aa7733ea8dfff22b4', 'request_id': 'req-21760eb3-71d8-4362-986c-56facfea9f18'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:20:48.913959 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-21760eb3-71d8-4362-986c-56facfea9f18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f964c1a58fa4e8aa7733ea8dfff22b4', 'request_id': 'req-21760eb3-71d8-4362-986c-56facfea9f18'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:20:48.924092 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-21760eb3-71d8-4362-986c-56facfea9f18 admin admin] The token cache is being invalidate because project 1f964c1a58fa4e8aa7733ea8dfff22b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 23:20:48.924400 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-21760eb3-71d8-4362-986c-56facfea9f18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:20:48.925057 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-21760eb3-71d8-4362-986c-56facfea9f18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:20:48.926673 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1440/2885] 10.222.0.36 () {58 vars in 1232 bytes} [Fri Jun 24 23:20:48 2022] DELETE /identity/v3/projects/1f964c1a58fa4e8aa7733ea8dfff22b4 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 23:20:48.931642 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b00996-9c61-44f5-8974-732f17a39274 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:20:48.932141 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b00996-9c61-44f5-8974-732f17a39274 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:20:48.932232 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b00996-9c61-44f5-8974-732f17a39274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:20:48.950199 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-36b00996-9c61-44f5-8974-732f17a39274 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 23:20:48.951494 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-36b00996-9c61-44f5-8974-732f17a39274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:20:49.014427 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1446/2886] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 23:20:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 23:20:49.027230 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba30092-c8b5-47c0-a62d-310629e48b84 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:20:49.027605 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba30092-c8b5-47c0-a62d-310629e48b84 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:20:49.027947 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba30092-c8b5-47c0-a62d-310629e48b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:20:49.048302 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-eba30092-c8b5-47c0-a62d-310629e48b84 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 23:20:49.049437 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-eba30092-c8b5-47c0-a62d-310629e48b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:20:49.058163 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1441/2887] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 23:20:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 23:20:49.062500 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b00996-9c61-44f5-8974-732f17a39274 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:20:49.072389 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b00996-9c61-44f5-8974-732f17a39274 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:20:49.078500 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4dfe45-8dad-4f7d-9ef6-3890c20c7d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:20:49.079660 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4dfe45-8dad-4f7d-9ef6-3890c20c7d4b admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:20:49.080175 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4dfe45-8dad-4f7d-9ef6-3890c20c7d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:20:49.080681 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4dfe45-8dad-4f7d-9ef6-3890c20c7d4b admin admin] PATH_INFO: `/v3/domains` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:20:49.082102 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4dfe45-8dad-4f7d-9ef6-3890c20c7d4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80215) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 23:20:49.082664 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4dfe45-8dad-4f7d-9ef6-3890c20c7d4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:20:49.085560 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4dfe45-8dad-4f7d-9ef6-3890c20c7d4b admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:20:49.097723 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1447/2888] 10.222.0.36 () {58 vars in 1152 bytes} [Fri Jun 24 23:20:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 23:20:49.102220 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba30092-c8b5-47c0-a62d-310629e48b84 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:20:49.113235 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba30092-c8b5-47c0-a62d-310629e48b84 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:20:49.122896 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83799bbb-b58a-4f0e-9e18-0e77ebfc8d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:20:49.123606 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83799bbb-b58a-4f0e-9e18-0e77ebfc8d8b admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:20:49.123891 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83799bbb-b58a-4f0e-9e18-0e77ebfc8d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:20:49.124168 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83799bbb-b58a-4f0e-9e18-0e77ebfc8d8b admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:20:49.124930 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83799bbb-b58a-4f0e-9e18-0e77ebfc8d8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:20:49.126901 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83799bbb-b58a-4f0e-9e18-0e77ebfc8d8b admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:20:49.165403 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1442/2889] 10.222.0.36 () {60 vars in 1152 bytes} [Fri Jun 24 23:20:49 2022] POST /identity/v3/projects => generated 389 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 23:20:49.169775 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4dfe45-8dad-4f7d-9ef6-3890c20c7d4b admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:20:49.181305 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4dfe45-8dad-4f7d-9ef6-3890c20c7d4b admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:20:49.216902 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:20:49.247045 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8310df2-cba5-468e-8f6c-bc490aade1a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:20:49.247747 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8310df2-cba5-468e-8f6c-bc490aade1a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:20:49.248013 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8310df2-cba5-468e-8f6c-bc490aade1a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:20:49.248280 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8310df2-cba5-468e-8f6c-bc490aade1a1 admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:20:49.248963 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8310df2-cba5-468e-8f6c-bc490aade1a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:20:49.250896 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8310df2-cba5-468e-8f6c-bc490aade1a1 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:20:49.272399 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1448/2890] 10.222.0.36 () {60 vars in 1143 bytes} [Fri Jun 24 23:20:49 2022] POST /identity/v3/users => generated 295 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 23:20:49.277958 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83799bbb-b58a-4f0e-9e18-0e77ebfc8d8b admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:20:49.289576 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83799bbb-b58a-4f0e-9e18-0e77ebfc8d8b admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:20:49.295589 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb1bc34-56a8-46ea-9849-af93a9a7f8b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:20:49.296279 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb1bc34-56a8-46ea-9849-af93a9a7f8b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:20:49.296561 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb1bc34-56a8-46ea-9849-af93a9a7f8b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:20:49.296828 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb1bc34-56a8-46ea-9849-af93a9a7f8b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:20:49.297563 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb1bc34-56a8-46ea-9849-af93a9a7f8b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:20:49.299241 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb1bc34-56a8-46ea-9849-af93a9a7f8b4 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:20:49.311958 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1443/2891] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 23:20:49 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 23:20:49.318130 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8310df2-cba5-468e-8f6c-bc490aade1a1 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:20:49.329831 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8310df2-cba5-468e-8f6c-bc490aade1a1 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:20:49.335782 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4629758d-61e2-4d9d-9301-9b5c09267d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:20:49.336480 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4629758d-61e2-4d9d-9301-9b5c09267d07 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:20:49.336760 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4629758d-61e2-4d9d-9301-9b5c09267d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:20:49.337028 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4629758d-61e2-4d9d-9301-9b5c09267d07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:20:49.337766 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4629758d-61e2-4d9d-9301-9b5c09267d07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:20:49.339489 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4629758d-61e2-4d9d-9301-9b5c09267d07 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:20:49.357580 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1449/2892] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 23:20:49 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 23:20:49.362362 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb1bc34-56a8-46ea-9849-af93a9a7f8b4 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:20:49.373660 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb1bc34-56a8-46ea-9849-af93a9a7f8b4 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:20:49.379527 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42b510a-c9f0-45d5-9e5d-e533fdd725f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:20:49.380429 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42b510a-c9f0-45d5-9e5d-e533fdd725f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:20:49.380711 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42b510a-c9f0-45d5-9e5d-e533fdd725f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:20:49.380973 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42b510a-c9f0-45d5-9e5d-e533fdd725f7 admin admin] PATH_INFO: `/v3/projects/379bf400a0884b4aa14d9d6f2ac5e8b2/users/418735bd430d4d08b944684f5173b318/roles/1928787bfcc745419829cd315900ac44` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:20:49.399198 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42b510a-c9f0-45d5-9e5d-e533fdd725f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=379bf400a0884b4aa14d9d6f2ac5e8b2, user_id=418735bd430d4d08b944684f5173b318, role_id=1928787bfcc745419829cd315900ac44)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:20:49.401923 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42b510a-c9f0-45d5-9e5d-e533fdd725f7 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:20:49.418754 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1444/2893] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 23:20:49 2022] PUT /identity/v3/projects/379bf400a0884b4aa14d9d6f2ac5e8b2/users/418735bd430d4d08b944684f5173b318/roles/1928787bfcc745419829cd315900ac44 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 23:20:49.432120 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1541c6f-54b7-4b1b-bb5b-814a1321069e None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:20:49.432633 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1541c6f-54b7-4b1b-bb5b-814a1321069e None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:20:49.432982 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1541c6f-54b7-4b1b-bb5b-814a1321069e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:20:49.466005 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-f1541c6f-54b7-4b1b-bb5b-814a1321069e None None] MFA Rules not processed for user `418735bd430d4d08b944684f5173b318`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 23:20:49.467208 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-f1541c6f-54b7-4b1b-bb5b-814a1321069e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:20:49.550989 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1450/2894] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 23:20:49 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 23:20:49.557052 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42b510a-c9f0-45d5-9e5d-e533fdd725f7 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:20:49.563966 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:20:49.632594 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42b510a-c9f0-45d5-9e5d-e533fdd725f7 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:20:49.641154 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f683c26-d22a-4679-8764-d555f65ae4ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:20:49.642187 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f683c26-d22a-4679-8764-d555f65ae4ee admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:20:49.642652 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f683c26-d22a-4679-8764-d555f65ae4ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:20:49.643088 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f683c26-d22a-4679-8764-d555f65ae4ee admin admin] PATH_INFO: `/v3/projects` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:20:49.644552 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f683c26-d22a-4679-8764-d555f65ae4ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:20:49.646917 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f683c26-d22a-4679-8764-d555f65ae4ee admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:20:49.685309 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1445/2895] 10.222.0.36 () {60 vars in 1152 bytes} [Fri Jun 24 23:20:49 2022] POST /identity/v3/projects => generated 389 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 23:20:49.690749 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1541c6f-54b7-4b1b-bb5b-814a1321069e None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:20:49.702507 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1541c6f-54b7-4b1b-bb5b-814a1321069e None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:20:49.769131 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac56eff-9904-4edd-98f8-6629028460cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:20:49.769809 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac56eff-9904-4edd-98f8-6629028460cc admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:20:49.770086 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac56eff-9904-4edd-98f8-6629028460cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:20:49.770356 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac56eff-9904-4edd-98f8-6629028460cc admin admin] PATH_INFO: `/v3/users` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:20:49.771094 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac56eff-9904-4edd-98f8-6629028460cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:20:49.773106 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac56eff-9904-4edd-98f8-6629028460cc admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:20:49.797989 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1451/2896] 10.222.0.36 () {60 vars in 1143 bytes} [Fri Jun 24 23:20:49 2022] POST /identity/v3/users => generated 301 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 23:20:49.803410 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f683c26-d22a-4679-8764-d555f65ae4ee admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:20:49.816119 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f683c26-d22a-4679-8764-d555f65ae4ee admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:20:49.821119 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fe1089-8d69-43b0-ab56-0d3969d4ce6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:20:49.821795 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fe1089-8d69-43b0-ab56-0d3969d4ce6b admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:20:49.822078 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fe1089-8d69-43b0-ab56-0d3969d4ce6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:20:49.822454 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fe1089-8d69-43b0-ab56-0d3969d4ce6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:20:49.823198 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fe1089-8d69-43b0-ab56-0d3969d4ce6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:20:49.824860 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fe1089-8d69-43b0-ab56-0d3969d4ce6b admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:20:49.837451 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1446/2897] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 23:20:49 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 23:20:49.844327 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac56eff-9904-4edd-98f8-6629028460cc admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:20:49.857433 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac56eff-9904-4edd-98f8-6629028460cc admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:20:49.864776 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12477dc6-43d6-45e8-8ffd-82ef215e0b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:20:49.868802 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12477dc6-43d6-45e8-8ffd-82ef215e0b00 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:20:49.868802 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12477dc6-43d6-45e8-8ffd-82ef215e0b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:20:49.868802 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12477dc6-43d6-45e8-8ffd-82ef215e0b00 admin admin] PATH_INFO: `/v3/projects/55f5a23e96574e3fbe04a81c36393ada/users/0cebb8a02929482bb45e1ea1756466a3/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:20:49.888261 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12477dc6-43d6-45e8-8ffd-82ef215e0b00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55f5a23e96574e3fbe04a81c36393ada, user_id=0cebb8a02929482bb45e1ea1756466a3, role_id=1a1c43cc97a0407eb7a7c7a1333a9d4a)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:20:49.891121 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12477dc6-43d6-45e8-8ffd-82ef215e0b00 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:20:49.909117 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1452/2898] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 23:20:49 2022] PUT /identity/v3/projects/55f5a23e96574e3fbe04a81c36393ada/users/0cebb8a02929482bb45e1ea1756466a3/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 23:20:49.913236 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fe1089-8d69-43b0-ab56-0d3969d4ce6b admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:20:49.925320 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fe1089-8d69-43b0-ab56-0d3969d4ce6b admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:20:50.011818 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3bf50d-8f57-4fb6-a553-f2bfe6680308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:20:50.012811 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3bf50d-8f57-4fb6-a553-f2bfe6680308 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:20:50.013090 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3bf50d-8f57-4fb6-a553-f2bfe6680308 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:20:50.013372 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3bf50d-8f57-4fb6-a553-f2bfe6680308 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:20:50.014126 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3bf50d-8f57-4fb6-a553-f2bfe6680308 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:20:50.015833 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3bf50d-8f57-4fb6-a553-f2bfe6680308 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:20:50.027551 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1447/2899] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 23:20:49 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 23:20:50.033456 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12477dc6-43d6-45e8-8ffd-82ef215e0b00 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:20:50.049908 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12477dc6-43d6-45e8-8ffd-82ef215e0b00 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:20:50.056155 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6c2971-9a32-4fd2-9dc4-8fed464ba002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:20:50.057025 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c2971-9a32-4fd2-9dc4-8fed464ba002 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:20:50.057307 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c2971-9a32-4fd2-9dc4-8fed464ba002 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:20:50.057580 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c2971-9a32-4fd2-9dc4-8fed464ba002 admin admin] PATH_INFO: `/v3/projects/55f5a23e96574e3fbe04a81c36393ada/users/0cebb8a02929482bb45e1ea1756466a3/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:20:50.059948 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6c2971-9a32-4fd2-9dc4-8fed464ba002 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55f5a23e96574e3fbe04a81c36393ada, user_id=0cebb8a02929482bb45e1ea1756466a3, role_id=1a1c43cc97a0407eb7a7c7a1333a9d4a)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:20:50.062721 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6c2971-9a32-4fd2-9dc4-8fed464ba002 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:20:50.067054 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:20:50.077277 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1453/2900] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 23:20:50 2022] PUT /identity/v3/projects/55f5a23e96574e3fbe04a81c36393ada/users/0cebb8a02929482bb45e1ea1756466a3/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 23:20:50.090530 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a2a41d-ab16-412b-b89d-5fd0b655bdcf None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:20:50.090886 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a2a41d-ab16-412b-b89d-5fd0b655bdcf None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:20:50.091200 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a2a41d-ab16-412b-b89d-5fd0b655bdcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:20:50.127006 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-e9a2a41d-ab16-412b-b89d-5fd0b655bdcf None None] MFA Rules not processed for user `0cebb8a02929482bb45e1ea1756466a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 23:20:50.128894 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-e9a2a41d-ab16-412b-b89d-5fd0b655bdcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:20:50.212988 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:20:50.218627 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1448/2901] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 23:20:50 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 23:20:50.230147 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6c2971-9a32-4fd2-9dc4-8fed464ba002 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:20:50.232301 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-6a6c2971-9a32-4fd2-9dc4-8fed464ba002 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:20:50.293315 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6c2971-9a32-4fd2-9dc4-8fed464ba002 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:20:50.297409 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491caac1-9835-469c-b673-73ad29619f55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a747e2a5684843a6ee9e3480badac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:20:50.298208 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491caac1-9835-469c-b673-73ad29619f55 service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:20:50.298464 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491caac1-9835-469c-b673-73ad29619f55 service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:20:50.298733 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491caac1-9835-469c-b673-73ad29619f55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:20:50.309214 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491caac1-9835-469c-b673-73ad29619f55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:20:50.310652 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491caac1-9835-469c-b673-73ad29619f55 service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:20:50.321174 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1454/2902] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:20:50 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:20:50.466811 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a2a41d-ab16-412b-b89d-5fd0b655bdcf None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:20:50.530494 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a2a41d-ab16-412b-b89d-5fd0b655bdcf None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:20:50.535694 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95164a1-8eef-467c-92d7-6cb86ae94034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:20:50.536571 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95164a1-8eef-467c-92d7-6cb86ae94034 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:20:50.536847 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95164a1-8eef-467c-92d7-6cb86ae94034 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:20:50.537116 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95164a1-8eef-467c-92d7-6cb86ae94034 admin admin] PATH_INFO: `/v3/users/418735bd430d4d08b944684f5173b318` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:20:50.538338 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95164a1-8eef-467c-92d7-6cb86ae94034 admin admin] RBAC: Authorizing `identity:delete_user(user_id=418735bd430d4d08b944684f5173b318)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:20:50.540356 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95164a1-8eef-467c-92d7-6cb86ae94034 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:20:50.604148 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-a95164a1-8eef-467c-92d7-6cb86ae94034 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '418735bd430d4d08b944684f5173b318'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:20:50.611267 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-a95164a1-8eef-467c-92d7-6cb86ae94034 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '418735bd430d4d08b944684f5173b318'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:20:50.612002 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-a95164a1-8eef-467c-92d7-6cb86ae94034 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '418735bd430d4d08b944684f5173b318'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:20:50.612786 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-a95164a1-8eef-467c-92d7-6cb86ae94034 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '418735bd430d4d08b944684f5173b318'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:20:50.626945 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-a95164a1-8eef-467c-92d7-6cb86ae94034 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '418735bd430d4d08b944684f5173b318'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:20:50.644768 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1449/2903] 10.222.0.36 () {58 vars in 1223 bytes} [Fri Jun 24 23:20:50 2022] DELETE /identity/v3/users/418735bd430d4d08b944684f5173b318 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 23:20:50.649510 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c243317-a3a6-4f32-a826-b362b278acdc None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:20:50.649890 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c243317-a3a6-4f32-a826-b362b278acdc None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:20:50.650171 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c243317-a3a6-4f32-a826-b362b278acdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:20:50.668697 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-7c243317-a3a6-4f32-a826-b362b278acdc None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 23:20:50.669890 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-7c243317-a3a6-4f32-a826-b362b278acdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:20:50.740915 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1455/2904] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 23:20:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 23:20:50.756520 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95164a1-8eef-467c-92d7-6cb86ae94034 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:20:50.759138 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-a95164a1-8eef-467c-92d7-6cb86ae94034 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:20:50.831142 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95164a1-8eef-467c-92d7-6cb86ae94034 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:20:50.835453 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db232f3f-fab0-4a37-8f89-99bf0b37f80e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:20:50.836113 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db232f3f-fab0-4a37-8f89-99bf0b37f80e service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:20:50.836395 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db232f3f-fab0-4a37-8f89-99bf0b37f80e service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:20:50.836671 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db232f3f-fab0-4a37-8f89-99bf0b37f80e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:20:50.847080 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db232f3f-fab0-4a37-8f89-99bf0b37f80e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:20:50.848573 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db232f3f-fab0-4a37-8f89-99bf0b37f80e service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:20:50.858855 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1450/2905] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:20:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:20:51.157947 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c243317-a3a6-4f32-a826-b362b278acdc None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:20:51.159844 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-7c243317-a3a6-4f32-a826-b362b278acdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:20:51.172781 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c243317-a3a6-4f32-a826-b362b278acdc None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:20:51.178564 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703019e1-088b-4d7e-aa61-20d130efb1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:20:51.179447 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703019e1-088b-4d7e-aa61-20d130efb1a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:20:51.179730 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703019e1-088b-4d7e-aa61-20d130efb1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:20:51.180048 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703019e1-088b-4d7e-aa61-20d130efb1a8 admin admin] PATH_INFO: `/v3/projects/379bf400a0884b4aa14d9d6f2ac5e8b2` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:20:51.181300 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703019e1-088b-4d7e-aa61-20d130efb1a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=379bf400a0884b4aa14d9d6f2ac5e8b2)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:20:51.183324 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703019e1-088b-4d7e-aa61-20d130efb1a8 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:20:51.234799 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-703019e1-088b-4d7e-aa61-20d130efb1a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '379bf400a0884b4aa14d9d6f2ac5e8b2', 'request_id': 'req-703019e1-088b-4d7e-aa61-20d130efb1a8'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:20:51.241552 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-703019e1-088b-4d7e-aa61-20d130efb1a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '379bf400a0884b4aa14d9d6f2ac5e8b2', 'request_id': 'req-703019e1-088b-4d7e-aa61-20d130efb1a8'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:20:51.252141 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-703019e1-088b-4d7e-aa61-20d130efb1a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '379bf400a0884b4aa14d9d6f2ac5e8b2', 'request_id': 'req-703019e1-088b-4d7e-aa61-20d130efb1a8'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:20:51.262971 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-703019e1-088b-4d7e-aa61-20d130efb1a8 admin admin] The token cache is being invalidate because project 379bf400a0884b4aa14d9d6f2ac5e8b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 23:20:51.263280 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-703019e1-088b-4d7e-aa61-20d130efb1a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:20:51.263997 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-703019e1-088b-4d7e-aa61-20d130efb1a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:20:51.265567 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1456/2906] 10.222.0.36 () {58 vars in 1232 bytes} [Fri Jun 24 23:20:51 2022] DELETE /identity/v3/projects/379bf400a0884b4aa14d9d6f2ac5e8b2 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 23:20:51.269789 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db232f3f-fab0-4a37-8f89-99bf0b37f80e service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:20:51.279786 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db232f3f-fab0-4a37-8f89-99bf0b37f80e service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:20:51.300210 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:20:51.344249 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5213526-9943-4634-bf4f-eb37e53c8a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:20:51.345146 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5213526-9943-4634-bf4f-eb37e53c8a46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:20:51.345429 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5213526-9943-4634-bf4f-eb37e53c8a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:20:51.345705 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5213526-9943-4634-bf4f-eb37e53c8a46 admin admin] PATH_INFO: `/v3/users/0cebb8a02929482bb45e1ea1756466a3` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:20:51.346965 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5213526-9943-4634-bf4f-eb37e53c8a46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cebb8a02929482bb45e1ea1756466a3)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:20:51.348982 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5213526-9943-4634-bf4f-eb37e53c8a46 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:20:51.405145 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e5213526-9943-4634-bf4f-eb37e53c8a46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cebb8a02929482bb45e1ea1756466a3'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:20:51.412268 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e5213526-9943-4634-bf4f-eb37e53c8a46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cebb8a02929482bb45e1ea1756466a3'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:20:51.413048 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e5213526-9943-4634-bf4f-eb37e53c8a46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cebb8a02929482bb45e1ea1756466a3'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:20:51.413681 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e5213526-9943-4634-bf4f-eb37e53c8a46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cebb8a02929482bb45e1ea1756466a3'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:20:51.425815 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-e5213526-9943-4634-bf4f-eb37e53c8a46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cebb8a02929482bb45e1ea1756466a3'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:20:51.441165 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1451/2907] 10.222.0.36 () {58 vars in 1223 bytes} [Fri Jun 24 23:20:51 2022] DELETE /identity/v3/users/0cebb8a02929482bb45e1ea1756466a3 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 23:20:51.733066 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703019e1-088b-4d7e-aa61-20d130efb1a8 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:20:51.735019 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-703019e1-088b-4d7e-aa61-20d130efb1a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:20:51.749835 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703019e1-088b-4d7e-aa61-20d130efb1a8 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:20:51.769645 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:20:51.813123 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d79cf1-c830-4d35-acc4-d9ea95df5962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:20:51.814006 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d79cf1-c830-4d35-acc4-d9ea95df5962 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:20:51.814283 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d79cf1-c830-4d35-acc4-d9ea95df5962 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:20:51.814559 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d79cf1-c830-4d35-acc4-d9ea95df5962 admin admin] PATH_INFO: `/v3/projects/55f5a23e96574e3fbe04a81c36393ada` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:20:51.815954 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d79cf1-c830-4d35-acc4-d9ea95df5962 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55f5a23e96574e3fbe04a81c36393ada)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:20:51.817920 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d79cf1-c830-4d35-acc4-d9ea95df5962 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:20:51.866858 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-31d79cf1-c830-4d35-acc4-d9ea95df5962 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55f5a23e96574e3fbe04a81c36393ada', 'request_id': 'req-31d79cf1-c830-4d35-acc4-d9ea95df5962'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:20:51.873280 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-31d79cf1-c830-4d35-acc4-d9ea95df5962 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55f5a23e96574e3fbe04a81c36393ada', 'request_id': 'req-31d79cf1-c830-4d35-acc4-d9ea95df5962'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:20:51.883583 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-31d79cf1-c830-4d35-acc4-d9ea95df5962 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55f5a23e96574e3fbe04a81c36393ada', 'request_id': 'req-31d79cf1-c830-4d35-acc4-d9ea95df5962'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:20:51.894905 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-31d79cf1-c830-4d35-acc4-d9ea95df5962 admin admin] The token cache is being invalidate because project 55f5a23e96574e3fbe04a81c36393ada was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 23:20:51.895199 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-31d79cf1-c830-4d35-acc4-d9ea95df5962 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:20:51.895876 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-31d79cf1-c830-4d35-acc4-d9ea95df5962 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:20:51.897454 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1457/2908] 10.222.0.36 () {58 vars in 1232 bytes} [Fri Jun 24 23:20:51 2022] DELETE /identity/v3/projects/55f5a23e96574e3fbe04a81c36393ada => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 23:20:51.903656 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f867ce6d-6aaf-4bc4-a0f7-96957195fa34 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:20:51.904144 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f867ce6d-6aaf-4bc4-a0f7-96957195fa34 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:20:51.904234 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f867ce6d-6aaf-4bc4-a0f7-96957195fa34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:20:51.922971 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-f867ce6d-6aaf-4bc4-a0f7-96957195fa34 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 23:20:51.924136 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-f867ce6d-6aaf-4bc4-a0f7-96957195fa34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:20:51.990897 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1452/2909] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 23:20:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 23:20:52.002198 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee9f18-4ce3-4227-ae94-a83ae93de972 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:20:52.002495 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee9f18-4ce3-4227-ae94-a83ae93de972 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:20:52.003215 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee9f18-4ce3-4227-ae94-a83ae93de972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:20:52.022919 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-6eee9f18-4ce3-4227-ae94-a83ae93de972 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 23:20:52.024212 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-6eee9f18-4ce3-4227-ae94-a83ae93de972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:20:52.033942 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1458/2910] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 23:20:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 23:20:52.038434 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f867ce6d-6aaf-4bc4-a0f7-96957195fa34 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:20:52.048846 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f867ce6d-6aaf-4bc4-a0f7-96957195fa34 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:20:52.054913 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f6cce1-75b4-4bab-b02a-5964baecae3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:20:52.055607 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f6cce1-75b4-4bab-b02a-5964baecae3a admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:20:52.055890 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f6cce1-75b4-4bab-b02a-5964baecae3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:20:52.056166 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f6cce1-75b4-4bab-b02a-5964baecae3a admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:20:52.056893 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f6cce1-75b4-4bab-b02a-5964baecae3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 23:20:52.057200 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f6cce1-75b4-4bab-b02a-5964baecae3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:20:52.058812 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f6cce1-75b4-4bab-b02a-5964baecae3a admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:20:52.071242 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1453/2911] 10.222.0.36 () {58 vars in 1152 bytes} [Fri Jun 24 23:20:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 23:20:52.075701 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eee9f18-4ce3-4227-ae94-a83ae93de972 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:20:52.085664 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eee9f18-4ce3-4227-ae94-a83ae93de972 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:20:52.091381 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1ace52-f75b-4f83-a62b-1108aa4f2f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:20:52.092033 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ace52-f75b-4f83-a62b-1108aa4f2f3b admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:20:52.092318 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ace52-f75b-4f83-a62b-1108aa4f2f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:20:52.092589 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ace52-f75b-4f83-a62b-1108aa4f2f3b admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:20:52.093284 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1ace52-f75b-4f83-a62b-1108aa4f2f3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:20:52.095212 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1ace52-f75b-4f83-a62b-1108aa4f2f3b admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:20:52.131529 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1459/2912] 10.222.0.36 () {60 vars in 1152 bytes} [Fri Jun 24 23:20:52 2022] POST /identity/v3/projects => generated 375 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 23:20:52.135672 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f6cce1-75b4-4bab-b02a-5964baecae3a admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:20:52.150251 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f6cce1-75b4-4bab-b02a-5964baecae3a admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:20:52.179201 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:20:52.211616 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb0f95d-cc68-4c1f-952f-d01a3b9d9a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:20:52.212268 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb0f95d-cc68-4c1f-952f-d01a3b9d9a03 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:20:52.212547 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb0f95d-cc68-4c1f-952f-d01a3b9d9a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:20:52.212821 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb0f95d-cc68-4c1f-952f-d01a3b9d9a03 admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:20:52.213506 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb0f95d-cc68-4c1f-952f-d01a3b9d9a03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:20:52.215466 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb0f95d-cc68-4c1f-952f-d01a3b9d9a03 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:20:52.237808 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1454/2913] 10.222.0.36 () {60 vars in 1143 bytes} [Fri Jun 24 23:20:52 2022] POST /identity/v3/users => generated 288 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 23:20:52.242220 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1ace52-f75b-4f83-a62b-1108aa4f2f3b admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:20:52.252888 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1ace52-f75b-4f83-a62b-1108aa4f2f3b admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:20:52.258372 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd1a412-6715-4194-bbf8-90727465188d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:20:52.259036 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd1a412-6715-4194-bbf8-90727465188d admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:20:52.259380 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd1a412-6715-4194-bbf8-90727465188d admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:20:52.259655 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd1a412-6715-4194-bbf8-90727465188d admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:20:52.260381 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd1a412-6715-4194-bbf8-90727465188d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:20:52.262031 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd1a412-6715-4194-bbf8-90727465188d admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:20:52.275431 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1460/2914] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 23:20:52 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 23:20:52.279549 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb0f95d-cc68-4c1f-952f-d01a3b9d9a03 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:20:52.294405 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb0f95d-cc68-4c1f-952f-d01a3b9d9a03 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:20:52.302182 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b6a8e3-4f98-4b2d-a8f9-3526483f5f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:20:52.302853 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b6a8e3-4f98-4b2d-a8f9-3526483f5f76 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:20:52.303143 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b6a8e3-4f98-4b2d-a8f9-3526483f5f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:20:52.303470 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b6a8e3-4f98-4b2d-a8f9-3526483f5f76 admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:20:52.304216 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b6a8e3-4f98-4b2d-a8f9-3526483f5f76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:20:52.305873 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b6a8e3-4f98-4b2d-a8f9-3526483f5f76 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:20:52.316587 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1455/2915] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 23:20:52 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 23:20:52.320808 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd1a412-6715-4194-bbf8-90727465188d admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:20:52.332004 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd1a412-6715-4194-bbf8-90727465188d admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:20:52.337475 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c732e8b1-046a-48ed-b3c9-f943bf44c6d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:20:52.338362 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c732e8b1-046a-48ed-b3c9-f943bf44c6d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:20:52.338638 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c732e8b1-046a-48ed-b3c9-f943bf44c6d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:20:52.338906 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c732e8b1-046a-48ed-b3c9-f943bf44c6d5 admin admin] PATH_INFO: `/v3/projects/3172f152fdeb43a0a2ea6a1e3ef78f34/users/1901a68f03e2440cb22c9028c5af1055/roles/1928787bfcc745419829cd315900ac44` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:20:52.353891 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c732e8b1-046a-48ed-b3c9-f943bf44c6d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3172f152fdeb43a0a2ea6a1e3ef78f34, user_id=1901a68f03e2440cb22c9028c5af1055, role_id=1928787bfcc745419829cd315900ac44)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:20:52.356639 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c732e8b1-046a-48ed-b3c9-f943bf44c6d5 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:20:52.372735 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1461/2916] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 23:20:52 2022] PUT /identity/v3/projects/3172f152fdeb43a0a2ea6a1e3ef78f34/users/1901a68f03e2440cb22c9028c5af1055/roles/1928787bfcc745419829cd315900ac44 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 23:20:52.384151 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4fce71-e956-484a-af31-3133da4d2690 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:20:52.384471 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4fce71-e956-484a-af31-3133da4d2690 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:20:52.384755 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4fce71-e956-484a-af31-3133da4d2690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:20:52.412195 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-0c4fce71-e956-484a-af31-3133da4d2690 None None] MFA Rules not processed for user `1901a68f03e2440cb22c9028c5af1055`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 23:20:52.413417 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-0c4fce71-e956-484a-af31-3133da4d2690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:20:52.484722 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1456/2917] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 23:20:52 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 23:20:52.503434 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c732e8b1-046a-48ed-b3c9-f943bf44c6d5 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:20:52.505447 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-c732e8b1-046a-48ed-b3c9-f943bf44c6d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:20:52.564721 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:20:52.569528 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c732e8b1-046a-48ed-b3c9-f943bf44c6d5 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:20:52.574036 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f00713-96e9-43ef-bfee-d26463b70eea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4a747e2a5684843a6ee9e3480badac7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:20:52.574701 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f00713-96e9-43ef-bfee-d26463b70eea service cinder] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:20:52.574991 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f00713-96e9-43ef-bfee-d26463b70eea service cinder] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:20:52.575597 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f00713-96e9-43ef-bfee-d26463b70eea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:20:52.585100 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f00713-96e9-43ef-bfee-d26463b70eea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:20:52.586576 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f00713-96e9-43ef-bfee-d26463b70eea service cinder] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:20:52.595771 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1462/2918] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:20:52 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:21:02.481004 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=53,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:21:02.573878 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4fce71-e956-484a-af31-3133da4d2690 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:21:02.591505 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=4 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:21:02.644219 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4fce71-e956-484a-af31-3133da4d2690 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:21:02.649557 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c737edc-079f-473c-9dbe-acef4bdbd5a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:21:02.650439 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c737edc-079f-473c-9dbe-acef4bdbd5a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:21:02.650718 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c737edc-079f-473c-9dbe-acef4bdbd5a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:21:02.650994 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c737edc-079f-473c-9dbe-acef4bdbd5a0 admin admin] PATH_INFO: `/v3/users/1901a68f03e2440cb22c9028c5af1055` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:21:02.652285 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c737edc-079f-473c-9dbe-acef4bdbd5a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1901a68f03e2440cb22c9028c5af1055)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:21:02.654223 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c737edc-079f-473c-9dbe-acef4bdbd5a0 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:21:02.712894 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-5c737edc-079f-473c-9dbe-acef4bdbd5a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1901a68f03e2440cb22c9028c5af1055'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:21:02.719573 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-5c737edc-079f-473c-9dbe-acef4bdbd5a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1901a68f03e2440cb22c9028c5af1055'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:21:02.720289 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-5c737edc-079f-473c-9dbe-acef4bdbd5a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1901a68f03e2440cb22c9028c5af1055'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:21:02.720956 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-5c737edc-079f-473c-9dbe-acef4bdbd5a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1901a68f03e2440cb22c9028c5af1055'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:21:02.733007 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-5c737edc-079f-473c-9dbe-acef4bdbd5a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1901a68f03e2440cb22c9028c5af1055'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:21:02.747114 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1457/2919] 10.222.0.36 () {58 vars in 1223 bytes} [Fri Jun 24 23:21:02 2022] DELETE /identity/v3/users/1901a68f03e2440cb22c9028c5af1055 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 23:21:02.752002 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fbdfe4-1873-48f5-b962-33913d937699 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:21:02.752338 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fbdfe4-1873-48f5-b962-33913d937699 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:21:02.752681 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fbdfe4-1873-48f5-b962-33913d937699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:21:02.770150 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-f1fbdfe4-1873-48f5-b962-33913d937699 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 23:21:02.771371 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-f1fbdfe4-1873-48f5-b962-33913d937699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:21:02.840838 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1463/2920] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 23:21:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 23:21:02.850999 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c737edc-079f-473c-9dbe-acef4bdbd5a0 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:21:02.852720 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-5c737edc-079f-473c-9dbe-acef4bdbd5a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:21:02.912836 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c737edc-079f-473c-9dbe-acef4bdbd5a0 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:21:02.918888 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c64b6cb-7a7f-4a8b-94d1-061cbb2d718c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:21:02.919752 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c64b6cb-7a7f-4a8b-94d1-061cbb2d718c service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:21:02.920111 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c64b6cb-7a7f-4a8b-94d1-061cbb2d718c service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:21:02.920473 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c64b6cb-7a7f-4a8b-94d1-061cbb2d718c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:21:02.936390 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c64b6cb-7a7f-4a8b-94d1-061cbb2d718c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:21:02.938646 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c64b6cb-7a7f-4a8b-94d1-061cbb2d718c service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:21:02.952242 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1458/2921] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:21:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:21:03.253577 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fbdfe4-1873-48f5-b962-33913d937699 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:21:03.255050 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-f1fbdfe4-1873-48f5-b962-33913d937699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:21:03.267473 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fbdfe4-1873-48f5-b962-33913d937699 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:21:03.273018 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8804897a-5816-4e88-887e-958fad56749e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:21:03.273907 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8804897a-5816-4e88-887e-958fad56749e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:21:03.274184 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8804897a-5816-4e88-887e-958fad56749e admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:21:03.274546 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8804897a-5816-4e88-887e-958fad56749e admin admin] PATH_INFO: `/v3/projects/3172f152fdeb43a0a2ea6a1e3ef78f34` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:21:03.275876 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8804897a-5816-4e88-887e-958fad56749e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3172f152fdeb43a0a2ea6a1e3ef78f34)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:21:03.277835 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8804897a-5816-4e88-887e-958fad56749e admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:21:03.328155 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-8804897a-5816-4e88-887e-958fad56749e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3172f152fdeb43a0a2ea6a1e3ef78f34', 'request_id': 'req-8804897a-5816-4e88-887e-958fad56749e'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:21:03.334647 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-8804897a-5816-4e88-887e-958fad56749e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3172f152fdeb43a0a2ea6a1e3ef78f34', 'request_id': 'req-8804897a-5816-4e88-887e-958fad56749e'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:21:03.343268 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-8804897a-5816-4e88-887e-958fad56749e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3172f152fdeb43a0a2ea6a1e3ef78f34', 'request_id': 'req-8804897a-5816-4e88-887e-958fad56749e'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:21:03.354199 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-8804897a-5816-4e88-887e-958fad56749e admin admin] The token cache is being invalidate because project 3172f152fdeb43a0a2ea6a1e3ef78f34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80215) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 23:21:03.354482 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-8804897a-5816-4e88-887e-958fad56749e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:21:03.355102 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-8804897a-5816-4e88-887e-958fad56749e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:21:03.356683 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1464/2922] 10.222.0.36 () {58 vars in 1232 bytes} [Fri Jun 24 23:21:03 2022] DELETE /identity/v3/projects/3172f152fdeb43a0a2ea6a1e3ef78f34 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 23:21:03.362359 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8288b05-5ab2-44ce-ad66-c4f7cd43044b None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:21:03.362644 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8288b05-5ab2-44ce-ad66-c4f7cd43044b None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:21:03.362915 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8288b05-5ab2-44ce-ad66-c4f7cd43044b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:21:03.380554 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-f8288b05-5ab2-44ce-ad66-c4f7cd43044b None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 23:21:03.381767 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-f8288b05-5ab2-44ce-ad66-c4f7cd43044b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:21:03.399809 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:21:03.444820 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1459/2923] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 23:21:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 23:21:03.453132 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d825bd89-76c7-44ee-b6ca-bb9a3ef53c00 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:21:03.453498 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d825bd89-76c7-44ee-b6ca-bb9a3ef53c00 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:21:03.453844 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d825bd89-76c7-44ee-b6ca-bb9a3ef53c00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:21:03.473369 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-d825bd89-76c7-44ee-b6ca-bb9a3ef53c00 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 23:21:03.474580 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-d825bd89-76c7-44ee-b6ca-bb9a3ef53c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:21:03.483905 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1465/2924] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 23:21:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 23:21:03.489892 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8288b05-5ab2-44ce-ad66-c4f7cd43044b None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:21:03.501981 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8288b05-5ab2-44ce-ad66-c4f7cd43044b None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:21:03.507566 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a846830-23ea-43c9-89ca-861b5272aeb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:21:03.508233 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a846830-23ea-43c9-89ca-861b5272aeb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:21:03.508511 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a846830-23ea-43c9-89ca-861b5272aeb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:21:03.508910 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a846830-23ea-43c9-89ca-861b5272aeb1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:21:03.510003 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a846830-23ea-43c9-89ca-861b5272aeb1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80214) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 23:21:03.510315 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a846830-23ea-43c9-89ca-861b5272aeb1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:21:03.511992 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a846830-23ea-43c9-89ca-861b5272aeb1 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:21:03.524071 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1460/2925] 10.222.0.36 () {58 vars in 1152 bytes} [Fri Jun 24 23:21:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 23:21:03.528620 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d825bd89-76c7-44ee-b6ca-bb9a3ef53c00 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:21:03.538472 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d825bd89-76c7-44ee-b6ca-bb9a3ef53c00 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:21:03.544616 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0195784-217c-47fd-955e-593780ce0553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:21:03.545279 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0195784-217c-47fd-955e-593780ce0553 admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:21:03.545562 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0195784-217c-47fd-955e-593780ce0553 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:21:03.545834 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0195784-217c-47fd-955e-593780ce0553 admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:21:03.546511 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0195784-217c-47fd-955e-593780ce0553 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:21:03.548465 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0195784-217c-47fd-955e-593780ce0553 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:21:03.577090 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1466/2926] 10.222.0.36 () {60 vars in 1152 bytes} [Fri Jun 24 23:21:03 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 23:21:03.581372 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a846830-23ea-43c9-89ca-861b5272aeb1 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:21:03.592158 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a846830-23ea-43c9-89ca-861b5272aeb1 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:21:03.652151 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946ec976-4548-43ba-99f4-d65d34acf999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:21:03.652821 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946ec976-4548-43ba-99f4-d65d34acf999 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:21:03.653114 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946ec976-4548-43ba-99f4-d65d34acf999 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:21:03.653393 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946ec976-4548-43ba-99f4-d65d34acf999 admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:21:03.654082 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946ec976-4548-43ba-99f4-d65d34acf999 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:21:03.656104 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946ec976-4548-43ba-99f4-d65d34acf999 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:21:03.678082 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1461/2927] 10.222.0.36 () {60 vars in 1143 bytes} [Fri Jun 24 23:21:03 2022] POST /identity/v3/users => generated 286 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 23:21:03.683691 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0195784-217c-47fd-955e-593780ce0553 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:21:03.694699 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0195784-217c-47fd-955e-593780ce0553 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:21:03.701095 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b04a96a-6a2f-4d76-8bd8-247ab6730b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:21:03.701792 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b04a96a-6a2f-4d76-8bd8-247ab6730b21 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:21:03.702069 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b04a96a-6a2f-4d76-8bd8-247ab6730b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:21:03.702338 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b04a96a-6a2f-4d76-8bd8-247ab6730b21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:21:03.703771 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b04a96a-6a2f-4d76-8bd8-247ab6730b21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:21:03.705388 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b04a96a-6a2f-4d76-8bd8-247ab6730b21 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:21:03.716434 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1467/2928] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 23:21:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 23:21:03.720567 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946ec976-4548-43ba-99f4-d65d34acf999 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:21:03.731062 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946ec976-4548-43ba-99f4-d65d34acf999 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:21:03.736421 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092d0d09-bd82-4836-a957-9dbc93874f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:21:03.737081 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092d0d09-bd82-4836-a957-9dbc93874f8b admin admin] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:21:03.737368 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092d0d09-bd82-4836-a957-9dbc93874f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:21:03.737644 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092d0d09-bd82-4836-a957-9dbc93874f8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:21:03.738383 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092d0d09-bd82-4836-a957-9dbc93874f8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:21:03.740087 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092d0d09-bd82-4836-a957-9dbc93874f8b admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:21:03.750900 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1462/2929] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 23:21:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 23:21:03.755307 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b04a96a-6a2f-4d76-8bd8-247ab6730b21 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:21:03.765780 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b04a96a-6a2f-4d76-8bd8-247ab6730b21 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:21:03.771707 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906a3764-902d-48d4-a91d-6b805190dcef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:21:03.772598 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906a3764-902d-48d4-a91d-6b805190dcef admin admin] REQUEST_METHOD: `PUT` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:21:03.772878 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906a3764-902d-48d4-a91d-6b805190dcef admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:21:03.773147 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906a3764-902d-48d4-a91d-6b805190dcef admin admin] PATH_INFO: `/v3/projects/4affab7adf32480eb257f907a2277dd1/users/c88eeecaa0734de29f2ebe6fcf53cc10/roles/1928787bfcc745419829cd315900ac44` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:21:03.789568 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906a3764-902d-48d4-a91d-6b805190dcef admin admin] RBAC: Authorizing `identity:create_grant(project_id=4affab7adf32480eb257f907a2277dd1, user_id=c88eeecaa0734de29f2ebe6fcf53cc10, role_id=1928787bfcc745419829cd315900ac44)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:21:03.792529 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906a3764-902d-48d4-a91d-6b805190dcef admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:21:03.809550 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1468/2930] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 23:21:03 2022] PUT /identity/v3/projects/4affab7adf32480eb257f907a2277dd1/users/c88eeecaa0734de29f2ebe6fcf53cc10/roles/1928787bfcc745419829cd315900ac44 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 23:21:03.815008 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d511dce0-4915-4173-9bbc-697ba0ece696 None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:21:03.815329 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d511dce0-4915-4173-9bbc-697ba0ece696 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:21:03.815609 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d511dce0-4915-4173-9bbc-697ba0ece696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:21:03.833581 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-d511dce0-4915-4173-9bbc-697ba0ece696 None None] MFA Rules not processed for user `e1b71ca6ab0b436d901fe1079176cb45`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 23:21:03.834782 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-d511dce0-4915-4173-9bbc-697ba0ece696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:21:03.900767 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1463/2931] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 23:21:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 23:21:03.912525 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906a3764-902d-48d4-a91d-6b805190dcef admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:21:03.914402 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-906a3764-902d-48d4-a91d-6b805190dcef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:21:03.938506 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:21:03.976774 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906a3764-902d-48d4-a91d-6b805190dcef admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:21:03.980964 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763718b8-9ab8-4f92-a32e-dac1803aac54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:21:03.981615 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763718b8-9ab8-4f92-a32e-dac1803aac54 service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:21:03.981896 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763718b8-9ab8-4f92-a32e-dac1803aac54 service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:21:03.982172 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763718b8-9ab8-4f92-a32e-dac1803aac54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:21:03.992051 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763718b8-9ab8-4f92-a32e-dac1803aac54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:21:03.993763 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763718b8-9ab8-4f92-a32e-dac1803aac54 service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:21:04.003693 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1469/2932] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:21:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:21:07.773848 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b996e7b-62e8-4d5e-a2dd-aca1128837db None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:21:07.774424 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b996e7b-62e8-4d5e-a2dd-aca1128837db None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:21:07.774726 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b996e7b-62e8-4d5e-a2dd-aca1128837db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:21:07.802851 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-3b996e7b-62e8-4d5e-a2dd-aca1128837db None None] MFA Rules not processed for user `c88eeecaa0734de29f2ebe6fcf53cc10`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 23:21:07.804189 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-3b996e7b-62e8-4d5e-a2dd-aca1128837db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:21:07.823686 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:21:07.875157 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1464/2933] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 23:21:07 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 23:21:07.879510 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763718b8-9ab8-4f92-a32e-dac1803aac54 service neutron] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:21:07.890731 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763718b8-9ab8-4f92-a32e-dac1803aac54 service neutron] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:21:07.895244 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1074ff36-cccf-45f6-adb0-473cca0b388c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:21:07.895966 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1074ff36-cccf-45f6-adb0-473cca0b388c admin admin] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:21:07.896244 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1074ff36-cccf-45f6-adb0-473cca0b388c admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:21:07.896515 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1074ff36-cccf-45f6-adb0-473cca0b388c admin admin] PATH_INFO: `/v3/projects` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:21:07.897240 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1074ff36-cccf-45f6-adb0-473cca0b388c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:21:07.899390 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1074ff36-cccf-45f6-adb0-473cca0b388c admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:21:07.927355 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1470/2934] 10.222.0.36 () {60 vars in 1152 bytes} [Fri Jun 24 23:21:07 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 23:21:07.931534 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b996e7b-62e8-4d5e-a2dd-aca1128837db None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:21:07.943393 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b996e7b-62e8-4d5e-a2dd-aca1128837db None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:21:08.002454 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eca0df-b157-427c-8ac2-4be7538dec60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:21:08.003143 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eca0df-b157-427c-8ac2-4be7538dec60 admin admin] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:21:08.003458 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eca0df-b157-427c-8ac2-4be7538dec60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:21:08.003730 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eca0df-b157-427c-8ac2-4be7538dec60 admin admin] PATH_INFO: `/v3/users` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:21:08.004422 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eca0df-b157-427c-8ac2-4be7538dec60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:21:08.006358 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eca0df-b157-427c-8ac2-4be7538dec60 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:21:08.028869 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1465/2935] 10.222.0.36 () {60 vars in 1143 bytes} [Fri Jun 24 23:21:07 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 23:21:08.032966 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1074ff36-cccf-45f6-adb0-473cca0b388c admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:21:08.044782 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1074ff36-cccf-45f6-adb0-473cca0b388c admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:21:08.050014 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b211d8e9-c39c-4593-86a7-8a7b8b6f8ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:21:08.050783 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b211d8e9-c39c-4593-86a7-8a7b8b6f8ae7 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:21:08.051132 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b211d8e9-c39c-4593-86a7-8a7b8b6f8ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:21:08.051500 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b211d8e9-c39c-4593-86a7-8a7b8b6f8ae7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:21:08.052304 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b211d8e9-c39c-4593-86a7-8a7b8b6f8ae7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:21:08.054017 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b211d8e9-c39c-4593-86a7-8a7b8b6f8ae7 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:21:08.066062 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1471/2936] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 23:21:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 23:21:08.070125 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eca0df-b157-427c-8ac2-4be7538dec60 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:21:08.081197 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eca0df-b157-427c-8ac2-4be7538dec60 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:21:08.085994 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c4643e-0768-4cb2-a579-7ec41ed766c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:21:08.086955 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c4643e-0768-4cb2-a579-7ec41ed766c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:21:08.087202 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c4643e-0768-4cb2-a579-7ec41ed766c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:21:08.087617 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c4643e-0768-4cb2-a579-7ec41ed766c7 admin admin] PATH_INFO: `/v3/projects/7c26645246f244f6b4355274d7437ae2/users/19989ed54e76428382d66be5ab18c9a5/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:21:08.104227 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c4643e-0768-4cb2-a579-7ec41ed766c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c26645246f244f6b4355274d7437ae2, user_id=19989ed54e76428382d66be5ab18c9a5, role_id=1a1c43cc97a0407eb7a7c7a1333a9d4a)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:21:08.106995 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c4643e-0768-4cb2-a579-7ec41ed766c7 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:21:08.122767 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1466/2937] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 23:21:08 2022] PUT /identity/v3/projects/7c26645246f244f6b4355274d7437ae2/users/19989ed54e76428382d66be5ab18c9a5/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 23:21:08.126938 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b211d8e9-c39c-4593-86a7-8a7b8b6f8ae7 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:21:08.137630 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b211d8e9-c39c-4593-86a7-8a7b8b6f8ae7 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:21:08.197268 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee3238e-9466-44c4-9b6c-df5cbaab35f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:21:08.198259 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee3238e-9466-44c4-9b6c-df5cbaab35f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:21:08.198708 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee3238e-9466-44c4-9b6c-df5cbaab35f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:21:08.198983 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee3238e-9466-44c4-9b6c-df5cbaab35f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:21:08.199785 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee3238e-9466-44c4-9b6c-df5cbaab35f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:21:08.201447 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee3238e-9466-44c4-9b6c-df5cbaab35f7 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:21:08.212429 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1472/2938] 10.222.0.36 () {58 vars in 1121 bytes} [Fri Jun 24 23:21:08 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 23:21:08.216572 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c4643e-0768-4cb2-a579-7ec41ed766c7 admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:21:08.227849 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c4643e-0768-4cb2-a579-7ec41ed766c7 admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:21:08.232843 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7d9aa6-dff6-44aa-a945-722de569a6ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:21:08.233747 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7d9aa6-dff6-44aa-a945-722de569a6ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:21:08.234374 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7d9aa6-dff6-44aa-a945-722de569a6ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:21:08.234653 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7d9aa6-dff6-44aa-a945-722de569a6ec admin admin] PATH_INFO: `/v3/projects/7c26645246f244f6b4355274d7437ae2/users/19989ed54e76428382d66be5ab18c9a5/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:21:08.236676 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7d9aa6-dff6-44aa-a945-722de569a6ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c26645246f244f6b4355274d7437ae2, user_id=19989ed54e76428382d66be5ab18c9a5, role_id=1a1c43cc97a0407eb7a7c7a1333a9d4a)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:21:08.239358 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7d9aa6-dff6-44aa-a945-722de569a6ec admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:21:08.250184 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1467/2939] 10.222.0.36 () {60 vars in 1482 bytes} [Fri Jun 24 23:21:08 2022] PUT /identity/v3/projects/7c26645246f244f6b4355274d7437ae2/users/19989ed54e76428382d66be5ab18c9a5/roles/1a1c43cc97a0407eb7a7c7a1333a9d4a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 23:21:12.787097 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12db6d90-d0a1-491e-b394-9ec31ce460ca None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:21:12.787653 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12db6d90-d0a1-491e-b394-9ec31ce460ca None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:21:12.788030 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12db6d90-d0a1-491e-b394-9ec31ce460ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:21:12.828169 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-12db6d90-d0a1-491e-b394-9ec31ce460ca None None] MFA Rules not processed for user `19989ed54e76428382d66be5ab18c9a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 23:21:12.829672 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-12db6d90-d0a1-491e-b394-9ec31ce460ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:21:12.929813 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1473/2940] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 23:21:12 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 23:21:12.945085 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7d9aa6-dff6-44aa-a945-722de569a6ec admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:21:12.947348 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-fc7d9aa6-dff6-44aa-a945-722de569a6ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:21:13.034528 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7d9aa6-dff6-44aa-a945-722de569a6ec admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:21:13.041250 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6030a511-4acb-4898-b0a5-91a68b64690d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214d9071042c4bad886bf060a079b6e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:21:13.042645 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6030a511-4acb-4898-b0a5-91a68b64690d service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:21:13.042960 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6030a511-4acb-4898-b0a5-91a68b64690d service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:21:13.043238 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6030a511-4acb-4898-b0a5-91a68b64690d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:21:13.050036 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:21:13.114352 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6030a511-4acb-4898-b0a5-91a68b64690d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:21:13.116145 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6030a511-4acb-4898-b0a5-91a68b64690d service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:21:13.127711 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1468/2941] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:21:12 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:21:14.201626 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9850c482-a408-4054-acaf-eb90b2455194 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:21:14.202191 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9850c482-a408-4054-acaf-eb90b2455194 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:21:14.202304 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9850c482-a408-4054-acaf-eb90b2455194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:21:14.225705 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-9850c482-a408-4054-acaf-eb90b2455194 None None] MFA Rules not processed for user `c88eeecaa0734de29f2ebe6fcf53cc10`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 23:21:14.227559 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-9850c482-a408-4054-acaf-eb90b2455194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:21:14.236410 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1474/2942] 10.222.0.36 () {58 vars in 957 bytes} [Fri Jun 24 23:21:14 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 23:21:23.123438 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=24 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:21:24.217338 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=97,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:21:39.306876 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6030a511-4acb-4898-b0a5-91a68b64690d service nova] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:21:39.366002 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6030a511-4acb-4898-b0a5-91a68b64690d service nova] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:21:39.369810 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d2e973-22fe-4e8f-9295-f68056dc7d5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:21:39.370464 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d2e973-22fe-4e8f-9295-f68056dc7d5c service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:21:39.370745 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d2e973-22fe-4e8f-9295-f68056dc7d5c service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:21:39.371022 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d2e973-22fe-4e8f-9295-f68056dc7d5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:21:39.372855 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-c1d2e973-22fe-4e8f-9295-f68056dc7d5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:21:39.382667 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d2e973-22fe-4e8f-9295-f68056dc7d5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:21:39.384350 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d2e973-22fe-4e8f-9295-f68056dc7d5c service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:21:39.392635 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1469/2943] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:21:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:21:42.142142 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9850c482-a408-4054-acaf-eb90b2455194 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:21:42.154006 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9850c482-a408-4054-acaf-eb90b2455194 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:21:42.157697 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56be459d-0310-47b9-a1ee-3178efc4f77a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:21:42.158362 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56be459d-0310-47b9-a1ee-3178efc4f77a service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:21:42.158663 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56be459d-0310-47b9-a1ee-3178efc4f77a service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:21:42.158939 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56be459d-0310-47b9-a1ee-3178efc4f77a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:21:42.160802 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-56be459d-0310-47b9-a1ee-3178efc4f77a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:21:42.171809 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56be459d-0310-47b9-a1ee-3178efc4f77a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:21:42.173313 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56be459d-0310-47b9-a1ee-3178efc4f77a service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:21:42.189142 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1475/2944] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:21:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:21:49.388980 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=26 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:21:52.184558 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=6 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:21:58.148117 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d2e973-22fe-4e8f-9295-f68056dc7d5c service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:21:58.157455 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d2e973-22fe-4e8f-9295-f68056dc7d5c service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:21:58.161576 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75fda42-b0e2-4cb4-85fe-726307848ff5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:21:58.162219 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75fda42-b0e2-4cb4-85fe-726307848ff5 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:21:58.162502 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75fda42-b0e2-4cb4-85fe-726307848ff5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:21:58.162769 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75fda42-b0e2-4cb4-85fe-726307848ff5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:21:58.172689 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75fda42-b0e2-4cb4-85fe-726307848ff5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:21:58.174145 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75fda42-b0e2-4cb4-85fe-726307848ff5 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:21:58.183908 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1470/2945] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:21:58 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:22:08.179642 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=6 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:22:36.827385 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56be459d-0310-47b9-a1ee-3178efc4f77a service neutron] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:22:36.829033 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-56be459d-0310-47b9-a1ee-3178efc4f77a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:22:36.934428 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56be459d-0310-47b9-a1ee-3178efc4f77a service neutron] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:22:36.940720 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d566c4f7-47dc-4bd4-b222-d03c63f893c8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0233b357708643be94c0ade17ac1fb3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:22:36.941364 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d566c4f7-47dc-4bd4-b222-d03c63f893c8 service placement] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:22:36.941641 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d566c4f7-47dc-4bd4-b222-d03c63f893c8 service placement] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:22:36.941910 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d566c4f7-47dc-4bd4-b222-d03c63f893c8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:22:36.944124 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-d566c4f7-47dc-4bd4-b222-d03c63f893c8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:22:36.955879 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d566c4f7-47dc-4bd4-b222-d03c63f893c8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:22:36.957473 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d566c4f7-47dc-4bd4-b222-d03c63f893c8 service placement] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:22:36.967414 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1476/2946] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:22:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:22:46.963310 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=45 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:24:19.877781 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75fda42-b0e2-4cb4-85fe-726307848ff5 service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:24:19.904626 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75fda42-b0e2-4cb4-85fe-726307848ff5 service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:24:19.909249 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a469b17-ed6e-49b1-973b-8a5698c9bb45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:24:19.909891 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a469b17-ed6e-49b1-973b-8a5698c9bb45 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:24:19.910207 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a469b17-ed6e-49b1-973b-8a5698c9bb45 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:24:19.910479 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a469b17-ed6e-49b1-973b-8a5698c9bb45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:24:19.912616 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-9a469b17-ed6e-49b1-973b-8a5698c9bb45 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:24:19.947967 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a469b17-ed6e-49b1-973b-8a5698c9bb45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:24:19.949410 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a469b17-ed6e-49b1-973b-8a5698c9bb45 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:24:19.960583 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1471/2947] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:24:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:24:21.148942 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d566c4f7-47dc-4bd4-b222-d03c63f893c8 service placement] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:24:21.170940 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d566c4f7-47dc-4bd4-b222-d03c63f893c8 service placement] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:24:21.175194 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc4eb42-8333-4262-b63f-0ed1d68a3c25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:24:21.175891 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc4eb42-8333-4262-b63f-0ed1d68a3c25 service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:24:21.176183 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc4eb42-8333-4262-b63f-0ed1d68a3c25 service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:24:21.176489 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc4eb42-8333-4262-b63f-0ed1d68a3c25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:24:21.178625 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-3cc4eb42-8333-4262-b63f-0ed1d68a3c25 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:24:21.195262 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc4eb42-8333-4262-b63f-0ed1d68a3c25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:24:21.197609 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc4eb42-8333-4262-b63f-0ed1d68a3c25 service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:24:21.214046 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1477/2948] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:24:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:24:28.512637 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a469b17-ed6e-49b1-973b-8a5698c9bb45 service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:24:28.522758 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a469b17-ed6e-49b1-973b-8a5698c9bb45 service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:24:28.527221 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858795b6-0aa2-494f-81fd-d25f6470cfb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:24:28.527895 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858795b6-0aa2-494f-81fd-d25f6470cfb7 service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:24:28.528181 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858795b6-0aa2-494f-81fd-d25f6470cfb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:24:28.528456 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858795b6-0aa2-494f-81fd-d25f6470cfb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:24:28.531052 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-858795b6-0aa2-494f-81fd-d25f6470cfb7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:24:28.541428 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858795b6-0aa2-494f-81fd-d25f6470cfb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:24:28.542874 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858795b6-0aa2-494f-81fd-d25f6470cfb7 service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:24:28.552473 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1472/2949] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:24:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:24:28.687708 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe31f0d-6748-4a0f-9e46-da225fc5f84b None None] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:24:28.688405 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe31f0d-6748-4a0f-9e46-da225fc5f84b None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:24:28.688693 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe31f0d-6748-4a0f-9e46-da225fc5f84b None None] PATH_INFO: `/` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:24:28.690216 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1478/2950] 10.222.0.36 () {54 vars in 921 bytes} [Fri Jun 24 23:24:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 23:24:28.696078 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f839fd59-de23-4b72-a270-1f2a24c663fc None None] REQUEST_METHOD: `POST` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:24:28.696372 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f839fd59-de23-4b72-a270-1f2a24c663fc None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:24:28.696681 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f839fd59-de23-4b72-a270-1f2a24c663fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:24:28.736687 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.auth.core [None req-f839fd59-de23-4b72-a270-1f2a24c663fc None None] MFA Rules not processed for user `b78f1fcce4174d1a931453d930d306f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80214) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 23:24:28.737943 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-f839fd59-de23-4b72-a270-1f2a24c663fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:24:28.747537 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1473/2951] 10.222.0.36 () {58 vars in 1018 bytes} [Fri Jun 24 23:24:28 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 23:24:28.762830 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe31f0d-6748-4a0f-9e46-da225fc5f84b None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:24:28.764776 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-ffe31f0d-6748-4a0f-9e46-da225fc5f84b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:24:28.778809 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe31f0d-6748-4a0f-9e46-da225fc5f84b None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:24:28.782725 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2973705a-2d18-4c5f-afe9-283e700acc17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:24:28.783502 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2973705a-2d18-4c5f-afe9-283e700acc17 service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:24:28.783789 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2973705a-2d18-4c5f-afe9-283e700acc17 service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:24:28.784063 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2973705a-2d18-4c5f-afe9-283e700acc17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:24:28.791915 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2973705a-2d18-4c5f-afe9-283e700acc17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:24:28.793421 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2973705a-2d18-4c5f-afe9-283e700acc17 service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:24:28.802254 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1479/2952] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:24:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:24:28.890138 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53472951-ec43-4612-b41f-63884d7453b0 None None] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:24:28.891106 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53472951-ec43-4612-b41f-63884d7453b0 None None] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:24:28.891440 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53472951-ec43-4612-b41f-63884d7453b0 None None] PATH_INFO: `/` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:24:28.892863 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1474/2953] 10.222.0.36 () {54 vars in 921 bytes} [Fri Jun 24 23:24:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 23:24:28.898465 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0fbfb1-17b2-418c-bcf2-3b344c70e5a2 None None] REQUEST_METHOD: `POST` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:24:28.898756 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0fbfb1-17b2-418c-bcf2-3b344c70e5a2 None None] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:24:28.899028 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0fbfb1-17b2-418c-bcf2-3b344c70e5a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:24:28.938835 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.auth.core [None req-3a0fbfb1-17b2-418c-bcf2-3b344c70e5a2 None None] MFA Rules not processed for user `214d9071042c4bad886bf060a079b6e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80215) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 23:24:28.940060 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-3a0fbfb1-17b2-418c-bcf2-3b344c70e5a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:24:28.950829 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1480/2954] 10.222.0.36 () {58 vars in 1018 bytes} [Fri Jun 24 23:24:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 23:24:28.962127 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53472951-ec43-4612-b41f-63884d7453b0 None None] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:24:28.975574 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53472951-ec43-4612-b41f-63884d7453b0 None None] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:24:28.979717 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541fcc76-ab7a-4ac5-b580-bb8234d5f40f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:24:28.980362 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541fcc76-ab7a-4ac5-b580-bb8234d5f40f service neutron] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:24:28.980650 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541fcc76-ab7a-4ac5-b580-bb8234d5f40f service neutron] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:24:28.980922 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541fcc76-ab7a-4ac5-b580-bb8234d5f40f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:24:28.992806 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541fcc76-ab7a-4ac5-b580-bb8234d5f40f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:24:28.994272 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541fcc76-ab7a-4ac5-b580-bb8234d5f40f service neutron] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:24:29.006589 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1475/2955] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:24:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:24:29.080323 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0fbfb1-17b2-418c-bcf2-3b344c70e5a2 None None] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:24:29.082271 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-3a0fbfb1-17b2-418c-bcf2-3b344c70e5a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:24:29.099978 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0fbfb1-17b2-418c-bcf2-3b344c70e5a2 None None] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:24:29.106501 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100879a4-a544-406e-99d5-0e36664e1435 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0233b357708643be94c0ade17ac1fb3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:24:29.107148 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100879a4-a544-406e-99d5-0e36664e1435 service placement] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:24:29.107517 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100879a4-a544-406e-99d5-0e36664e1435 service placement] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:24:29.107797 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100879a4-a544-406e-99d5-0e36664e1435 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:24:29.110508 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-100879a4-a544-406e-99d5-0e36664e1435 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:24:29.123531 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100879a4-a544-406e-99d5-0e36664e1435 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:24:29.125284 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100879a4-a544-406e-99d5-0e36664e1435 service placement] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:24:29.136435 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1481/2956] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:24:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:24:30.110762 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541fcc76-ab7a-4ac5-b580-bb8234d5f40f service neutron] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:24:30.113254 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-541fcc76-ab7a-4ac5-b580-bb8234d5f40f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:24:30.132985 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541fcc76-ab7a-4ac5-b580-bb8234d5f40f service neutron] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:24:30.141363 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26a439f-5e31-4c78-93f0-f8d114e14549 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214d9071042c4bad886bf060a079b6e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:24:30.141736 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a439f-5e31-4c78-93f0-f8d114e14549 service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:24:30.141841 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a439f-5e31-4c78-93f0-f8d114e14549 service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:24:30.142072 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a439f-5e31-4c78-93f0-f8d114e14549 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:24:30.144762 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-a26a439f-5e31-4c78-93f0-f8d114e14549 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:24:30.170404 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26a439f-5e31-4c78-93f0-f8d114e14549 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:24:30.172086 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26a439f-5e31-4c78-93f0-f8d114e14549 service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:24:30.185372 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1476/2957] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:24:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:24:39.131616 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=32 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:24:40.180162 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=46 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:26:14.196572 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100879a4-a544-406e-99d5-0e36664e1435 service placement] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:26:14.209028 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100879a4-a544-406e-99d5-0e36664e1435 service placement] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:26:14.212748 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb599d3c-fd13-4137-b713-78ee65158c3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:26:14.213382 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb599d3c-fd13-4137-b713-78ee65158c3a service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:26:14.213660 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb599d3c-fd13-4137-b713-78ee65158c3a service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:26:14.213935 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb599d3c-fd13-4137-b713-78ee65158c3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:26:14.223093 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb599d3c-fd13-4137-b713-78ee65158c3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:26:14.224594 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb599d3c-fd13-4137-b713-78ee65158c3a service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:26:14.233726 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1482/2958] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:26:14 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:26:15.134787 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26a439f-5e31-4c78-93f0-f8d114e14549 service nova] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:26:15.148819 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26a439f-5e31-4c78-93f0-f8d114e14549 service nova] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:26:15.154495 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681a2d04-7a97-4192-8f0b-c753ec33ff27 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '214d9071042c4bad886bf060a079b6e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:26:15.155156 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681a2d04-7a97-4192-8f0b-c753ec33ff27 service nova] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:26:15.155465 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681a2d04-7a97-4192-8f0b-c753ec33ff27 service nova] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:26:15.155748 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681a2d04-7a97-4192-8f0b-c753ec33ff27 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:26:15.157561 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-681a2d04-7a97-4192-8f0b-c753ec33ff27 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:26:15.171124 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681a2d04-7a97-4192-8f0b-c753ec33ff27 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:26:15.172774 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681a2d04-7a97-4192-8f0b-c753ec33ff27 service nova] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:26:15.185667 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1477/2959] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:26:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:26:19.040460 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb599d3c-fd13-4137-b713-78ee65158c3a service neutron] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:26:19.049221 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb599d3c-fd13-4137-b713-78ee65158c3a service neutron] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:26:19.052942 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7f5ea0-9331-4670-b2cc-4ad86f570ad7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b78f1fcce4174d1a931453d930d306f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:26:19.053568 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f5ea0-9331-4670-b2cc-4ad86f570ad7 service neutron] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:26:19.054022 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f5ea0-9331-4670-b2cc-4ad86f570ad7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:26:19.054211 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f5ea0-9331-4670-b2cc-4ad86f570ad7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:26:19.127754 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7f5ea0-9331-4670-b2cc-4ad86f570ad7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:26:19.129230 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7f5ea0-9331-4670-b2cc-4ad86f570ad7 service neutron] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:26:19.140062 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1483/2960] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:26:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:26:22.302691 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681a2d04-7a97-4192-8f0b-c753ec33ff27 service nova] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:26:22.325498 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681a2d04-7a97-4192-8f0b-c753ec33ff27 service nova] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:26:22.331201 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd380120-ad51-4d6f-968e-a407e8d95cfa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0233b357708643be94c0ade17ac1fb3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:26:22.331970 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd380120-ad51-4d6f-968e-a407e8d95cfa service placement] REQUEST_METHOD: `GET` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:26:22.332325 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd380120-ad51-4d6f-968e-a407e8d95cfa service placement] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:26:22.332667 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd380120-ad51-4d6f-968e-a407e8d95cfa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:26:22.334718 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-bd380120-ad51-4d6f-968e-a407e8d95cfa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:26:22.347737 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd380120-ad51-4d6f-968e-a407e8d95cfa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:26:22.349401 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd380120-ad51-4d6f-968e-a407e8d95cfa service placement] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:26:22.363412 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1478/2961] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:26:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:26:25.619299 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7f5ea0-9331-4670-b2cc-4ad86f570ad7 service neutron] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:26:25.635018 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7f5ea0-9331-4670-b2cc-4ad86f570ad7 service neutron] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:26:25.640574 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e7b3bb-2f4f-4c14-a3fe-27b9e0fd6ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:26:25.641465 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e7b3bb-2f4f-4c14-a3fe-27b9e0fd6ec9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:26:25.641744 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e7b3bb-2f4f-4c14-a3fe-27b9e0fd6ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:26:25.642016 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e7b3bb-2f4f-4c14-a3fe-27b9e0fd6ec9 admin admin] PATH_INFO: `/v3/users/c88eeecaa0734de29f2ebe6fcf53cc10` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:26:25.643193 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e7b3bb-2f4f-4c14-a3fe-27b9e0fd6ec9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c88eeecaa0734de29f2ebe6fcf53cc10)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:26:25.645156 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e7b3bb-2f4f-4c14-a3fe-27b9e0fd6ec9 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:26:25.694277 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-f9e7b3bb-2f4f-4c14-a3fe-27b9e0fd6ec9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c88eeecaa0734de29f2ebe6fcf53cc10'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:26:25.701738 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-f9e7b3bb-2f4f-4c14-a3fe-27b9e0fd6ec9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c88eeecaa0734de29f2ebe6fcf53cc10'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:26:25.702417 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-f9e7b3bb-2f4f-4c14-a3fe-27b9e0fd6ec9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c88eeecaa0734de29f2ebe6fcf53cc10'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:26:25.703026 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-f9e7b3bb-2f4f-4c14-a3fe-27b9e0fd6ec9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c88eeecaa0734de29f2ebe6fcf53cc10'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:26:25.715302 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-f9e7b3bb-2f4f-4c14-a3fe-27b9e0fd6ec9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c88eeecaa0734de29f2ebe6fcf53cc10'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:26:25.730014 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1484/2962] 10.222.0.36 () {58 vars in 1223 bytes} [Fri Jun 24 23:26:25 2022] DELETE /identity/v3/users/c88eeecaa0734de29f2ebe6fcf53cc10 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 23:26:25.911420 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd380120-ad51-4d6f-968e-a407e8d95cfa service placement] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:26:25.922948 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd380120-ad51-4d6f-968e-a407e8d95cfa service placement] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:26:25.985966 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f9c1fa-5e83-484f-a357-d34a253d825f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:26:25.986853 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f9c1fa-5e83-484f-a357-d34a253d825f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:26:25.987131 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f9c1fa-5e83-484f-a357-d34a253d825f admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:26:25.987441 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f9c1fa-5e83-484f-a357-d34a253d825f admin admin] PATH_INFO: `/v3/projects/4affab7adf32480eb257f907a2277dd1` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:26:25.989270 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f9c1fa-5e83-484f-a357-d34a253d825f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4affab7adf32480eb257f907a2277dd1)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:26:25.991340 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f9c1fa-5e83-484f-a357-d34a253d825f admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:26:26.040353 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-89f9c1fa-5e83-484f-a357-d34a253d825f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4affab7adf32480eb257f907a2277dd1', 'request_id': 'req-89f9c1fa-5e83-484f-a357-d34a253d825f'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:26:26.046502 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-89f9c1fa-5e83-484f-a357-d34a253d825f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4affab7adf32480eb257f907a2277dd1', 'request_id': 'req-89f9c1fa-5e83-484f-a357-d34a253d825f'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:26:26.055833 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-89f9c1fa-5e83-484f-a357-d34a253d825f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4affab7adf32480eb257f907a2277dd1', 'request_id': 'req-89f9c1fa-5e83-484f-a357-d34a253d825f'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:26:26.066035 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-89f9c1fa-5e83-484f-a357-d34a253d825f admin admin] The token cache is being invalidate because project 4affab7adf32480eb257f907a2277dd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 23:26:26.066321 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-89f9c1fa-5e83-484f-a357-d34a253d825f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:26:26.066926 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-89f9c1fa-5e83-484f-a357-d34a253d825f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:26:26.068470 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1479/2963] 10.222.0.36 () {58 vars in 1232 bytes} [Fri Jun 24 23:26:25 2022] DELETE /identity/v3/projects/4affab7adf32480eb257f907a2277dd1 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 23:26:26.072737 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e7b3bb-2f4f-4c14-a3fe-27b9e0fd6ec9 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:26:26.074180 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-f9e7b3bb-2f4f-4c14-a3fe-27b9e0fd6ec9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:26:26.087980 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e7b3bb-2f4f-4c14-a3fe-27b9e0fd6ec9 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:26:26.148494 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:26:26.159496 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aad6a8-5642-4fa3-bf68-b0143fc325e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:26:26.160622 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aad6a8-5642-4fa3-bf68-b0143fc325e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:26:26.161063 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aad6a8-5642-4fa3-bf68-b0143fc325e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:26:26.161340 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aad6a8-5642-4fa3-bf68-b0143fc325e1 admin admin] PATH_INFO: `/v3/users/19989ed54e76428382d66be5ab18c9a5` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:26:26.162553 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aad6a8-5642-4fa3-bf68-b0143fc325e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19989ed54e76428382d66be5ab18c9a5)` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:26:26.164687 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aad6a8-5642-4fa3-bf68-b0143fc325e1 admin admin] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:26:26.216596 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-f3aad6a8-5642-4fa3-bf68-b0143fc325e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19989ed54e76428382d66be5ab18c9a5'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:26:26.223816 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-f3aad6a8-5642-4fa3-bf68-b0143fc325e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19989ed54e76428382d66be5ab18c9a5'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:26:26.224596 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-f3aad6a8-5642-4fa3-bf68-b0143fc325e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19989ed54e76428382d66be5ab18c9a5'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:26:26.225316 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-f3aad6a8-5642-4fa3-bf68-b0143fc325e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19989ed54e76428382d66be5ab18c9a5'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:26:26.239795 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.notifications [None req-f3aad6a8-5642-4fa3-bf68-b0143fc325e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19989ed54e76428382d66be5ab18c9a5'} {{(pid=80215) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:26:26.256261 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1485/2964] 10.222.0.36 () {58 vars in 1223 bytes} [Fri Jun 24 23:26:26 2022] DELETE /identity/v3/users/19989ed54e76428382d66be5ab18c9a5 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 23:26:26.436187 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f9c1fa-5e83-484f-a357-d34a253d825f admin admin] Authenticating user token {{(pid=80214) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:26:26.437763 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.fernet_utils [None req-89f9c1fa-5e83-484f-a357-d34a253d825f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80214) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:26:26.452004 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f9c1fa-5e83-484f-a357-d34a253d825f admin admin] Validating token access rules against request {{(pid=80214) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:26:26.509415 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5bc9e1-f8a5-408f-bf46-f69215dce552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1b71ca6ab0b436d901fe1079176cb45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed521bc1cbbe4ae1823626f007bced73', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80214) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:26:26.510300 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5bc9e1-f8a5-408f-bf46-f69215dce552 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:26:26.510579 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5bc9e1-f8a5-408f-bf46-f69215dce552 admin admin] SCRIPT_NAME: `/identity` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:26:26.510852 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5bc9e1-f8a5-408f-bf46-f69215dce552 admin admin] PATH_INFO: `/v3/projects/7c26645246f244f6b4355274d7437ae2` {{(pid=80214) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:26:26.512040 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5bc9e1-f8a5-408f-bf46-f69215dce552 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c26645246f244f6b4355274d7437ae2)` {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:26:26.513959 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5bc9e1-f8a5-408f-bf46-f69215dce552 admin admin] RBAC: Authorization granted {{(pid=80214) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:26:26.520128 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:26:26.562957 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-3c5bc9e1-f8a5-408f-bf46-f69215dce552 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c26645246f244f6b4355274d7437ae2', 'request_id': 'req-3c5bc9e1-f8a5-408f-bf46-f69215dce552'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:26:26.569147 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-3c5bc9e1-f8a5-408f-bf46-f69215dce552 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c26645246f244f6b4355274d7437ae2', 'request_id': 'req-3c5bc9e1-f8a5-408f-bf46-f69215dce552'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:26:26.579410 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-3c5bc9e1-f8a5-408f-bf46-f69215dce552 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c26645246f244f6b4355274d7437ae2', 'request_id': 'req-3c5bc9e1-f8a5-408f-bf46-f69215dce552'} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:26:26.590903 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-3c5bc9e1-f8a5-408f-bf46-f69215dce552 admin admin] The token cache is being invalidate because project 7c26645246f244f6b4355274d7437ae2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80214) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 23:26:26.591192 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-3c5bc9e1-f8a5-408f-bf46-f69215dce552 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:26:26.591862 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG keystone.notifications [None req-3c5bc9e1-f8a5-408f-bf46-f69215dce552 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80214) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 23:26:26.593453 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: [pid: 80214|app: 0|req: 1480/2965] 10.222.0.36 () {58 vars in 1232 bytes} [Fri Jun 24 23:26:26 2022] DELETE /identity/v3/projects/7c26645246f244f6b4355274d7437ae2 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 23:26:36.252881 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:26:36.588122 dv-cinder-847620-1-iscsi devstack@keystone.service[80214]: DEBUG dbcounter [-] [80214] Writing DB stats keystone:SELECT=22,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 23:27:42.791622 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aad6a8-5642-4fa3-bf68-b0143fc325e1 admin admin] Authenticating user token {{(pid=80215) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 23:27:42.793640 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-f3aad6a8-5642-4fa3-bf68-b0143fc325e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:27:42.882928 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aad6a8-5642-4fa3-bf68-b0143fc325e1 admin admin] Validating token access rules against request {{(pid=80215) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 23:27:42.942458 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d922cf16-237d-4fe5-8f25-0b87a39cdd5a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0233b357708643be94c0ade17ac1fb3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd189b31bbec0469381292d2cde3cb420', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80215) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 23:27:42.943117 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d922cf16-237d-4fe5-8f25-0b87a39cdd5a service placement] REQUEST_METHOD: `GET` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 23:27:42.943440 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d922cf16-237d-4fe5-8f25-0b87a39cdd5a service placement] SCRIPT_NAME: `/identity` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 23:27:42.943715 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d922cf16-237d-4fe5-8f25-0b87a39cdd5a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80215) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 23:27:42.945689 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.fernet_utils [None req-d922cf16-237d-4fe5-8f25-0b87a39cdd5a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80215) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 23:27:42.958300 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d922cf16-237d-4fe5-8f25-0b87a39cdd5a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 23:27:42.959919 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d922cf16-237d-4fe5-8f25-0b87a39cdd5a service placement] RBAC: Authorization granted {{(pid=80215) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 23:27:42.970936 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: [pid: 80215|app: 0|req: 1486/2966] 10.222.0.36 () {60 vars in 1365 bytes} [Fri Jun 24 23:27:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 23:27:52.966228 dv-cinder-847620-1-iscsi devstack@keystone.service[80215]: DEBUG dbcounter [-] [80215] Writing DB stats keystone:SELECT=63 {{(pid=80215) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}